Skip to content

test-plan-ui-verify

Browser-based UI test execution against live ODH/RHOAI clusters. Uses a two-step flow: ui_prepare.py (deterministic setup in terminal) followed by Claude Code execution. Loads TC-*.md files from a GitHub PR or repo folder, executes each via a persistent Playwright CDP browser, and produces a visual HTML report with PASS/FAIL/BLOCKED/INCOMPLETE verdicts and highlighted screenshots. Supports upgrade testing workflow with pre/post phase comparison and regression detection.

Plugin: test-plan | User-invocable

Contract

Skill Contract canonical-skill-v1

Execute UI test cases against a prepared live browser session and produce evidence-backed verification reports.

Identity

Functions
verify
Success
  • Records case actions, assertions and screenshots with the session test log.
  • Produces Markdown and HTML reports with the documented PASS, BLOCKED, INCOMPLETE and FAIL verdicts.

Optimization Targets

task_success judge instructions.md @ d13995e

Invariants

Must Preserve
  • Use verdict precedence FAIL, INCOMPLETE, BLOCKED, PASS; a case without UI steps is BLOCKED.
  • Keep inspection mode read-only and separate from official verification results; enforce retry and no-progress limits.
Fixed Context
documentsskills/test-plan-ui-verify/SKILL.md, skills/test-plan-ui-verify/instructions.md
knowledgetask_inputtask_private

Traceability

Skill
skills/test-plan-ui-verify/SKILL.md
Supporting

Diagram

test-plan-ui-verify diagram

Usage

python3 scripts/ui_prepare.py --test-plan-pr https://github.com/org/repo/pull/5
python3 scripts/ui_prepare.py --test-plan-pr <url> --tc TC-UI --priority P0
python3 scripts/ui_prepare.py --test-plan-pr <url> --upgrade-phase pre
/test-plan-ui-verify