fix(e2e): gate tests on a served response and keep failure artifacts - #819
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Blocked merge diagnosis — blocked |
GitNexus Review · PR #819GitNexus reviewed 4 changed files. 🤖 Agent context — 4 filesSummaryThis appears to be a test-harness and CI workflow change with no graph-detected code dependents or execution-flow reach. Review attention should center on the workflow configuration, which carries the elevated file risk. 🟠 HIGH blast radius. A test and CI configuration change spanning The change is concentrated in Playwright configuration, an e2e harness test, and the associated planning document at Review
What changedChanged Files (4)
What to checkFile Risk (2)
Full detail lives in the GitNexus check run for this commit. |
Up to standards ✅🟢 Issues
|
| Metric | Results |
|---|---|
| Complexity | 0 |
| Duplication | 0 |
NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.
Amp-Thread-ID: https://ampcode.com/threads/T-01a0cf2b-5969-7627-bccd-702e8d30adda Co-authored-by: Amp <amp@ampcode.com>
71fc043 to
6f13a09
Compare
GitNexus Review · PR #819No issues found in 4 changed files. 🤖 Agent context — 4 filesSummaryThis appears to be a test-harness and CI workflow change with no graph-detected code dependents or execution-flow reach. Review attention should center on the workflow configuration, which carries the elevated file risk. 🟠 HIGH blast radius. A test and CI configuration change spanning The change is concentrated in Playwright configuration, an e2e harness test, and the associated planning document at Review
What changedChanged Files (4)
What to checkFile Risk (2)
Full detail lives in the GitNexus check run for this commit. |

Two defects that surfaced when PR #817's E2E job failed 140 of 149 tests, and left nothing behind to explain it.
1. Readiness was a bound port, not a served response
webServer.port: 3000is satisfied the momentnext devbinds, while it is still compiling — tests started 3 seconds after the server did. A server that cannot answer yet then fails every navigating test on its own 5-second readiness wait, which reads as 140 broken tests. The job now waits onurl(a real HTTP response, 120 s budget), and pipes the dev server's own output into the log.2. A failing E2E run kept no evidence
The job uploaded
playwright-report/on failure, butreporter: 'list'never creates that directory — the artifact list from that run holds only the coverage report. Meanwhiletrace: 'on-first-retry'was writing traces intotest-results/, which no step uploaded. The upload now covers both directories, and CI writes the HTML report so the report path exists at all.Verification
src/lib/__tests__/e2e-harness.test.tsloads the real config (withCIstubbed, since the reporter depends on it) and the real workflow. Each assertion was mutation-checked:url→port: 3000waits for a served response, not a bound portfailstest-results/from the uploaduploads the traces alongside the reportfailsreporter→'list'in CIwrites the HTML report in CIfailspnpm exec playwright test e2e/home.spec.ts e2e/graph-density.spec.ts --project=chromium— 10 passed../scripts/quality_gate.sh— all gates passed.The cold-start path is verified by this PR's own CI run, which starts the server itself and must now see a served response before the first test begins.
plans/153records what is not explained (the underlying stall) and what the next occurrence will now reveal.📝 Summary by GitNexus
Summary
This appears to be a test-harness and CI workflow change with no graph-detected code dependents or execution-flow reach. Review attention should center on the workflow configuration, which carries the elevated file risk.
🟠 HIGH blast radius. A test and CI configuration change spanning
playwright.config.ts,src/lib/__tests__/e2e-harness.test.ts, and.github/workflows/ci-and-labels.yml, with no detected dependents.The change is concentrated in Playwright configuration, an e2e harness test, and the associated planning document at
plans/153-e2e-harness-readiness-and-artifacts-2026-09-24.md. The title and paths indicate updates to test readiness gating and failure-artifact handling.Review
.github/workflows/ci-and-labels.ymlfirst, as it is the HIGH-risk file. Then verify thatplaywright.config.tsandsrc/lib/__tests__/e2e-harness.test.tsremain aligned with the CI execution environment and expected artifact behavior.Added by GitNexus for PR #819. Edit freely — this block is replaced on the next review, everything above it is left untouched.