feat(staging): validation cycle — env, smoke, live LLM, fixture fix - #71
Conversation
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars. ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Advanced Run ID: Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Aparnap2
left a comment
There was a problem hiding this comment.
STAGING REVIEW: ACCEPT pending human merge.
- Deterministic staging smoke is green.
- Fresh-DB migration/seed ordering is fixed and tenant isolation verified.
- Live Groq result 5/14 is recorded without weakening thresholds; failures are split into harness/contract issues plus one real calibration miss.
- Exact 6-file scope; no frozen P6/P7/P8 contract changes.
Next after merge: use F2 fake/replay cases to fix the harness and refusal mapping first; then rerun the 14 live cases. Do not burn credits on broad scenario expansion. Before production, replace env_file secrets, canonicalize approval stack, quarantine finance/llm, and complete real AWS E2E.
Staging validation on boring stack (API + PG). Deterministic smoke green (201/200/403/200/422); live Groq eval 5/14 with harness-artifact failures recorded unweakened; tenant fixture alembic-first fix; proposal rebuild seam + healthcheck fix; STAGING_VALIDATION.md with blockers. Production claim stays NOT READY. Evidence: docs/release/STAGING_VALIDATION.md.