Skip to content

Archive v0.3: Model/Test detail, evolution timeline and comparison - #18

Merged
WangEn merged 13 commits into
mainfrom
archive/v0.3-model-test-comparison
Sep 24, 2026
Merged

WangEn merged 13 commits into
mainfrom
archive/v0.3-model-test-comparison

Conversation

@WangEn

@WangEn WangEn commented Sep 24, 2026

Copy link
Copy Markdown
Contributor

Goal

Move Modelapse from individual Run records toward a navigable model evolution archive.

Public routes

/models/<model-id>
/tests/<test-case-id>
/compare

Model detail

Adds a public canonical Model view with:

  • provider / family / track identity;
  • release and retirement metadata;
  • provider snapshots;
  • explicit model relations;
  • public Test coverage;
  • recent sealed Runs;
  • a dated evolution timeline combining catalog lifecycle, snapshot validity, relations and sealed public Runs.

The timeline is descriptive: it does not infer quality or rank models.

Test detail

Adds a public Test Case view with:

  • family / variant / version / case identity;
  • definition, prompt, fixture and evaluator hashes;
  • origin / license / publication / active-window metadata;
  • model coverage from sealed public Runs;
  • recent Run history.

Comparison foundation

Adds a same-Test comparison surface for 2–4 canonical models.

For each model it retrieves the latest sealed public Run for the exact selected Test Case and presents:

  • Run identity and completion time;
  • requested / returned model IDs;
  • execution path and evidence level;
  • evaluator and deterministic result when present.

No overall score, winner, ranking or cross-Test aggregate is computed.

Public API

GET /v1/archive/models/:modelId
GET /v1/archive/tests/:testCaseId
GET /v1/archive/compare?modelIds=<2-4 UUIDs>&testCaseId=<UUID>

These remain public Archive reads and do not cross the operator/control boundary.

Verification

Extends PostgreSQL integration coverage with a canonical model, snapshot, model relation, sealed Run, Model detail, Test detail, timeline and 2-model comparison.

@WangEn
WangEn merged commit 87ef6f8 into main Sep 24, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant