feat(run): serve tool-calling examples from the response cache - #26

Merged

babaliauskas merged 14 commits into

mainfrom

feat/cache-tool-calls

Oct 1, 2026

Commits on Oct 1, 2026

feat(cache): store a parsed tool trace alongside a cached response

babaliauskas
and
claude
committed
acea337
test: keep the suite off the developer's real response cache

babaliauskas
and
claude
committed
9b9b918
feat(run): serve tool-calling examples from the response cache

babaliauskas
and
claude
committed
05fe063
docs: tool-calling examples are served from the response cache

babaliauskas
and
claude
committed
7bb4a69
refactor(client): extract serialize_tools as the one tools-array builder

babaliauskas
and
claude
committed
3ef13f6
fix(run): key tool rounds on the tools array exactly as sent

babaliauskas
and
claude
committed
ac70f13
fix(cache): tolerate concurrent opens racing to create or migrate the schema

babaliauskas
and
claude
committed
59c00b3
fix(report): keep partly cached rows out of live latency

babaliauskas
and
claude
committed
4efc7c3
fix(run): translate a tool item's generation config once

babaliauskas
and
claude
committed
0903f1e
docs: tool rounds key the tool list as sent; partly cached latency

babaliauskas
and
claude
committed
fc4fc0b
fix(report): no latency change when one role measured nothing live

babaliauskas
and
claude
committed
c35fb30
fix(cache): dispose the engine when opening the cache fails

babaliauskas
and
claude
committed
acbf15f
chore: tidy report wording, a docstring and text wrapping

babaliauskas
and
claude
committed
89590b4
docs(changelog): note the -100% latency fix

babaliauskas
and
claude
committed
b55e155