Skip to content

Collect all V4 focused audit reports - #3533

Merged
joshlf merged 1 commit into
mainfrom
Gowcssqoviioleh66rgjls4bafqwd4l5n
Sep 3, 2026
Merged

Collect all V4 focused audit reports#3533
joshlf merged 1 commit into
mainfrom
Gowcssqoviioleh66rgjls4bafqwd4l5n

Conversation

@joshlf

@joshlf joshlf commented Aug 3, 2026

Copy link
Copy Markdown
Member

Generate and preserve the complete 50-report canonical corpus under the frozen
blind protocol. Keep condition identities sealed and leave the packages,
prompts, fixtures, rubrics, authority sets, and release gates unchanged.

Record 54 total attempts. Four infrastructure failures are retried under the
preregistered rules; every canonical report validates and remains within its
output cap. Preserve the raw reports, attempt metadata, validator output, and
collection integrity records so later scoring can distinguish model behavior
from orchestration behavior.

This commit closes report collection only. It contains no scoring result,
unblinding, semantic interpretation, or revision to the skill.

Agent-Authored-By: AI agent acting on Josh Liebow-Feeser's behalf


This PR is on branch codex/unsafe-rust-stack.

Latest Update: v20 — Compare vs v19

📚 Full Patch History

Links show the diff between the row version and the column version.

Version v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v20 v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v8 v7 v6 v5 v4 v3 v2 v1 Base
v7 v6 v5 v4 v3 v2 v1 Base
v6 v5 v4 v3 v2 v1 Base
v5 v4 v3 v2 v1 Base
v4 v3 v2 v1 Base
v3 v2 v1 Base
v2 v1 Base
v1 Base
⬇️ Download this PR

Branch

git fetch origin refs/heads/Gowcssqoviioleh66rgjls4bafqwd4l5n && git checkout -b pr-Gowcssqoviioleh66rgjls4bafqwd4l5n FETCH_HEAD

Checkout

git fetch origin refs/heads/Gowcssqoviioleh66rgjls4bafqwd4l5n && git checkout FETCH_HEAD

Cherry Pick

git fetch origin refs/heads/Gowcssqoviioleh66rgjls4bafqwd4l5n && git cherry-pick FETCH_HEAD

Pull

git pull origin refs/heads/Gowcssqoviioleh66rgjls4bafqwd4l5n

Stacked PRs enabled by GHerrit.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c4249a62e8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from c4249a6 to a0b0714 Compare August 29, 2026 10:42
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from e57a8d4 to 64bcd22 Compare August 29, 2026 10:42
@codecov-commenter

codecov-commenter commented Aug 29, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.85%. Comparing base (cbbe1de) to head (cb5124c).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3533   +/-   ##
=======================================
  Coverage   91.85%   91.85%           
=======================================
  Files          20       20           
  Lines        6093     6093           
=======================================
  Hits         5597     5597           
  Misses        496      496           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from a0b0714 to efd636c Compare August 29, 2026 11:11
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 64bcd22 to b3e8e85 Compare August 29, 2026 11:11
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from efd636c to c2cdf0a Compare September 1, 2026 22:15
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from c2cdf0a to e8899de Compare September 2, 2026 20:45
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 0f43205 to 74a1213 Compare September 2, 2026 20:45
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 74a1213 to f896258 Compare September 2, 2026 21:51
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch 2 times, most recently from 3035967 to cb44cae Compare September 2, 2026 22:28
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from c0a6959 to fbc9c93 Compare September 2, 2026 23:04
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch 2 times, most recently from 32effbc to 82b772a Compare September 3, 2026 00:07
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from 6874910 to d4b141e Compare September 3, 2026 01:00
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch 2 times, most recently from 66274a6 to 6e64f6c Compare September 3, 2026 01:33
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from d4b141e to 6bba97d Compare September 3, 2026 01:33
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 6e64f6c to 5e0f1ea Compare September 3, 2026 02:26
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from 0ea0029 to 4720761 Compare September 3, 2026 03:03
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 5e0f1ea to 06696d0 Compare September 3, 2026 03:03
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 4720761 to 69fd512 Compare September 3, 2026 04:06
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 06696d0 to 2369a5d Compare September 3, 2026 04:06
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 69fd512 to 856b8e7 Compare September 3, 2026 04:42
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 2369a5d to 3547511 Compare September 3, 2026 04:42
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 856b8e7 to dab498a Compare September 3, 2026 05:14
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 3547511 to 0b3185d Compare September 3, 2026 05:14
Base automatically changed from Gpt2gxvx72macbs3xnoxkx7o3k5mtekib to main September 3, 2026 05:46
Generate and preserve the complete 50-report canonical corpus under the frozen
blind protocol. Keep condition identities sealed and leave the packages,
prompts, fixtures, rubrics, authority sets, and release gates unchanged.

Record 54 total attempts. Four infrastructure failures are retried under the
preregistered rules; every canonical report validates and remains within its
output cap. Preserve the raw reports, attempt metadata, validator output, and
collection integrity records so later scoring can distinguish model behavior
from orchestration behavior.

This commit closes report collection only. It contains no scoring result,
unblinding, semantic interpretation, or revision to the skill.

gherrit-pr-id: Gowcssqoviioleh66rgjls4bafqwd4l5n
Agent-Authored-By: AI agent acting on Josh Liebow-Feeser's behalf
@joshlf
joshlf force-pushed the Gowcssqoviioleh66rgjls4bafqwd4l5n branch from 0b3185d to cb5124c Compare September 3, 2026 05:47
@joshlf
joshlf enabled auto-merge September 3, 2026 05:48
@joshlf
joshlf added this pull request to the merge queue Sep 3, 2026
Merged via the queue into main with commit d52a36d Sep 3, 2026
105 checks passed
@joshlf
joshlf deleted the Gowcssqoviioleh66rgjls4bafqwd4l5n branch September 3, 2026 06:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants