Skip to content

Add official NZ WFF and IWTC source facts - #209

Draft
MaxGhenis wants to merge 9 commits into
mainfrom
nz-wff-iwtc-official-targets
Draft

Add official NZ WFF and IWTC source facts#209
MaxGhenis wants to merge 9 commits into
mainfrom
nz-wff-iwtc-official-targets

Conversation

@MaxGhenis

@MaxGhenis MaxGhenis commented Aug 30, 2026

Copy link
Copy Markdown
Contributor

Summary

Implements package 8 of the canonical New Zealand wave-1 inventory in #176:
ird/working_for_families_statistics_sept_2025. This targets main after #208's
country-storage and period conventions merged as 10597ae. It does not close #176 or claim that
Microcosm calibration or reform scoring is live.

  • Pin Inland Revenue's original September 2025 workbook, unchanged (71,211
    bytes; SHA-256 95ae66f4d44f3f47ea3daa006328b22f061a163cf7e31b487342cde649390833).
  • Emit 330 administrative source facts for the 2024 NZ tax year: national
    WFF/FTC/MFTC/IWTC/BSTC recipient-family counts and aggregate entitlements,
    supported children and family sizes, and the complete 39-row, 8-measure
    published family-income table.
  • Preserve country NZ and tax-year coverage 2023-04-01 through 2024-03-31.
    Counts describe non-zero administrative entitlements, not all eligible
    families or cash paid during a financial year.
  • Keep source income labels, unknown-income rows, publisher totals, and
    independently rounded amounts. Do not infer interval boundaries, impute a
    residual, reconcile tables, age values, or build solver targets. The explicit
    rounding-adjustment row is parsed and pinned in tests, not emitted as a
    population fact. Obsolete blank credits and the average-entitlement table
    are outside this package's emitted count-and-total-amount scope.
  • Publish the single workbook under its immutable raw/nz/ird/... key and
    verify its checksum after downloading it again. The R2 manifest update is
    isolated in commit 25f5aba after the source pin in c9d6eae.

Verification

  • Post-review source/storage/core/consumer/import/schema tests: 112 passed.
  • The income-definition correction retains entitlement-time-weighted assessed family scheme income and the Work and Income non-filer fallback to individual tax-return income excluding partners, in every consumer-facing income measure note.
  • uv run ruff check and git diff --check: passed.
  • build-suite for the WFF package: all 12 source acceptance checks passed;
    4,910 source cells, 330 source records/facts/consumer rows, 100% cell lineage,
    one checksum-pinned raw artifact with an R2 link, zero acceptance errors.
  • Single-source build-bundle --year 2023: passed with 330 facts, tax year
    still 2024, one source/geography, zero duplicate keys/errors/warnings.
  • Full default-bundle expectations updated by the measured WFF-only delta:
    +330 facts, +1 source/package/geography, +329 family facts and +1 person fact.
    The full all-country bundle test is left to CI to avoid repeating its long
    CPU-intensive build on the user's laptop; no full-suite-green claim here.
  • Axiom concept validation was not requested: these are IRD source-label
    concepts, not model-variable bindings. The suite records that unchecked
    alignment warning explicitly.

Downstream identifiers

Alias: ird-working-for-families-statistics-sept-2025; publisher: ird.

  • WFF families: ird_wff_statistics.ty2024.recipient_families.all.wff_recipient_families
  • IWTC families: ird_wff_statistics.ty2024.recipient_families.all.iwtc_recipient_families

These exact scalar IDs distinguish the national totals from the 39 income-table
rows sharing each source measure. Consumer measurement and any receipt/take-up
mapping remain in Microcosm.

Review gates

Independent ledger-source-fidelity and ledger-boundary reviews PASS at 98465d5. The source, checklist, and regression-test files are unchanged after merging main at eb6ca1b. #208 is merged; passing CI for the current head remains required before merge. The UK copy-only migration remainder in #175 is separate and not changed here.

Route new raw and derived artifacts through country-aware publisher prefixes, refuse stale manifest keys, and record NZ period/geography rulings. Preserve legacy US paths and leave UK object copying and manifest migration to a separate credentialed change.
Restrict publisher inference to canonical package roots, preserve cached bytes on rejected routes, and correct the stale quartile ruling using the existing quantile contract. Targeted schema, consumer, artifact, core, and import checks: 83 passed.
WFF-only bundle: 330 facts, 329 family + 1 person, one source/package/country, tax_year 2024, zero aggregate or semantic duplicate keys.

Default bundle expectations: 171855 + 330 = 172185 facts; 43 + 1 = 44 sources; 151 + 1 = 152 packages; 12536 + 1 = 12537 geographies; 107 + 329 = 436 family facts; 60466 + 1 = 60467 person facts; TY2024 40 + 330 = 370; 146 + 1 = 147 source tables. Period and duplicate counts are unchanged. Source-only build measured locally; all-country bundle remains a CI check.

Describe the average-entitlement table as outside emitted scope, not as an exact algebraic duplicate of independently rounded count/amount tables.
@MaxGhenis
MaxGhenis changed the base branch from nz-source-conventions-175 to main August 30, 2026 01:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

NZ source packages, wave 1: the populace-nz v1 16-margin surface

1 participant