Regenerate Goldens
Testing & Qualityregenerate-goldensRegenerate Goldens is an Agent Skill for testing & quality published in the marcinz606/NegPy repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Use when a deliberate look/pipeline change has shifted NegPy's golden / characterization test values and they need updating — e.g. after changing the working-space TRC or primaries, the print curve, a lab/toning default (saturation, vibrance), or any default that alters rendered output, and a snapshot test now fails. Keywords: golden, goldens, characterization test, snapshot, regenerate, update expected values, test_scene_linear_relocation, test_characteristic_curve, _GOLDEN, look drift.
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Inspect the Agent Skill at https://github.com/marcinz606/NegPy/blob/HEAD/.claude/skills/regenerate-goldens/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/regenerate-goldens, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
Regenerate goldens
Overview
A few tests pin rendered output as hardcoded "golden" values — they exist to catch unintended drift in the look. When you change the pipeline on purpose (a default, the TRC, primaries, a curve), those snapshots go stale and must be re-baselined.
Core principle — this is the one thing to get right: only regenerate a golden when the change that moved it was intentional. A failing golden after an unrelated edit is a real regression — fix the code, do not bless the new numbers. Regenerating to silence a surprise defeats the entire point of the test.
Which tests carry rendered goldens
tests/test_scene_linear_relocation.py—_GOLDEN: full-engine output (6 pixels × default /expo_dark/expo_cmy). Depends on the whole creative chain, so it shifts on almost any look change: working TRC/primaries, print curve, lab/toning/finish defaults (saturation, vibrance, etc.).tests/test_characteristic_curve.py::test_default_curve_shape—golden: the default print curve sampled at x = 0, .25, .5, .75, 1 (exposure kernel only). Shifts on TRC or print-curve changes, not on lab/saturation.
Not rendered snapshots (do not use this skill for them):
test_working_oetf.py— values are defined by the TRC formula; hand-edit if you change the curve.test_lab_colorspace.py/test_lab_logic.py— assert structural properties / explicit inputs, not default-look pixels. A failure there usually means a real math change.- Parity tests (
test_pipeline_parity.py) — relative CPU↔GPU; default-value changes apply to both sides, so they don't need regeneration.
Workflow
-
Confirm the change was intentional. If you can't name why the look moved, stop and investigate — that's a regression, not a golden update.
-
See what actually fails so you only touch real snapshots:
make testExpect
test_scene_linear_relocationand/ortest_characteristic_curveif the change is look-affecting. Anything else failing is a separate signal — read it, don't auto-bless. -
Print the new values:
uv run python .claude/skills/regenerate-goldens/regenerate.pyIt imports each test's own image / sample-point / curve helpers, so those stay in sync; only the relocation config list is mirrored in the script — if you add or remove a config or sample point in the test, update the script to match.
-
Paste the printed blocks over
_GOLDEN(relocation) andgolden(characteristic curve). Keep the surrounding comment/docstring accurate (which TRC, which default). -
Re-run to confirm green and eyeball the magnitude of the shift — a tiny tweak that moved a pixel by 0.4 is a red flag the change did more than intended:
make test -
If a non-golden test (lab_logic L* tolerance, etc.) also moved, decide per-test whether the new behaviour is correct before loosening a bound — don't widen tolerances to pass.