Drift Review
Testing & Qualitydrift-reviewDrift Review is an Agent Skill for testing & quality published in the Pipelex/pipelex repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Resolve open drift contracts — the review obligations between code and docs declared in drift.toml. Use whenever `make drift-check` (or the `make check` aggregate, or the CI lint-drift job) fails with open contracts, when the user says "drift check failed", "resolve the drift contract", "ack the drift", "run drift plan", or after any change that touches drift trigger files (the config model / pipelex.toml, CLI code, the keyword-only guard). Also use when recording a drift dogfood observation. Performs the review for real, records an honest ack, and logs the dogfood observation the pilot phase depends on.
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Inspect the Agent Skill at https://github.com/Pipelex/pipelex/blob/HEAD/.claude/skills/drift-review/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/drift-review, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
Drift Review
Resolve open drift contracts: review the declared targets against what actually changed, fix staleness, record the ack, log a dogfood observation. Full system reference: docs/contribute/drift-contracts.md. The manifest is drift.toml at the repo root.
A contract is "open" when tracked files matching its triggers changed (in the git index) since the last recorded review — or the contract definition itself changed, or it never had an ack. The tool proves that a review happened; this skill's job is to make the review genuine. There is deliberately no bypass anywhere in the system — the legitimate escape is an honest "nothing to update" rationale, which is cheap and auditable.
Workflow
1. See what's open
make drift-plan # all open contracts
make drift-plan CONTRACT=<id> # one contract's full packet
Each packet gives you: the description, exactly which trigger files were added/removed/modified since the last ack, the review targets, the verify commands, the previous ack's rationale, and the exact ack command to run.
2. Review — this is the point, not a formality
Work from the trigger diff to the review targets:
- For each added/modified/removed trigger file, identify what a reader of the review targets could observe changing: new, renamed, or removed options, settings, defaults, commands, behaviors. Use
git diffon the trigger files; the previous ack's rationale tells you what the last review already covered, so focus on what changed since. - Grep the review targets for the changed names, settings, and symbols — then read the surrounding prose. A mention can be present but stale (wrong default, wrong behavior, incomplete), not just missing.
- Fix what's stale, following the repo's doc rules: docs describe current reality, no hardcoded counts, MkDocs conventions (blank line before lists).
- "Nothing to update" is a legitimate verdict — but only after you actually opened and read the review targets. If you didn't open them, you haven't reviewed.
3. Stage, then ack
The digest is computed from the git index, not the working tree: git add the trigger files (and any doc fixes you made). Staging is enough — no commit needed first, and unrelated unstaged changes elsewhere are fine. Take drift ack's warnings about untracked or unstaged-modified matched files seriously: an unstaged edit is invisible to the ack. For a contract with verify commands, a matched unstaged or untracked file is a hard error (the verify run would certify content the digest does not cover) — stage the files, then re-run.
make drift-ack CONTRACT=<id> RATIONALE="<honest sentence>" BY="<your identity>"
As an agent, always pass BY with your own actual identity — the model you are actually running as, in the form BY="Claude (<your model name>)". Do not copy a model name from an example or from a previous ack; the reviewer field is audit data and must name who really did the review. Never ack under the human's git config user.name. The contract's verify commands run first (no shell, fail-fast); a failure aborts the ack. Fix what the verifier caught — do not look for a bypass; none exists, by design.
The rationale is the on-the-record review decision. It must say what was reviewed and what the verdict was:
- Bad:
"docs fine","reviewed","re-ack after refactor" - Good:
"Documented the new activity_queues setting in general-config.md; other config pages unaffected." - Good:
"CLI change is internal plumbing (renamed a private helper); no user-visible surface moved; cli docs and agent-CLI contract doc verified unchanged."
4. Verify and commit
make drift-check must pass. drift ack stages the ack file it writes; commit the ack file(s) under .drift/acks/ together with the change they cover — the rationale lands in the PR diff next to the change, which is the audit trail. Never hand-edit files under .drift/acks/.
Mandatory: log the dogfood observation
The drift system is in its pilot phase, and the one question only usage can answer is: is the ack friction proportionate to the staleness caught? Every ack must therefore produce one evidence entry — the per-contract keep/narrow/mechanize/drop verdict will be decided from this log.
Append to wip/drift-contracts/dogfood-log.md (create it with this header if missing):
# Drift-contracts dogfood log
One entry per ack. Verdicts: **real-catch** (the review found actual staleness), **clean-pass** (genuinely reviewed, nothing was stale), **friction** (the contract opened on changes that could not have affected the targets — candidate for narrowing or mechanizing).
- **YYYY-MM-DD · <contract-id> · <verdict>** — one sentence: what triggered the contract, what the review found.
A clean-pass is a fine outcome; a pattern of clean-passes on the same contract is signal. When you record friction, also say which trigger narrowing would have prevented the false opening.
Failure modes
drift checkfails on manifest rot (dead trigger glob, zero-match review target, orphan ack, id/filename mismatch): the manifest itself needs fixing — editdrift.tomlfirst (typically a rename left a glob dead), then re-review and re-ack. Editing a contract reopens it; that is expected.- A verify command fails: it caught something real — fix it; the ack stays blocked until the verifier passes.
- A contract keeps reopening on edits that cannot affect its targets: keep recording
frictionentries and propose a trigger narrowing to the user. During the pilot, do not grow the manifest (no new contracts) without the user's explicit say-so — growth follows pain, not tooling enthusiasm.