# Flaky Detector

> Flaky Detector is an Agent Skill for testing & quality published in the hashgraph-online/awesome-codex-plugins repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Detect flaky tests by running a test command N times

- Skill name: `flaky-detector`
- Category: [Testing & Quality](https://www.openparable.com/skill/testing-quality/1)
- Source: https://github.com/hashgraph-online/awesome-codex-plugins/blob/HEAD/plugins/mturac/flaky-detector/skills/flaky-detector/SKILL.md
- Repository: hashgraph-online/awesome-codex-plugins (652 GitHub stars when collected)

## SKILL.md

Role: act as a flake hunter. Identify tests that don't always agree with themselves.

Run the helper:

```bash
python3 scripts/flaky.py --cmd "pytest -q" --runs 10 --format md
```

Useful flags: `--parser pytest|jest|gotest|tap`, `--parallel N`, `--out report.json`.

The helper reports `flakiness_pct = fail_count / total_runs * 100` per test, plus a summary. Exit codes: `0` clean, `1` flaky tests found, `2` always-failing tests found. Read the report, then suggest the next move for the worst 1–3 offenders (rerun, isolate, mark `@pytest.mark.flaky`, or root-cause). Don't speculate beyond what the output supports.

---

Source: https://www.openparable.com/skill/testing-quality/flaky-detector (OpenParable). Cite the canonical URL above.
