reproducibility-checklist-audit
Assess paper completeness against ML Reproducibility Checklist
Browse reusable Agent Skills, each with a clear purpose and practical guidance.
Assess paper completeness against ML Reproducibility Checklist
Verify result reproducibility via re-runs with different seeds and ICC comparison
Validate results through statistical testing, ROPE judgment, reproducibility re-runs, and final synthesis
Hostile reviewer perspective — find fatal flaws, logical gaps, and missing evidence in a solution.
Design experiments to identify failure boundaries and robustness limits
Two-phase sensitivity — Morris quick screening to eliminate unimportant factors, then Sobol precise decomposition on survivors. Efficient allocation of analytical effort.
Rate failure mode severity 1-10 based on end-effect impact. Follows AIAG-VDA severity scale calibrated for research artifacts.
Steel-Manning Campaign — adversarial verification of convergence decisions through resurrection advocacy, winner stress-testing, criteria interrogation, and multi-perspective attack using Devil's Advocacy, Pre-mortem, Red Teaming, Dialectical Inquiry methods.
Determines whether validation has reached saturation — no new weaknesses or failure modes being discovered. Used by all 5 campaigns as termination signal.
Tactic: List all factors, remove one at a time, assess conclusion stability, rank factors by load-bearing importance.