OpenParable
Skip to content

Testing & Quality skills

Browse reusable Agent Skills, each with a clear purpose and practical guidance.

pldi-experiments

Use when designing or auditing a PLDI evaluation — choosing defensible benchmark suites and baseline compiler configurations, measuring runtime, compile time, and memory with warmup and variance discipline, running ablations that isolate the claimed mechanism, and scoping claims to the platforms measured.

805 repo stars98 repo forks
Testing & Quality

pldi-reproducibility

Use when hardening a PLDI paper's measurements against the SIGPLAN Empirical Evaluation Guidelines — warmup and steady-state discipline, variance and confidence reporting, principled benchmark choice, pinned toolchains, cross-platform validity, and a measurement log that survives artifact evaluation.

805 repo stars98 repo forks
Testing & Quality

podc-reproducibility

Use when making an ACM PODC paper's result independently checkable — reproducibility for a proofs venue, not an artifact venue. Covers a self-contained proof appendix, an explicit and checkable model/assumption box, honest handling of any optional simulation, and keeping the full version (with proofs) in sync with the 10-page camera-ready.

805 repo stars98 repo forks
Testing & Quality

pods-reproducibility

Use when strengthening the verifiability of an ACM PODS paper — a complete claim-to-proof map, self-contained proofs in the at-submission appendix (no external appendices), correctly stated assumptions, honest scope and open cases, the full-version-on-arXiv norm, and consistency between what the paper claims and what the proofs actually establish.

805 repo stars98 repo forks
Testing & Quality

ppopp-experiments

Use when designing or auditing a PPoPP paper's evaluation, covering the twin bar of concurrency correctness and measured scalability — speedup curves, strong vs weak scaling, core/thread sweeps, NUMA and GPU effects, contention microbenchmarks plus real workloads, variance and measurement hygiene, and honest strong baselines.

805 repo stars98 repo forks
Testing & Quality

ppopp-reproducibility

Use when making a PPoPP paper's parallel-performance results reproducible, covering the hardware and topology description reviewers re-run, thread pinning and NUMA control, seeds and warm-up, compiler/driver/flag provenance, and building an environment that reproduces the paper's scaling trend on different machines.

805 repo stars98 repo forks
Testing & Quality

prai-reproducibility

在为《模式识别与人工智能》(Pattern Recognition and Artificial Intelligence, PR&AI) 准备可复现性与实验可重复材料时调用。覆盖固定随机种子、锁定软硬件环境与依赖版本、固定数据集划分与预处理、预训练权重与大模型版本的记录、复现包(脚本/配置/环境文件)的组织、大数据与权重的稳定托管、以及可复现自查冒烟测试。用于让本刊模式识别/机器学习论文的实验结果能被外审与后续读者重复,降低"结果无法复现"的信任风险;本刊是否设强制复现要求以官网当期须知为准(待核实)。

805 repo stars98 repo forks
Testing & Quality

recsys-reproducibility

Use when strengthening the reproducibility of an ACM RecSys paper or preparing a RecSys Reproducibility Track submission — pinning dataset versions and splits, tuning baselines under an equal budget, reporting seeds and variance, avoiding sampled-metric distortion, and structuring a reproduction study with honest divergence analysis.

805 repo stars98 repo forks
Testing & Quality

rfs-robustness

Use when results may be fragile or when multiple-testing / out-of-sample discipline is the bottleneck for a The Review of Financial Studies (RFS) manuscript. Builds the robustness battery referees will demand; does NOT design identification or write the rebuttal.

805 repo stars98 repo forks
Testing & Quality

rt-replication-package

Use before final submission or on acceptance to assemble and validate the Data-Editor replication package against the target venue's data-and-code policy — master script, pinned environment, README/roadmap, restricted-data plan, and a script-to-exhibit output map, with a checklist that catches the numbers a Data Editor would fail to reproduce. Reads the venue policy live from the pack's source-map.

805 repo stars98 repo forks
Testing & Quality