# Benchmark Suite Manager

> Benchmark Suite Manager is an Agent Skill for testing & quality published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Manage benchmarks for algorithm engineering experiments and evaluations

- Skill name: `benchmark-suite-manager`
- Category: [Testing & Quality](https://www.openparable.com/skill/testing-quality/1)
- Source: https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/domains/science/computer-science/skills/benchmark-suite-manager/SKILL.md
- Repository: a5c-ai/babysitter (1,548 GitHub stars when collected)

## SKILL.md

# Benchmark Suite Manager

## Purpose

Provides expert guidance on managing benchmark suites for algorithm engineering and experimental evaluation.

## Capabilities

- Standard benchmark suite access (DIMACS, TSPLIB, etc.)
- Instance generation for specific problem classes
- Statistical analysis of results
- Performance comparison tables
- Visualization of scaling behavior
- Reproducibility support

## Usage Guidelines

1. **Suite Selection**: Choose appropriate benchmark suite
2. **Instance Selection**: Select representative instances
3. **Execution**: Run experiments systematically
4. **Analysis**: Perform statistical analysis
5. **Reporting**: Generate comparison tables and plots

## Tools/Libraries

- DIMACS
- TSPLIB
- SuiteSparse Matrix Collection
- Statistical tools

---

Source: https://www.openparable.com/skill/testing-quality/benchmark-suite-manager (OpenParable). Cite the canonical URL above.
