Giab Benchmark Validator
Testing & Qualitygiab-benchmark-validatorGiab Benchmark Validator is an Agent Skill for testing & quality published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Genome in a Bottle benchmark validation skill for pipeline accuracy assessment
QUICK START
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/domains/science/bioinformatics/skills/giab-benchmark-validator/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/giab-benchmark-validator, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
GIAB Benchmark Validator Skill
Purpose
Enable Genome in a Bottle benchmark validation for pipeline accuracy assessment.
Capabilities
- Truth set comparison
- hap.py/vcfeval execution
- Sensitivity/specificity calculation
- Stratified performance metrics
- Difficult region analysis
- Validation report generation
Usage Guidelines
- Use appropriate GIAB reference samples
- Compare against truth sets with hap.py
- Calculate sensitivity and specificity
- Stratify by region type and variant class
- Analyze performance in difficult regions
- Generate comprehensive validation reports
Dependencies
- hap.py
- vcfeval
- GIAB resources
Process Integration
- Analysis Pipeline Validation (pipeline-validation)
- Whole Genome Sequencing Pipeline (wgs-analysis-pipeline)