OpenParable
Skip to content
← Back to skills

Giab Benchmark Validator

Testing & Quality
giab-benchmark-validator

Giab Benchmark Validator is an Agent Skill for testing & quality published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Genome in a Bottle benchmark validation skill for pipeline accuracy assessment

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/domains/science/bioinformatics/skills/giab-benchmark-validator/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/giab-benchmark-validator, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

GIAB Benchmark Validator Skill

Purpose

Enable Genome in a Bottle benchmark validation for pipeline accuracy assessment.

Capabilities

  • Truth set comparison
  • hap.py/vcfeval execution
  • Sensitivity/specificity calculation
  • Stratified performance metrics
  • Difficult region analysis
  • Validation report generation

Usage Guidelines

  • Use appropriate GIAB reference samples
  • Compare against truth sets with hap.py
  • Calculate sensitivity and specificity
  • Stratify by region type and variant class
  • Analyze performance in difficult regions
  • Generate comprehensive validation reports

Dependencies

  • hap.py
  • vcfeval
  • GIAB resources

Process Integration

  • Analysis Pipeline Validation (pipeline-validation)
  • Whole Genome Sequencing Pipeline (wgs-analysis-pipeline)