OpenParable
Skip to content
← Back to skills

Performance Benchmark Suite

Testing & Quality
performance-benchmark-suite

Performance Benchmark Suite is an Agent Skill for testing & quality published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

SDK performance benchmarking and regression detection

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/sdk-platform-development/skills/performance-benchmark-suite/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/performance-benchmark-suite, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Performance Benchmark Suite Skill

Overview

This skill implements comprehensive SDK performance benchmarking, tracking latency, throughput, memory usage, and detecting performance regressions across versions.

Capabilities

  • Measure latency percentiles (p50, p95, p99)
  • Track memory usage and allocation patterns
  • Detect performance regressions automatically
  • Generate visual benchmark reports
  • Compare performance across SDK versions
  • Implement microbenchmarks for critical paths
  • Configure continuous benchmarking in CI
  • Support load testing scenarios

Target Processes

  • Performance Benchmarking
  • SDK Testing Strategy
  • SDK Versioning and Release Management

Integration Points

  • k6 for load testing
  • Artillery for HTTP benchmarking
  • hyperfine for CLI benchmarking
  • Benchmark.js for JavaScript
  • pytest-benchmark for Python
  • Continuous benchmark systems (Bencher)

Input Requirements

  • Performance requirements (SLOs)
  • Benchmark scenarios
  • Baseline versions for comparison
  • Environment specifications
  • Reporting requirements

Output Artifacts

  • Benchmark test suite
  • Performance baseline data
  • Regression detection rules
  • Visual benchmark reports
  • CI benchmark configuration
  • Historical trend analysis

Usage Example

skill:
  name: performance-benchmark-suite
  context:
    tool: k6
    scenarios:
      - name: basic-crud
        operations: ["create", "read", "update", "delete"]
        vus: 10
        duration: "30s"
      - name: high-load
        vus: 100
        duration: "5m"
    slos:
      p95_latency: "100ms"
      p99_latency: "500ms"
      error_rate: "0.1%"
    compareWith: "v1.0.0"
    regressionThreshold: "10%"

Best Practices

  1. Establish baselines before optimization
  2. Track percentiles, not just averages
  3. Run benchmarks in consistent environments
  4. Automate regression detection in CI
  5. Monitor memory alongside latency
  6. Document benchmark methodology