OpenParable
Skip to content
← Back to skills

Review Nvbench

Testing & Quality
review-nvbench

Review Nvbench is an Agent Skill for testing & quality published in the NVIDIA/nvbench repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Use this skill when the user invokes /review-nvbench to review an NVBench pull request, PR branch, commit range, or diff. Supports context, feedback, and adversarial modes.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/NVIDIA/nvbench/blob/HEAD/.agents/skills/review-nvbench/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/review-nvbench, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Review NVBench Pull Request

Read AGENTS.md and docs/pr_review.md before acting.

Use one of these modes:

  • context: Gather PR context and explain the change without review findings.
  • feedback: Produce normal review findings after the human reviewer has inspected the PR.
  • adversarial: Challenge assumptions, design direction, compatibility risks, and hidden failure modes after the PR context is understood.

If no mode is provided, default to context.

Context Mode

Run or inspect ci/util/pr_review_context.sh when reviewing a checked-out PR branch. If the user provided a PR number, pass --pr <number>. If the user provided an issue number, pass --issue <number>.

Summarize:

  • The linked issue or PR context.
  • The problem the PR is trying to solve.
  • How the PR attempts to solve it.
  • The important changed files and a sensible human review order.
  • Any missing context, such as no discoverable linked issue.

Do not produce review findings in context mode.

Feedback Mode

Before producing findings, make sure the context pass has happened. If it has not, gather and summarize the PR context first.

Review for correctness, benchmark validity, performance, API compatibility, build and packaging impact, and consistency with existing code. Let the changed files determine which risks matter, while paying attention to relevant NVBench contracts such as CUDA stream ordering, timing boundaries, cold/batch/CPU-only measurement behavior, manual timer semantics, axis generation, output schemas, optional CUPTI/NVML behavior, CMake options, Python bindings, and test coverage.

Report findings first, ordered by severity, with file and line references. Do not post comments to GitHub; the human reviewer decides which findings to use.

Adversarial Mode

Before producing adversarial feedback, make sure the PR intent and implementation strategy are understood.

Focus on whether the approach is sound:

  • Hidden assumptions that could fail.
  • Simpler or safer alternative designs.
  • Compatibility, layering, maintenance, or rollout risks.
  • Cases where the implementation solves the local issue but weakens a broader NVBench contract.

Keep this distinct from normal feedback. It is acceptable for adversarial mode to produce questions or risks rather than concrete blocking findings.