OpenParable
Skip to content
← Back to skills

Artifact Quality

Testing & Quality
artifact-quality

Artifact Quality is an Agent Skill for testing & quality published in the chekusu/wanman repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Quality standards for structured deliverables, ensuring data is verifiable and traceable

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/chekusu/wanman/blob/HEAD/packages/core/skills/artifact-quality/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/artifact-quality, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Artifact Quality Standards

Required Fields

Every artifact's metadata must include:

FieldTypeDescription
sourcestringData source identifier
confidencenumber (0-1)Confidence score

Source Identifier Format

training_data        → From model training data (lowest confidence)
estimate             → Extrapolated from known data
web_search:<domain>  → Web search result, specify the domain
government_data      → Official government data
industry_report      → Industry report
api:<service>        → API call result
cross_validated      → Cross-validated

Confidence Scoring Guide

0.9+    → Official data, multi-source validated
0.7-0.9 → Reliable source, single validation
0.5-0.7 → Web search result, not cross-validated
0.3-0.5 → Extrapolation/estimate with reasonable basis
0.1-0.3 → Training data or rough estimate

Cross-Validation

When the CEO or another agent validates an artifact, update the metadata:

wanman artifact put --kind market_data --path "competitors/pricing" \
  --meta '{"source":"cross_validated","confidence":0.85,"verified":true,"verified_by":"ceo","verified_at":"2024-01-15","original_source":"web_search:dianping.com","validation_notes":"consistent with Meituan data"}'

Common Quality Issues

  1. Missing source: source is empty or just says "internet"
  2. Inflated confidence: Estimated data labeled 0.9+
  3. Missing units: Amounts without currency, areas without units
  4. Vague timing: No data collection date specified
  5. Inconsistent paths: path does not follow a consistent naming convention

Path Naming Convention

costs/{category}/{item}          → Cost data
revenue/{scenario}/{period}      → Revenue forecasts
competitors/{name}/{metric}      → Competitor data
market/{segment}/{metric}        → Market data
location/{area}/{metric}         → Location data