Dvc Dataset Versioning
Developmentdvc-dataset-versioningDvc Dataset Versioning is an Agent Skill for development published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Dataset versioning skill using DVC for tracking data changes, managing data pipelines, and ensuring reproducibility.
QUICK START
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/data-science-ml/skills/dvc-dataset-versioning/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/dvc-dataset-versioning, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
dvc-dataset-versioning
Overview
Dataset versioning skill using DVC (Data Version Control) for tracking data changes, managing data pipelines, and ensuring reproducibility in ML workflows.
Capabilities
- Dataset version tracking
- Data pipeline definition and execution
- Remote storage management (S3, GCS, Azure, etc.)
- Reproducibility enforcement
- Data lineage tracking
- Experiment comparison with data versions
- Cache management for large datasets
Target Processes
- Data Collection and Validation Pipeline
- ML Model Retraining Pipeline
- Feature Store Implementation
Tools and Libraries
- DVC
- Git
- Remote storage SDKs (boto3, google-cloud-storage, etc.)
Input Schema
{
"type": "object",
"required": ["action"],
"properties": {
"action": {
"type": "string",
"enum": ["init", "add", "push", "pull", "diff", "checkout", "run", "repro"],
"description": "DVC action to perform"
},
"paths": {
"type": "array",
"items": { "type": "string" },
"description": "File or directory paths to track"
},
"remote": {
"type": "string",
"description": "Remote storage name"
},
"revision": {
"type": "string",
"description": "Git revision for checkout/diff"
},
"pipeline": {
"type": "object",
"description": "Pipeline stage definition for run action"
}
}
}
Output Schema
{
"type": "object",
"required": ["status", "action"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error"]
},
"action": {
"type": "string"
},
"trackedFiles": {
"type": "array",
"items": { "type": "string" }
},
"changes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"path": { "type": "string" },
"status": { "type": "string" },
"hash": { "type": "string" }
}
}
},
"remote": {
"type": "object",
"properties": {
"name": { "type": "string" },
"url": { "type": "string" },
"syncStatus": { "type": "string" }
}
}
}
}
Usage Example
{
kind: 'skill',
title: 'Version training dataset',
skill: {
name: 'dvc-dataset-versioning',
context: {
action: 'add',
paths: ['data/train.csv', 'data/test.csv'],
remote: 's3-bucket'
}
}
}