Incremental Model Strategy Selector
ProductivityIncremental Model Strategy Selector is an Agent Skill for productivity published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
Selects and configures optimal incremental model strategies
QUICK START
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/data-engineering-analytics/skills/incremental-model-strategy-selector/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/incremental-model-strategy-selector, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
Incremental Model Strategy Selector
Overview
Selects and configures optimal incremental model strategies. This skill optimizes data transformation efficiency through proper incremental processing patterns.
Capabilities
- Incremental strategy selection (append, merge, delete+insert)
- Partition pruning optimization
- Unique key configuration
- On_schema_change handling
- Full refresh scheduling
- Lookback window optimization
- Late-arriving data handling
Input Schema
{
"modelCharacteristics": {
"sourceType": "string",
"updatePattern": "append|update|delete",
"volumeGB": "number",
"updateFrequency": "string"
},
"platform": "snowflake|bigquery|redshift",
"existingModel": "object"
}
Output Schema
{
"strategy": "append|merge|delete+insert",
"config": "object",
"partitionStrategy": "object",
"refreshSchedule": "object",
"dbtConfig": "object"
}
Target Processes
- Incremental Model Setup
- dbt Model Development
- Pipeline Migration
Usage Guidelines
- Analyze source data update patterns
- Measure data volume and update frequency
- Select strategy based on characteristics
- Configure appropriate lookback windows
Best Practices
- Use append for insert-only sources
- Use merge for sources with updates
- Configure partition pruning for large tables
- Schedule periodic full refreshes for data correction
- Handle late-arriving data with appropriate lookback