OpenParable
Skip to content
← Back to skills

Incremental Model Strategy Selector

Productivity

Incremental Model Strategy Selector is an Agent Skill for productivity published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Selects and configures optimal incremental model strategies

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/data-engineering-analytics/skills/incremental-model-strategy-selector/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/incremental-model-strategy-selector, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Incremental Model Strategy Selector

Overview

Selects and configures optimal incremental model strategies. This skill optimizes data transformation efficiency through proper incremental processing patterns.

Capabilities

  • Incremental strategy selection (append, merge, delete+insert)
  • Partition pruning optimization
  • Unique key configuration
  • On_schema_change handling
  • Full refresh scheduling
  • Lookback window optimization
  • Late-arriving data handling

Input Schema

{
  "modelCharacteristics": {
    "sourceType": "string",
    "updatePattern": "append|update|delete",
    "volumeGB": "number",
    "updateFrequency": "string"
  },
  "platform": "snowflake|bigquery|redshift",
  "existingModel": "object"
}

Output Schema

{
  "strategy": "append|merge|delete+insert",
  "config": "object",
  "partitionStrategy": "object",
  "refreshSchedule": "object",
  "dbtConfig": "object"
}

Target Processes

  • Incremental Model Setup
  • dbt Model Development
  • Pipeline Migration

Usage Guidelines

  1. Analyze source data update patterns
  2. Measure data volume and update frequency
  3. Select strategy based on characteristics
  4. Configure appropriate lookback windows

Best Practices

  • Use append for insert-only sources
  • Use merge for sources with updates
  • Configure partition pruning for large tables
  • Schedule periodic full refreshes for data correction
  • Handle late-arriving data with appropriate lookback