# Kafka Topic Designer

> Kafka Topic Designer is an Agent Skill for devops & security published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Designs and optimizes Apache Kafka topics and configurations

- Skill name: `Kafka Topic Designer`
- Category: [DevOps & Security](https://www.openparable.com/skill/devops-security/1)
- Source: https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/data-engineering-analytics/skills/kafka-topic-designer/SKILL.md
- Repository: a5c-ai/babysitter (1,548 GitHub stars when collected)

## SKILL.md

# Kafka Topic Designer

## Overview

Designs and optimizes Apache Kafka topics and configurations. This skill provides expertise in topic architecture, partitioning strategies, and producer/consumer configuration for optimal streaming performance.

## Capabilities

- Topic naming convention design
- Partition strategy optimization
- Replication factor recommendations
- Retention policy configuration
- Compaction strategy design
- Schema registry integration
- Consumer group design
- Throughput capacity planning
- Security configuration (ACLs, encryption)

## Input Schema

```json
{
  "requirements": {
    "throughputMBps": "number",
    "messageSize": "number",
    "retentionDays": "number",
    "orderingRequirements": "string"
  },
  "existingTopics": ["object"],
  "clusterConfig": "object"
}
```

## Output Schema

```json
{
  "topicDesign": {
    "name": "string",
    "partitions": "number",
    "replicationFactor": "number",
    "configs": "object"
  },
  "schemaDefinition": "object",
  "producerConfig": "object",
  "consumerConfig": "object"
}
```

## Target Processes

- Streaming Pipeline
- ETL/ELT Pipeline (CDC)
- Feature Store Setup

## Usage Guidelines

1. Define throughput and latency requirements
2. Specify message size and retention needs
3. Document ordering requirements (per-partition, global)
4. Include existing topic configurations for consistency

## Best Practices

- Use consistent naming conventions across all topics
- Size partitions based on consumer parallelism needs
- Configure appropriate retention for compliance and replay scenarios
- Implement schema registry for schema evolution
- Set up proper ACLs for security

---

Source: https://www.openparable.com/skill/devops-security/kafka-topic-designer (OpenParable). Cite the canonical URL above.