Opentelemetry LLM
DevOps & Securityopentelemetry-llmOpentelemetry LLM is an Agent Skill for devops & security published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.
OpenTelemetry instrumentation for LLM applications with distributed tracing
QUICK START
How to use this skill
Bring this guide into your coding agent with a prompt tailored to the tool you use.
- Open your project in Codex.
- Copy and paste the prompt below.
- Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/ai-agents-conversational/skills/opentelemetry-llm/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/opentelemetry-llm, but wait for my approval before writing files or running scripts.
Copying this prompt does not install or run the skill. Review third-party files before use.
OpenTelemetry LLM Skill
Capabilities
- Configure OpenTelemetry SDK for LLM apps
- Implement LLM-specific instrumentation
- Set up trace exporters (Jaeger, OTLP)
- Design semantic conventions for LLM
- Configure span attributes for AI workloads
- Implement context propagation
Target Processes
- llm-observability-monitoring
- agent-deployment-pipeline
Implementation Details
Core Components
- TracerProvider: SDK configuration
- SpanProcessor: Batch/simple processors
- Exporters: Jaeger, OTLP, Console
- Instrumentation: Auto and manual
LLM Semantic Conventions
- gen_ai.system (OpenAI, Anthropic)
- gen_ai.request.model
- gen_ai.request.max_tokens
- gen_ai.response.finish_reason
- gen_ai.usage.prompt_tokens
Configuration Options
- Exporter selection
- Sampling strategies
- Resource attributes
- Span limits
- Context propagation
Best Practices
- Consistent attribute naming
- Appropriate sampling
- Error handling traces
- Propagate context across services
Dependencies
- opentelemetry-sdk
- opentelemetry-exporter-*
- openinference (optional)