Langfuse Integration

DevOps & Security

langfuse-integration

Langfuse Integration is an Agent Skill for devops & security published in the a5c-ai/babysitter repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

LangFuse LLM observability integration for tracing, analytics, and cost tracking

View on GitHub ↗

QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

Open your project in Codex.
Copy and paste the prompt below.
Review files and risks before approving any action.

Prompt to paste

Inspect the Agent Skill at https://github.com/a5c-ai/babysitter/blob/HEAD/library/specializations/ai-agents-conversational/skills/langfuse-integration/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/langfuse-integration, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

LangFuse Integration Skill

Capabilities

Set up LangFuse tracing for LLM calls
Configure cost tracking and analytics
Implement prompt management
Set up evaluation datasets
Design custom trace metadata
Create dashboards and alerts

Target Processes

llm-observability-monitoring
cost-optimization-llm

Implementation Details

Core Features

Tracing: Track LLM calls, chains, and agents
Prompts: Version and manage prompts
Analytics: Usage, latency, cost metrics
Datasets: Evaluation and testing data
Scores: Track output quality

Integration Methods

LangChain callback handler
Direct SDK integration
OpenAI drop-in replacement
Decorator-based tracing

Configuration Options

Public/secret keys
Host URL (cloud or self-hosted)
Sampling rate
Metadata configuration
User tracking

Best Practices

Consistent trace naming
Meaningful metadata
Regular prompt versioning
Set up alerting

Dependencies

langfuse
langchain (for callback integration)