OpenParable
Skip to content
← Back to skills

LLM Integration

Development
llm-integration

LLM Integration is an Agent Skill for development published in the rapidaai/voice-ai repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Add or modify integration-api LLM providers with caller factory wiring, unified provider routing, streaming behavior, and metric/audit compatibility.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/rapidaai/voice-ai/blob/HEAD/.codex/skills/llm-integration/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/llm-integration, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

LLM Integration Skill

Mission

Add provider callers for chat/stream/verify (plus optional embedding/reranking) with consistent metrics and routing.

Inputs expected from user

  1. Required capabilities: chat, stream, verify, embedding, reranking.
  2. Auth and endpoint model.
  3. Model parameter/tool-calling constraints.

If missing:

  • Implement chat + stream + verify first.
  • Add embedding/reranking only if provider supports them.

Hard boundaries

In scope:

  • api/integration-api/internal/caller/<provider>/...
  • api/integration-api/internal/caller/caller.go
  • api/integration-api/internal/type/callers.go if interfaces change
  • api/integration-api/api/unified_provider.go
  • pkg/clients/integration/integration_client.go if routing updates are needed
  • provider model metadata in ui/src/providers/<provider>/...

Out of scope:

  • assistant-api telephony/STT/TTS/EOS/VAD internals

Implementation workflow

  1. Build provider caller package (llm, verify-credential, optional embedding/reranking).
  2. Register in caller factory switches.
  3. Ensure unified provider endpoint behavior is consistent.
  4. Keep MetricBuilder lifecycle consistent (TIME_TAKEN, STATUS).
  5. Add tests for success/failure and stream completion.
  6. Update provider model metadata where required.

Validation commands

  • go test ./api/integration-api/internal/caller/...
  • go test ./api/integration-api/api/...
  • go test ./pkg/clients/integration/...
  • ./skills/llm-integration/scripts/validate.sh --check-diff --provider <provider>

References

  • references/checklist.md
  • references/llm-checklist.md
  • examples/sample.md