lynkr

Lynkr - Universal LLM Gateway

Lynkr routes AI coding requests to the optimal model based on task complexity, cost, and provider health. Supports 12+ providers with 60-80% cost reduction through intelligent token optimization.

Quick Start

npm install -g lynkr
lynkr-setup   # Auto-installs Ollama + pulls a model
lynkr          # Start the proxy

Then point your AI coding tool at http://localhost:8081/v1.

How It Works

1. 5-Phase Complexity Analysis - Scores each request 0-100 using token count, tool usage, code patterns, domain keywords, and Graphify structural analysis (god nodes, community cohesion, blast radius)
2. 4-Tier Routing - Maps score to SIMPLE/MEDIUM/COMPLEX/REASONING, each with a configured provider:model
3. Agentic Detection - Detects multi-step workflows (tool loops, autonomous agents) and upgrades to higher tiers
4. Cost Optimization - Picks the cheapest provider that can handle the tier
5. Circuit Breaker + Failover - Automatic failover with half-open probe recovery

Key Features (v8.0)

Intelligent Routing

• 5-phase complexity scoring with 15-dimension weighted mode
• Agentic workflow detection (SINGLE_SHOT / TOOL_CHAIN / ITERATIVE / AUTONOMOUS)
• Graphify knowledge graph integration — god node detection, community cohesion, blast radius
• Routing telemetry with SQLite store, quality scoring (0-100), latency tracking (P50/P95/P99)

Token Optimization (60-80% savings)

• Smart tool selection — filters tools by request type
• Distill compression — structural similarity (Jaccard), delta rendering, block dedup
• Code Mode — replaces 100+ MCP tools with 4 meta-tools (~96% token reduction)
• History compression — sliding window with Distill-powered dedup
• Prompt caching — SHA-256 keyed LRU cache
• Headroom sidecar — optional 47-92% compression via Smart Crusher, CCR, LLMLingua

Production Hardening

• Circuit breakers with half-open probe recovery
• Admin hot-reload endpoint (POST /v1/admin/reload) — no restart needed
• Per-request performance timing (PERF_TIMER=true)
• Prometheus metrics, structured logging, health checks
• Rate limiting, load shedding, input validation

Long-Term Memory (Titans-Inspired)

• Surprise-based memory storage with decay
• Semantic search via FTS5
• Automatic extraction and injection

Configuration for OpenClaw

Set tier routing in your environment:

MODEL_PROVIDER=ollama
TIER_SIMPLE=ollama:llama3.2
TIER_MEDIUM=openrouter:anthropic/claude-sonnet-4
TIER_COMPLEX=bedrock:anthropic.claude-sonnet-4-20250514-v1:0
TIER_REASONING=bedrock:anthropic.claude-opus-4-20250514-v1:0

OpenClaw Mode

When running under OpenClaw, enable model name rewriting:

OPENCLAW_MODE=true

This replaces the generic model: "auto" in responses with the actual provider/model that handled the request.

Provider Registration

Add to your openclaw.json:

{
  "models": {
    "providers": [
      {
        "name": "lynkr",
        "type": "openai-compatible",
        "base_url": "http://localhost:8081/v1",
        "api_key": "any-value",
        "models": ["auto"]
      }
    ]
  },
  "agents": {
    "defaults": {
      "models": {
        "primary": "lynkr/auto",
        "fallback": "lynkr/auto"
      }
    }
  }
}

Providers

New in v8.0

• Graphify Integration — AST-based knowledge graph with 19-language support for blast radius analysis
• Distill Compression — Structural similarity, delta rendering, and smart dedup
• Routing Telemetry — SQLite-backed decision recording with quality scoring
• Code Mode — 4 MCP meta-tools replace 100+ individual definitions
• Admin Reload — Hot-reload config + reset circuit breakers without restart
• Performance Timer — Per-request timing breakdown (PERF_TIMER=true)
• Large Payload Passthrough — Smart cloning skips base64 media that will be discarded

Response Headers

Telemetry Endpoints