Models & Infrastructure
Omlx AI
Large Language Models (LLMs)A native macOS inference server built on MLX. Paged SSD KV caching drops agent TTFT from 30-90s to under 5s. OpenAI & Anthropic compatible API for Apple Silicon.
Visit website- Category
- Models & Infrastructure
- Type
- Large Language Models (LLMs)
- Website
- omlx.ai
- Similar tools
- Omnibot, Omniinfer and Onairos