OpenParable
Skip to content
← Back to skills

Minicpm5 Deploy Lmstudio

Apps & Automation
minicpm5-deploy-lmstudio

Minicpm5 Deploy Lmstudio is an Agent Skill for apps & automation published in the OpenBMB/MiniCPM repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Run MiniCPM5-1B in LM Studio (desktop GUI) using either the GGUF runtime (cross-platform) or the MLX runtime (Apple Silicon, faster). Includes OpenAI-compatible local server. Use when the user mentions "LM Studio", desktop GUI inference, "lms" CLI, or wants a no-code chat UI for MiniCPM5.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/OpenBMB/MiniCPM/blob/HEAD/skills/minicpm5-deploy-lmstudio/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/minicpm5-deploy-lmstudio, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Deploy MiniCPM5-1B with LM Studio

Desktop GUI + OpenAI-compatible local server. On Apple Silicon ships two runtimes:

RuntimeFormatWhen to use
GGUF (llama.cpp engine)F16 / Q8_0 / Q4_K_Mcross-platform, same artifact as Ollama; Q4_K_M build
MLX (Apple Silicon only)bf16 / 4-bit~60 % faster, automatic think/answer split via reasoning_content; Q4 build

Required input

VarExampleDefault
Runtimegguf or mlxmlx on Apple Silicon, gguf elsewhere
QUANTQ4_K_M (GGUF) or 4bit (MLX)Q4_K_M / 4bit
MODEL_NAMEminicpm5-1bminicpm5-1b

Steps

1. Install LM Studio + complete onboarding

brew install --cask lm-studio
open -a "LM Studio"     # accept EULA + pick model source

⚠️ The first launch MUST be GUI — lms (CLI) refuses with Cannot find LM Studio installation until LM Studio has run interactively at least once.

2A. GGUF runtime path

mkdir -p ~/.lmstudio/models/openbmb/MiniCPM5-1B-GGUF
huggingface-cli download openbmb/MiniCPM5-1B-GGUF MiniCPM5-1B-${QUANT}.gguf \
    --local-dir ~/.lmstudio/models/openbmb/MiniCPM5-1B-GGUF/

LMS="/Applications/LM Studio.app/Contents/Resources/app/.webpack/lms"
"$LMS" server start                              # binds 127.0.0.1:1234
"$LMS" load minicpm5-1b --gpu max --context-length 8192 -y
"$LMS" ps                                        # verify the model is loaded

2B. MLX runtime path (Apple Silicon, recommended on Mac)

The MLX runtime needs an MLX-format checkpoint. The only published MLX repo is openbmb/MiniCPM5-1B-MLX (4-bit affine); there is no separate -bf16 / -4bit variant. Either drop that one in as-is, or convert locally from openbmb/MiniCPM5-1B (see minicpm5-deploy-mlx). Then:

# Option A — use the official pre-quantized repo
huggingface-cli download openbmb/MiniCPM5-1B-MLX \
    --local-dir ~/.lmstudio/models/openbmb/MiniCPM5-1B-MLX

# Option B — drop a locally converted directory in
mkdir -p ~/.lmstudio/models/openbmb/MiniCPM5-1B-MLX-${QUANT}
cp -r ./minicpm5-mlx-${QUANT}/* ~/.lmstudio/models/openbmb/MiniCPM5-1B-MLX-${QUANT}/

"$LMS" server start
"$LMS" load minicpm5-1b-mlx${QUANT:+-${QUANT}} --gpu max -y

3. Validate

curl http://127.0.0.1:1234/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "minicpm5-1b",
        "messages": [{"role":"user","content":"1+1=?"}],
        "temperature": 0.7, "top_p": 0.95, "max_tokens": 64
    }'

Expected: "2" in the reply.

For the MLX runtime, a think prompt produces output split into message.reasoning_content (the <think> block) and message.content (the final answer) automatically — that's an MLX-runtime feature, not a model setting.

Think vs nothink

LM Studio 0.4.13's chat-completion endpoint does not propagate chat_template_kwargs.enable_thinking to the GGUF runtime. Instead:

  • Default = think mode for both runtimes.
  • For nothink with the GGUF runtime, prepend the closing think block manually:
    "messages": [
      {"role":"user","content":"1+1=?"},
      {"role":"assistant","content":"<think>\n\n</think>\n\n"}
    ]
    
    and the model continues from there.
  • MLX runtime: think/answer are auto-split, you don't need to do anything.

Common pitfalls

  • MLX runtime not available: only on Apple Silicon. On Intel Mac / Windows / Linux LM Studio, only the GGUF runtime works.

When NOT to use

  • Just want CLI / scripted runs → minicpm5-deploy-ollama is leaner
  • Production server → minicpm5-deploy-vllm
  • No GUI desired → minicpm5-deploy-llama-cpp (llama-server)

Reference

docs/deployment/lmstudio.md