OpenParable
Skip to content
← Back to skills

Skippy Model Package

Development
skippy-model-package

Skippy Model Package is an Agent Skill for development published in the Mesh-LLM/mesh-llm repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Use this skill when inspecting GGUF models, planning layer ranges, generating or validating skippy package artifacts, fake packages for direct GGUFs, materialized stage cache behavior, or GGUF writer integration.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/Mesh-LLM/mesh-llm/blob/HEAD/.agents/skills/skippy-model-package/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/skippy-model-package, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

skippy-model-package

Use this skill for model inspection, package planning, stage materialization, and cache behavior.

Ownership

Rust owns package manifests, topology planning inputs, cache policy, and mesh model-storage integration. The patched llama/skippy ABI owns GGUF tensor inspection and GGUF artifact writing.

Direct GGUF loading in mesh should materialize as a fake package identity in the skippy runtime so the split-serving path can use the same package-backed stage machinery as Hugging Face packages.

Commands

Check current package names before running commands:

cargo metadata --no-deps --format-version 1 | jq -r '.packages[].name' | sort

Useful current checks in this repo:

cargo test -p skippy-runtime --lib
cargo test -p skippy-topology --lib
cargo test -p mesh-llm-host-runtime --lib inference::skippy

For a published layer package, prefer package-local diagnostics before a live split smoke:

cargo test -p skippy-model-package --bin skippy-model-package
skippy-model-package preflight <package-dir> --stages 2

Cache Policy

Materialized stages are derived cache. Model storage commands may evict materialized stage artifacts without deleting the source model/package. Preserve pinned materialized artifacts unless the command explicitly asks for a stronger cleanup.