OpenParable
Skip to content
← Back to skills

Build Compiled Extensions

Development
build-compiled-extensions

Build Compiled Extensions is an Agent Skill for development published in the A-EVO-Lab/a-evolve repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

How to build C/C++/Cython/Fortran extensions and frameworks like Caffe, OpenCV, protobuf-dependent projects from source.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/A-EVO-Lab/a-evolve/blob/HEAD/artifacts/tb2_clawcode_opus46/skills/build-compiled-extensions/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/build-compiled-extensions, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Building Compiled Extensions & Frameworks

Pre-flight

pip install setuptools wheel cython 2>/dev/null
apt-get install -y build-essential python3-dev 2>/dev/null

Cython extension workflow

cython file.pyx   # Cythonize to .c first
python setup.py build_ext --inplace 2>&1
# Manual fallback:
gcc -shared -fPIC -O2 $(python3-config --includes) -o mod$(python3-config --extension-suffix) mod.c

Building large C++ frameworks (Caffe, etc.)

  1. Check protobuf version: protoc --version and dpkg -l | grep protobuf
  2. Fix API incompatibilities before building (see debug-and-fix skill)
  3. Use make -j$(nproc) but capture errors: make 2>&1 | tee build.log
  4. For Caffe specifically:
    • Set CPU_ONLY := 1 in Makefile.config for non-GPU environments
    • Fix protobuf SetTotalBytesLimit calls for newer protobuf
    • Use make all -j$(nproc) && make test && make runtest

When pip install times out

  1. Install dependencies individually first: pip install numpy scipy
  2. Build extensions only: python setup.py build_ext --inplace
  3. Or: pip install --no-deps -e .

Common pitfalls

  • Missing numpy headers: pip install numpy before building numpy-dependent C extensions
  • Import from wrong dir: Test from /tmp, not the source directory
  • Protobuf mismatch: Check version and fix API calls before compiling

Verification

find . -name "*.so" -newer setup.py
cd /tmp && python -c "import mypackage; print('OK')"