Home › Directory › Local Inference › llama-cpp-python

llama-cpp-python

Python bindings for llama.cpp.

Visit llama-cpp-python Docs

Category	Local Inference
Authentication	No auth
Pricing	Free
Website	https://github.com/abetlen/llama-cpp-python
Docs	https://llama-cpp-python.readthedocs.io/
Last checked	2026-10-14
As JSON	/api/v1/directory/llama-cpp-python.json

Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with llama-cpp-python. Suggest a correction.

More in Local Inference

llama.cpp

C/C++ LLM inference with an OpenAI-compatible server.

Llamafile

Single-file executable LLMs.

MLX

Apple's array framework for ML on Apple silicon.

Cortex

Local AI engine from Jan.