Home › Directory › Local Inference › llama.cpp

llama.cpp

C/C++ LLM inference with an OpenAI-compatible server.

Visit llama.cpp Docs

Category	Local Inference
Authentication	No auth
Pricing	Free
Website	https://github.com/ggml-org/llama.cpp
Docs	https://github.com/ggml-org/llama.cpp/tree/master/tools/server
Last checked	2026-10-14
As JSON	/api/v1/directory/llamacpp.json

Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with llama.cpp. Suggest a correction.

More in Local Inference

Llamafile

Single-file executable LLMs.

MLX

Apple's array framework for ML on Apple silicon.

Cortex

Local AI engine from Jan.