Home › Directory › Local Inference

Local Inference

Run models locally on your own hardware.

JSON: /api/v1/directory.json (filter on category=local-inference)

llama.cpp

C/C++ LLM inference with an OpenAI-compatible server.

Llamafile

Single-file executable LLMs.

MLX

Apple's array framework for ML on Apple silicon.

Cortex

Local AI engine from Jan.