FastMLX
A production-oriented API server for MLX models on Apple Silicon with an OpenAI-compatible interface.
More in Local Inference
llama.cpp
C/C++ LLM inference with an OpenAI-compatible server.
Llamafile
Single-file executable LLMs.
MLX
Apple's array framework for ML on Apple silicon.
Cortex
Local AI engine from Jan.
| Category | Local Inference |
|---|---|
| Authentication | No auth |
| Pricing | Free |
| Source | Open Source |
| Operating System | macOS |
| Website | https://github.com/arcee-ai/fastmlx |
| Docs | https://github.com/arcee-ai/fastmlx |
| Last checked | 2026-10-14 |
| As JSON | /api/v1/directory/fastmlx.json |