Local Inference
Run models on your own hardware, including Apple Silicon Macs (use the macOS filter).
JSON: /api/v1/directory.json (filter on category=local-inference) · Agents can search it with the Swarmnest MCP Server
Local Inference
llama.cpp
C/C++ LLM inference with an OpenAI-compatible server.
FreeNo authOpen SourceLlamafile
Single-file executable LLMs.
FreeNo authOpen SourceMLX
Apple's array framework for ML on Apple silicon.
FreeNo authOpen SourcemacOSCortex
Local AI engine from Jan.
FreeNo authOpen SourceMLX LM
Run LLMs on Apple silicon.
FreeNo authOpen SourcemacOSText Generation WebUI
Gradio UI and API for local LLMs.
FreeNo authOpen SourceKoboldCpp
Single-file llama.cpp distribution with API.
FreeNo authOpen SourceExo
Run models across everyday devices.
FreeNo authOpen SourceMsty
Desktop client for local and remote models.
Free tierNo authMLC LLM
Universal LLM deployment.
FreeNo authOpen WebUI
Web UI for local models.
FreeNo authllama-cpp-python
Python bindings for llama.cpp.
FreeNo authOpen SourceTransformers.js
Run models in the browser.
FreeNo authWebLLM
In-browser LLM inference.
FreeNo authMsty Studio
Local AI app.
Free tierNo authAnythingLLM
Local AI workspace.
FreeNo authOllama Python
Ollama client.
FreeNo authOpen SourceOsaurus
An open-source local model server for Apple Silicon Macs built on MLX, with an OpenAI-compatible API and MCP support.
FreeNo authOpen SourcemacOSEnchanted
An open-source native Mac, iPhone and iPad chat app for models served by Ollama on your own machine or network.
FreeNo authOpen SourcemacOSiOSOllamac
An open-source native macOS client for chatting with local Ollama models.
FreeNo authOpen SourcemacOSMLX VLM
A Python package for running and fine-tuning vision-language models on Apple Silicon with MLX.
FreeNo authOpen SourcemacOSMLX Swift
Apple's Swift API for MLX, for running and training models inside native Mac and iOS apps on Apple Silicon.
FreeNo authOpen SourcemacOSiOSLM Studio MLX Engine
The open-source MLX inference engine that powers Apple Silicon models in LM Studio, usable on its own from Python.
FreeNo authOpen SourcemacOSvLLM MLX
An OpenAI-compatible server for Apple Silicon that brings vLLM-style batching to MLX models for text, vision and audio.
FreeNo authOpen SourcemacOSApple Foundation Models Framework
Apple's Swift framework for calling the on-device language model behind Apple Intelligence from Mac and iOS apps, with guided generation and tool calling.
FreeNo authmacOSiOSPrivate LLM
A paid app for Mac, iPhone and iPad that runs quantized open models fully on device, with Shortcuts and Siri support.
PaidNo authmacOSiOSLocally AI
A free app for Mac, iPhone and iPad that runs open models offline on Apple Silicon using MLX.
FreeNo authmacOSiOSChatMLX
An open-source macOS chat app that runs local models with MLX on Apple Silicon.
FreeNo authOpen SourcemacOSFastMLX
A production-oriented API server for MLX models on Apple Silicon with an OpenAI-compatible interface.
FreeNo authOpen SourcemacOSMore in AI Models & Inference
See the Group- LLM APIs70
- Model Hosting & Inference27
- GPU Cloud17
- Training & Fine-Tuning32
- Embeddings & Rerankers20
- LLM SDKs & Structured Output22
- LLM Benchmarks & Leaderboards19
- Prompt Management & Libraries33
- NLP & Text Analysis16
- Computer Vision APIs13
- OCR & Document Parsing27
- Data Labeling & Synthetic Data26
- Security & Guardrails19
- AI Content Detection & Provenance19