Swarmnest Search

vLLM MLX

An OpenAI-compatible server for Apple Silicon that brings vLLM-style batching to MLX models for text, vision and audio.

Visit vLLM MLXDocs

More in Local Inference

llama.cpp

C/C++ LLM inference with an OpenAI-compatible server.

Llamafile

Single-file executable LLMs.

MLX

Apple's array framework for ML on Apple silicon.

Cortex

Local AI engine from Jan.

Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with vLLM MLX. Suggest a correction.

CategoryLocal Inference
AuthenticationNo auth
PricingFree
SourceOpen Source
Operating SystemmacOS
Websitehttps://github.com/waybarrios/vllm-mlx
Docshttps://github.com/waybarrios/vllm-mlx
Last checked2026-10-14
As JSON/api/v1/directory/vllm-mlx.json