Swarmnest

Home › Directory › LLM APIs › OpenLLM (self‑hosted gateway)

OpenLLM (self‑hosted gateway)

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Visit OpenLLM (self‑hosted gateway)Docs

CategoryLLM APIs
AuthenticationNo auth
PricingFree
Websitehttps://github.com/bentoml/OpenLLM
Docshttps://docs.bentoml.com/en/latest/guides/build-options.html
Last checked2026-10-14
As JSON/api/v1/directory/openllm-self-hosted-gateway.json

Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with OpenLLM (self‑hosted gateway). Suggest a correction.

More in LLM APIs

OpenAI API

Hosted GPT-family language, image, speech and embedding models behind a single REST API, with function calling and structured outputs.

Anthropic API

Access to the Claude model family over REST, with tool use, long context windows and prompt caching.

Google Gemini API

Google's multimodal Gemini models via API key, with a free tier for prototyping and support for large context inputs.

Groq

Very fast inference for open-weight models on custom hardware, exposed through an OpenAI-compatible endpoint.