Swarmnest

Home › Directory › Observability & Evals › EleutherAI LM Evaluation Harness

EleutherAI LM Evaluation Harness

Standard framework for few-shot evaluation of language models.

Visit EleutherAI LM Evaluation HarnessDocs

CategoryObservability & Evals
AuthenticationNo auth
PricingFree
Websitehttps://github.com/EleutherAI/lm-evaluation-harness
Docshttps://github.com/EleutherAI/lm-evaluation-harness
Last checked2026-10-14
As JSON/api/v1/directory/eleutherai-lm-evaluation-harness.json

Information is summarised in our own words and may be out of date; check the vendor's site for current terms and prices. Not affiliated with EleutherAI LM Evaluation Harness. Suggest a correction.

More in Observability & Evals

Langfuse

Open-source observability for LLM apps: traces, evals, prompt management and cost tracking.

LangSmith

Tracing, evaluation and monitoring platform for LLM applications and agents.

Opik

Open-source LLM evaluation and observability from Comet.

OpenLLMetry

OpenTelemetry-based instrumentation for LLM applications.