Comparison

Galileo vs OpenLLMetry

A like-for-like, spec-level comparison. Both entries are verified against their docs and repo.

Galileo

Guardrails and evaluation for production LLMs.

+ Strong on hallucination and safety metrics
+ Good for regulated industries
− Proprietary and enterprise-priced
− Less general-purpose tracing

OpenLLMetry

OpenTelemetry instrumentation for LLMs.

+ Vendor-neutral instrumentation
+ Works with existing observability stacks
− Instrumentation only, no UI
− Needs a backend like SigNoz or Honeycomb

Spec	Galileo	OpenLLMetry
Category	eval-observability	eval-observability
License	Proprietary	Apache-2.0
Open source	No	Yes
Self-hostable	No	Yes
MCP support	No	No
Pricing	paid	free
Starting price	Custom	Free
Models	multi	multi
Languages	python	python, typescript
GitHub stars	—	7.2k
Last activity	—	2026-06-25