Comparison

OpenLLMetry vs SigNoz

A like-for-like, spec-level comparison. Both entries are verified against their docs and repo.

OpenLLMetry

OpenTelemetry instrumentation for LLMs.

  • + Vendor-neutral instrumentation
  • + Works with existing observability stacks
  • − Instrumentation only, no UI
  • − Needs a backend like SigNoz or Honeycomb

SigNoz

Open-source OpenTelemetry observability.

  • + Unified app and LLM tracing on OTel
  • + Fully self-hosted, no vendor lock-in
  • − LLM evals via OpenLLMetry, not native
  • − More ops to run than a SaaS
Spec OpenLLMetry SigNoz
Category eval-observability eval-observability
License Apache-2.0 MIT
Open source Yes Yes
Self-hostable Yes Yes
MCP support No No
Pricing free freemium
Starting price Free Self-host free
Models multi multi
Languages python, typescript go, typescript
GitHub stars 7.2k 27.5k
Last activity 2026-06-25 2026-06-25