Open source Self-hostable free
In these stacks
LicenseApache-2.0
PriceFree tier
UsageIncluded
Model supportmulti
Languagespython
GitHub stars16.6k
Last activity2026-07-02
VerifiedThu Jun 25 2026 00:00:00 GMT+0000 (Coordinated Universal Time)
Verified byseed
A pytest-style framework for writing and running LLM evaluations, paired with the Confident AI platform for reporting.
Strengths
- Pytest-style DX, fits existing test suites
- Open source metric library
Tradeoffs
- Confident AI cloud is proprietary
- Setup for custom metrics takes work