Comet / Opik
The Fastest Path to Agents That Work
Comet is an end-to-end AI model evaluation and observability platform, featuring Opik — an open-source LLM tracing and evaluation tool for GenAI apps and agents. It enables developers to log traces, run evaluations, annotate results, and automatically fix agent code via a built-in coding agent called Ollie. The platform also includes MLOps capabilities for experiment tracking, model versioning, and production monitoring.
Opik instruments LLM calls and agent steps via a few lines of code, logging traces and eval results that feed into automated scoring, human annotation, and an AI coding agent that writes fixes directly to the codebase.
ML engineers, data scientists, and developers building LLM-powered applications and AI agents
Background.
- Status
- launched
- Business model
- freemium
- Company
- Comet
Similar projects.
Editorial take on the space this project sits in — momentum signals, adjacent moves, our call on whether the wedge is real. Get pinged when we publish a new read or when the landscape shifts.
Have a take on this space?
Tell us what you’d build differently, where you think the incumbents miss, or what we’ve gotten wrong about this project. Comments + reactions are coming soon.