HoneyHive is a New York-based AI observability and evaluation platform that helps engineering teams ship reliable AI agents. Built OpenTelemetry-native, it unifies distributed tracing, offline experiments, real-time monitoring, and human-in-the-loop annotation into a single continuous-improvement loop so teams can see not just what an agent output, but how it got there and where it went wrong. Founded in 2022 by Columbia roommates Mohak Sharma and Dhruv Singh, HoneyHive is used in production by enterprises including Commonwealth Bank, NVIDIA, MongoDB, and Pinecone, and raised $7.4M in total seed funding led by Insight Partners.
Judgment Labs is a San Francisco applied-research startup building the continuous-improvement layer for AI agents. Its platform and open-source SDK, Judgeval, trace, evaluate, and monitor 'deep agents' - systems that reason, plan, use tools, and remember - turning messy production data into measurable, repeatable improvements. Founded in 2026 by three childhood friends out of Stanford, it raised $32M in combined seed and Series A funding led by Lightspeed Venture Partners.
Monte Carlo is the data and AI observability company that pioneered the 'data observability' category. Its platform helps enterprises detect, resolve, and prevent data and AI quality issues - what the company calls 'data downtime' - by monitoring data pipelines end to end, mapping lineage, surfacing anomalies, and tracing root causes. Founded in 2019 by Barr Moses and Lior Gavish, Monte Carlo serves 400+ enterprises including PepsiCo, Cisco, Nasdaq, and Comcast, and has raised $236M at a valuation of roughly $1.6B.
Agency (agen.cy) is a San Francisco company building the tooling layer for AI agents. Its flagship product, AgentOps.ai, is an observability, testing, and compliance platform that logs every decision an autonomous agent makes - so teams can see what their agents actually do, catch failures, and ship reliably. Founded in 2023 out of the city's AI hackathon scene, the company also runs an AI-agent consulting practice and raised $2.6M in pre-seed funding in 2024.