ai-quality
(2)
Confident AI
Confident AI is a San Francisco startup (YC W25) that builds the evaluation and testing layer for LLM applications. Its open-source frameworks DeepEval and DeepTeam - often described as 'Pytest for LLMs' - let engineers unit-test, benchmark, red team, and monitor chatbots, agents, and RAG pipelines with research-backed metrics. The cloud platform adds dataset management, observability, adversarial testing, and governance so teams can prove AI quality before and after shipping.
Kolena
Kolena is a San Francisco-based AI company building software that automates document-heavy workflows for regulated industries - real estate, insurance, banking, and financial services. Founded in 2021 by Mohamed Elgendy, Andrew Shi, and Gordon Hart, the company began as a rigorous ML model testing platform and has since extended that quality-first DNA into agentic document workflow automation, with an emphasis on transparency, citations, and auditability.