ai-quality
(3)
Confident AI
Confident AI is a San Francisco startup (YC W25) that builds the evaluation and testing layer for LLM applications. Its open-source frameworks DeepEval and DeepTeam - often described as 'Pytest for LLMs' - let engineers unit-test, benchmark, red team, and monitor chatbots, agents, and RAG pipelines with research-backed metrics. The cloud platform adds dataset management, observability, adversarial testing, and governance so teams can prove AI quality before and after shipping.
Kolena
Kolena is a San Francisco-based AI company building software that automates document-heavy workflows for regulated industries - real estate, insurance, banking, and financial services. Founded in 2021 by Mohamed Elgendy, Andrew Shi, and Gordon Hart, the company began as a rigorous ML model testing platform and has since extended that quality-first DNA into agentic document workflow automation, with an emphasis on transparency, citations, and auditability.
Mohamed Elgendy
Mohamed Elgendy is the Co-Founder and CEO of Kolena, a San Francisco-based AI testing and validation platform that raised $21M to help enterprises build reliable, trustworthy AI systems. An Egyptian-American technologist and author of the widely-read 'Deep Learning for Vision Systems' (Manning Publications, 20,000+ copies sold), Elgendy cut his teeth building AI/ML organizations at Amazon, Twilio, Rakuten, and Synapse (acquired by Palantir) before founding Kolena in 2021. His mission: bring software engineering rigor - unit testing, regression analysis, scenario-level validation - to a field that has long relied on aggregate accuracy scores that mask real-world failures.