# Confident AI

> Confident AI is a San Francisco startup (YC W25) that builds the evaluation and testing layer for LLM applications. Its open-source frameworks DeepEval and DeepTeam - often described as 'Pytest for LLMs' - let engineers unit-test, benchmark, red team, and monitor chatbots, agents, and RAG pipelines with research-backed metrics. The cloud platform adds dataset management, observability, adversarial testing, and governance so teams can prove AI quality before and after shipping.

- **Founded:** 2024
- **Headquarters:** San Francisco, United States
- **Founders:** Jeffrey Ip (CEO & Co-Founder), Kritin Vongthongsri (Co-Founder)
- **Team size:** 7-8
- **Products:** DeepEval, DeepTeam, Confident AI Platform
- **Notable:** DeepEval reached 16k+ GitHub stars and 8M+ monthly downloads, Framework runs roughly 2 million LLM evaluations per day, Closed a $2.2M seed round in five days off open-source traction

## Products & services

- **DeepEval** — Open-source LLM evaluation framework - 'Pytest for LLMs' - with research-backed metrics for RAG, agents, and chatbots. 16k+ GitHub stars, 8M+ monthly downloads, running ~2M evaluations daily.
- **DeepTeam** — Open-source LLM red teaming framework built on DeepEval. Simulates jailbreaks, prompt injection, and multi-turn exploits to surface 40+ vulnerability types using 10+ attack methods.
- **Confident AI Platform** — Cloud platform for LLM evaluation, observability, red teaming, and governance - dataset editor, regression catcher, tracing, alerting, scheduled attack campaigns, audit logs, and compliance dashboards.

## Achievements

- DeepEval reached 16k+ GitHub stars and 8M+ monthly downloads
- Framework runs roughly 2 million LLM evaluations per day
- Closed a $2.2M seed round in five days off open-source traction
- Accepted into Y Combinator Winter 2025 batch
- Adopted by enterprises including BCG, AstraZeneca, AXA, and Microsoft

## Latest updates

- **2025-03** — Closed $2.2M seed round led by Y Combinator in five days after Demo Day.
- **2025-02** — Launched publicly as YC W25 with the DeepEval-powered evaluation platform (Launch HN).
- **2025** — Released DeepTeam, an open-source LLM red teaming framework mapping to OWASP LLM Top 10, NIST AI RMF, and MITRE ATLAS.

## Links

- Website: https://confident-ai.com
- LinkedIn: https://www.linkedin.com/company/confident-ai
- Twitter/X: https://twitter.com/confident_ai
- GitHub: https://github.com/confident-ai/deepeval

---

Profile page: https://yespress.io/confident-ai-yc-w25
Published by YesPress — https://yespress.io
Last updated: 2026-07-31