ai-alignment
(2)
Haize Labs
Haize Labs is a New York-based AI safety and reliability startup that automates the red-teaming, stress-testing, and evaluation of large language models. Founded in 2024 by a trio of Harvard-trained researchers, the company builds algorithms that hunt for the inputs that make AI models misbehave - jailbreaks, failure modes, and edge cases - so they can be fixed before real users find them. Its 'haizing suite' and multi-turn attack engine Cascade are used by frontier model labs including OpenAI and Anthropic, alongside enterprises like Deloitte and MongoDB.
Pareto.AI
Pareto.AI is a San Francisco-based, talent-first human data platform that connects AI labs with a deeply vetted network of expert labelers to produce premium training data, RLHF, and evaluation signals. Founded by Thiel Fellow Phoebe Yao, the company started as a bootcamp for women and work-from-home mothers, pivoted into AI data labeling in 2023, and now positions itself as the 'verification layer' for reinforcement learning on real-world expertise, turning specialist judgment into durable reward signals under the banner 'Expert data for AGI.'