model-serving
(6)
The AI Company That Learned to Wait
Sail Research has built an AI infrastructure business around a strange advantage: machines that can wait. Its bet is that the next useful agent will need more time, more tokens and a cheaper clock.
Chalk and the 24-Hour Problem
A live shopping app cannot recommend a show that did not exist when last night's batch ran. Chalk built its business around the moment stale data becomes an expensive mistake.
Simplismart and the Expensive Second After the Model Thinks
The glamour in artificial intelligence belongs to the model. The bill belongs to inference. Simplismart built a business in that awkward second between a clever answer and one that arrives fast enough, cheaply enough, and inside the right security perimeter.
FriendliAI
FriendliAI is a San Francisco-based AI inference cloud built by the researchers who invented continuous batching - the technique now standard across the industry. Its platform serves open-weight and custom generative AI models in production with high throughput, lower GPU costs, and 99.99% reliability, used by customers including LG and Twelve Labs.
Anyscale
Anyscale is the company behind Ray, the open-source distributed computing framework used to train and serve some of the world's largest AI systems. Founded by the creators of Ray at UC Berkeley's RISELab, Anyscale provides a managed compute platform that lets enterprises scale Python and AI workloads across any cloud, with the performance of bare metal and the ergonomics of a notebook.
TrueFoundry
TrueFoundry is a San Francisco-based enterprise agentic AI platform that helps Fortune 1000 companies deploy, govern, and scale AI and machine learning applications. Founded in 2021 by former Meta engineers from IIT Kharagpur, it provides an end-to-end MLOps/LLMOps platform covering model deployment, AI gateway, model registry, prompt lifecycle management, and observability - all on the customer's own infrastructure with SOC 2, HIPAA, and GDPR compliance. With $21.3M in total funding led by Intel Capital and Peak XV, TrueFoundry's platform manages 1,000+ clusters, processes 10+ billion monthly API requests, and delivers 40-50% infrastructure cost reductions for customers including Siemens Healthineers, ResMed, NVIDIA, and Automation Anywhere.