machine-learning-infrastructure
(2)
TensorPool
TensorPool (YC W25) is a San Francisco startup that turns cloud GPUs into a git-style command line. Instead of wrestling with SSH sessions, provider dashboards, and idle-instance billing, machine learning engineers describe a training job in a config file and run 'tp job push' - TensorPool spins up a multi-node cluster across partner clouds, streams logs, saves outputs, and shuts everything down, billing only for runtime. It advertises GPU access at roughly half the cost of major cloud providers, with H100s starting around $1.99/hr. Founded by three Stanford dormmates, the company was accepted into Y Combinator's Winter 2025 batch.
Deep Infra Inc.
Deep Infra is a Palo Alto-based AI inference cloud that lets developers run hundreds of open-source machine learning models - large language models, image and video generation, speech, and embeddings - through a simple, OpenAI-compatible, pay-per-use API. The company owns and operates its own GPU fleet across multiple US data centers, processing trillions of tokens per week for companies that want production AI without managing infrastructure.