local-ai
(2)
Cactus
Cactus is a cross-platform, open-source AI inference engine built in C/C++ to run language, speech, and vision models directly on smartphones, laptops, wearables, and other low-power edge hardware. It gives mobile developers Flutter, React Native, Kotlin, and Swift SDKs to deploy quantized models on-device - cutting latency to under 100ms, keeping data private, working offline, and avoiding cloud API bills - with automatic cloud fallback for heavier tasks. A YC Summer 2025 company, Cactus already powers production apps serving 500,000+ weekly inference tasks.
OpenInfer
OpenInfer is a San Mateo-based AI infrastructure startup building an 'Inference OS for the agentic era' - software that runs large AI models and agents directly on the CPUs, GPUs and NPUs enterprises already own, from edge devices to private data centers, without cloud lock-in. Founded by ex-Meta and Roblox systems engineers Behnam Bastani and Reza Nourai, its OpenInfer Engine claims 2-3x faster inference than Llama.cpp and Ollama on distilled DeepSeek models and works as a drop-in replacement for existing endpoints. The company raised an $8M seed round in February 2025 and has since shipped Jean, a private email-native agentic AI system, and orchestration layers for heterogeneous compute.