llm-hardware
(2)
Reiner Pope
Reiner Pope is the co-founder and CEO of MatX, an AI chip startup based in Mountain View, California, designing purpose-built silicon for large language models. A former Google Senior Staff Software Engineer who led AI software development for Google's TPUs and served as Efficiency Lead for PaLM, Pope left Google one week before ChatGPT launched to build what he calls 'the best chips for LLMs that physics allows.' MatX has raised approximately $604M to date, including a $500M Series B led by Jane Street and Situational Awareness LP, and is building a hybrid SRAM-HBM chip architecture targeting the world's leading AI labs.
Etched
Etched is an American semiconductor startup building Sohu, an application-specific integrated circuit (ASIC) designed to run only one thing: transformer models. By burning the transformer architecture directly into silicon, Etched claims an 8-chip Sohu server can match the throughput of 160 Nvidia H100 GPUs on Llama-70B inference. Founded in 2022 by three Harvard dropouts, the company has raised over $625M, including a recent $500M round at a reported $5B valuation.