mixture-of-experts
(2)
Noam Shazeer and the Art of Making Machines Talk
He helped give language models their modern architecture, then left the lab to see whether people would actually talk to them. His route from Google to Character.AI, back to Gemini, and on to OpenAI began with a crayon chart on a wall.
Azalia Mirhoseini
Azalia Mirhoseini is an Iranian-born AI researcher, Stanford professor, and co-founder of Ricursive Intelligence - a frontier AI lab valued at $4 billion that uses AI to design better chips, which in turn train stronger AI. Best known for AlphaChip, the deep reinforcement learning system that now designs Google's TPUs and has compressed chip floorplanning from months to hours, she also co-invented the Mixture-of-Experts architecture underpinning GPT, Claude, and Gemini. With 20,000+ citations and a $335M-funded startup launched in under four months, she is closing the recursive loop between artificial intelligence and the hardware it runs on.