Lessons from Noam Shazeer
Noam Shazeer co-authored “Attention Is All You Need,” built Mesh-TensorFlow and SwiGLU, founded Character.AI, and returned to co-lead Gemini. Across those systems, his operating focus remains computational efficiency and scaling models people genuinely want to use.