Lessons from Lukasz Kaiser
Lukasz Kaiser co-authored “Attention Is All You Need,” introducing the Transformer, before focusing at OpenAI on process-based supervision. His work asks how intermediate reasoning steps can improve model performance on mathematical and logical problems.