
Lessons from Prafulla Dhariwal
Prafulla Dhariwal is an OpenAI researcher who led the omni team behind GPT-4o. These lessons are drawn from the text of co-authored research papers and one public post; the paper sources are joint, so the wording is shared with co-authors. — Diffusion Models Beat GANs on Image Synthesis, Prafulla Dhariwal and Alex Nichol, arXiv (2021).
In the co-authored paper Diffusion Models Beat GANs on Image Synthesis with Alex Nichol, the authors wrote: "We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models". — Diffusion Models Beat GANs on Image Synthesis, Prafulla Dhariwal and Alex Nichol, arXiv (2021).
In the co-authored paper Diffusion Models Beat GANs on Image Synthesis with Alex Nichol, the authors wrote: "a simple, compute-efficient method for trading off diversity for fidelity using gradients from a classifier". — Diffusion Models Beat GANs on Image Synthesis, Prafulla Dhariwal and Alex Nichol, arXiv (2021).
In the co-authored paper Diffusion Models Beat GANs on Image Synthesis with Alex Nichol, the authors wrote: "better generative models could have wide-ranging impacts on graphic design, games, music production, and countless other fields". — Diffusion Models Beat GANs on Image Synthesis, Prafulla Dhariwal and Alex Nichol, arXiv (2021).
In the co-authored paper Glow with Diederik Kingma, the authors wrote: "data-efficiency: the ability to learn from few datapoints, like humans". — Glow: Generative Flow with Invertible 1x1 Convolutions, Diederik P. Kingma and Prafulla Dhariwal, arXiv (2018).
In the co-authored paper Glow with Diederik Kingma, the authors wrote: "a generative model optimized towards the plain log-likelihood objective is capable of efficient realistic-looking synthesis and manipulation of large images". — Glow: Generative Flow with Invertible 1x1 Convolutions, Diederik P. Kingma and Prafulla Dhariwal, arXiv (2018).
In the co-authored paper Jukebox, the authors wrote: "We tackle the long context of raw audio using a multi-scale VQ-VAE to compress it to discrete codes". — Jukebox: A Generative Model for Music, Dhariwal and co-authors, arXiv (2020).
In the co-authored paper Jukebox, the authors wrote: "a single system to do it all remains elusive". — Jukebox: A Generative Model for Music, Dhariwal and co-authors, arXiv (2020).
In the co-authored paper Jukebox, the authors wrote: "We are releasing thousands of non cherry-picked samples, along with model weights and code". — Jukebox: A Generative Model for Music, Dhariwal and co-authors, arXiv (2020).
In a post on X on May 15, 2024, embedded by Mashable India, Dhariwal wrote: "GPT-4o (o for “omni”) is the first model to come out of the omni team, OpenAI’s first natively fully multimodal model". — Meet Prafulla Dhariwal, The Indian Brain Behind Sam Altman OpenAI's GPT-4o, Mashable India (May 17, 2024), embedding a post on X.
In a post on X on May 15, 2024, embedded by Mashable India, Dhariwal wrote: "This launch was a huge org-wide effort, but I’d like to give a shout out to a few of my awesome team members who made this magical model even possible". — Meet Prafulla Dhariwal, The Indian Brain Behind Sam Altman OpenAI's GPT-4o, Mashable India (May 17, 2024), embedding a post on X.