A NeurIPS 2026 Tutorial · Sydney, Australia

The Principles of Diffusion Models: Toward Fast and Scalable Diffusion LLMs

A concise, hands-on tutorial on fast diffusion-based generation across continuous and discrete data, with live demos you can adapt for your own research.

DateMon, Dec 7, 2026
Time9:00 AM AEDT
RoomTikTok Ent Centre
FormatLectures + live demos

01 Speakers

Three instructors.

Chieh-Hsin (Jesse) Lai received his Ph.D. in Mathematics from the University of Minnesota in 2021. He is currently a Staff Research Scientist at Sony AI and a Visiting Assistant Professor in the Department of Applied Mathematics at National Yang Ming Chiao Tung University (Taiwan). His research focuses on deep generative modeling (with an emphasis on diffusion models) and AI for science. He has organized and delivered tutorials on generative AI at ISMIR 2024, ICASSP 2025, and IJCNN 2025. Recently, he led and authored a book, The Principles of Diffusion Models, which provides a systematic treatment of the foundations of diffusion models.

YMPortrait of Yuki Mitsufuji
Sony AI · Sony Group

Yuki Mitsufuji is a Distinguished Engineer at Sony Group Corporation and leads AI research at Sony AI, working at the intersection of creativity and artificial intelligence. He is also a Visiting Research Professor at New York University and an IEEE Senior Member. His research focuses on generative models and diffusion-based approaches for vision and audio. He has organized and delivered tutorials on diffusion models at international conferences such as ISMIR 2024, ICASSP 2025, and IJCNN 2025, and has given a series of lectures at the Tokyo Institute of Technology.

SSPortrait of Subham Sekhar Sahoo
MBZUAI · IFM

Subham Sahoo is a Senior Research Scientist at the MBZUAI Institute of Foundation Models, where he leads a research team focused on diffusion language models (diffusion-LLMs). He holds a Ph.D. from Cornell University, where he conducted foundational work in this area. Most notably, he proposed the MDLM framework, which has played a pivotal role in shaping the field of discrete diffusion and has been adopted at industrial scale, such as ByteDance’s state-of-the-art diffusion-LLM and NVIDIA’s GenMol foundation model for drug discovery.

02 Schedule

Two parts, three live demos.

The tutorial starts at 9:00 AM AEDT on Monday, December 7, in the TikTok Ent Centre and runs in the order below. Per-session times will be posted closer to the event.

Part I

Continuous Diffusion

This section develops the theoretical and empirical foundations of diffusion and flow-map models for fast sampling on continuous data.

InstructorChieh-Hsin (Jesse) Lai
I · 01 Continuous diffusion overview from three origins Lecture
I · 02 Diffusion-motivated flow-map models as fast generators Lecture
I · 03 Efficient flow-map training with Consistency Mid-Training Lecture
I · 04 Live Demo 1: Training a flow-map model Live demo
Interlude Audio-Visual Generation & Protection of Creation Instructor: Yuki Mitsufuji. A brief look at AI content creation and protection, from diffusion memorization and attribution to audio-visual models such as MMAudio, highlighting both creativity and the need for safeguards. Lecture
—BreakBreak
Part II

Discrete Diffusion

This section builds the theoretical and empirical foundation for diffusion when the data lives in discrete space.

InstructorSubham Sekhar Sahoo
II · 01 Discrete diffusion overview
  • Uniform-state diffusion: forward / reverse process
  • Training + implementation
  • Samplers
Lecture
II · 02 Live Demo 1: Image generation
  • Training a discrete diffusion model for image generation
  • Implement samplers: ancestral sampler, and Psi-sampler [2] for inference-time scaling
Live demo
II · 03 Self-distillation to accelerate sampling
  • The discrete-space and continuous-space diffusion duality [1]
  • Use the duality to design Discrete Consistency Distillation [1]
  • Implementation
Lecture
II · 04 Live Demo 2: Discrete Consistency Distillation
  • Distill a pre-trained discrete diffusion model for faster inference via Discrete Consistency Distillation
  • Implement the Greedy-Tail sampler [1] for few-step generation
Live demo

Session times to be announced · shown in program order.

03 Materials

Book, slides & notebooks.

Everything below is from the CVPR 2026 edition of this tutorial. NeurIPS 2026 slides and a recording will be added here.

Book & references

Continuous diffusion

Discrete diffusion

Slides & recording

Slides

Recording

  • To be posted

How to cite

  • To be posted