Origins of creativity in attention-based diffusion models

Abstract

As diffusion models have become the tool of choice for image generation and as the quality of the images continues to improve, the question of how `creativity' originates in diffusion has become increasingly important. The score matching perspective on diffusion has proven particularly fruitful for understanding how and why diffusion models generate images that remain plausible while differing significantly from their training images. In particular, as explained in (Kamb \& Ganguli, 2024) and ot

Relevance Assessment

Research Gap

Notes are automatically saved as you type

Search Queries