AMD presents new method of handing indirect lighting off to an image generation model

AMD researchers published work on replacing global illumination with image generation: a one-step Stable Diffusion 2.1 Turbo model takes a direct-light frame and reconstructs indirect light. The method runs at 0.29 seconds per frame (about 3.45 fps) at 512×512 on an RTX 3090 and requires 8–9 GB of VRAM.

• Model trained on 31,000 Blender Cycles interior frames with 1–30 light sources
• Training took 50 epochs on an AMD Instinct MI210 GPU
• Speed 0.29 s per frame at 512×512 on RTX 3090, needs 8–9 GB VRAM
• TVAE with motion vectors removes light flicker between frames