Microsoft’s New Ray Tracing AI, now at 16 fps

Microsoft’s New Ray Tracing AI (YouTube Video, six minutes with hardcoded ad at the end). They ingested 16 million ray traced 3D images, to make an AI that simply infers (from its past knowledge) what the play of real light in a 3D scene should be. Then the AI applies it and ‘renders’ the scene in a microsecond. You can tweak materials, and it updates instantly.

Animated? Yup, their pseudo-raytracing currently clocks in at 16 frames per second (on MS’s research labs hardware, admittedly). Quite respectable, and there are also frame-interpolation AIs out there that might boost it to 30FPS.

Physics? Yup, they even added that too. Even dynamic water.

Generative AI overlay? Not yet. But if this gets a general open-source release and isn’t locked away as an exclusive for Microsoft Flight Simulator, someone will add generative AI imaging to the mix. Imagine not only AI raytracing, but AI raytracing + a layer of SD ‘style change’ based off the 3D scene (but still faithful to it). The ‘Hollywood-real look’ for your 3D scene, in near real-time and beautifully lit.

What a time to be alive. Indeed, what a time to have a huge Poser runtime. Poser has such massive possibilities ahead, if only it can shrug off the AI-haters. The devs don’t even have to develop for it, I would imagine. Just open up some general hooks in Python, to let users hook into whatever local AI they choose to run.