The Next Medium: Why Real-Time Interactive Video Changes Everything — Ahmed Ahres, Reactor
This talk introduces Reactor, a platform enabling real-time interactive video using world models. The core idea is to shift from passive, pre-rendered video to programmable, real-time generated pixels, akin to software. This unlocks new possibilities across various domains, including infinite interactive narratives, advanced robotics simulations, dynamic advertising, and truly engaging educational experiences, by providing developers with an API to control generated content instantly.
read more
Ahmed Ahres from Reactor presented on the transformative potential of real-time interactive video, which he views as the next evolution of world models. He emphasized that traditional video, even generative AI-produced clips, remains passive recordings – fixed outputs that cannot be altered or interacted with once rendered. The fundamental shift comes when video becomes programmable like software, allowing pixels to be generated and manipulated in real-time.
Ahres drew parallels from history to illustrate the impact of real-time capabilities. He compared paper maps (static recordings) to GPS (real-time location), highlighting how GPS enabled entirely new categories like Uber and live navigation. Similarly, film photography (delayed viewing) transformed into digital live viewfinders, which underpinned the rise of user-generated content platforms like TikTok and Instagram by providing instant feedback and control to creators. This immediate feedback, Ahres argued, is the 'ultimate level of control' that generative media currently lacks.
He identified three key types of real-time world models emerging today: 1. Veo and Sora-like models, but live and interactive: These models generate infinite video streams in real-time, allowing users to interactively change content by prompting or steering it as it plays. An example shown was a dog in a street changing to include a cat in real-time after a prompt. This eliminates the 'slot machine' problem of current generative video, offering creators programmable content and real control. It also enables dynamic, real-time advertising where content can be tailored based on a user's immediate context or search history. 2. Genie-style models (e.g., LingBot from Alibaba), but controllable worlds: These generate interactive worlds that users can walk into and control characters or environments via inputs like WASD keys. While initially reminiscent of games, this technology extends to new interactive experiences where the world generates itself around the player as they explore, rather than being a pre-built level. Crucially, it's vital for robotics to generate vast amounts of training data through dynamic simulations. It also promises revolutionary education experiences, allowing learners to 'step into the lesson' by interacting with historical moments or scientific phenomena rather than just reading about them. 3. Avatars that finally feel real: Moving beyond current uncanny valley avatars, real-time interactive avatars allow for live conversations. This has significant implications for customer support, training, and sales, where highly responsive and context-aware digital humanoids can provide more engaging and effective interactions.
Ahres showcased current applications being built on Reactor, including: Interactive Livestreams: Generating an image and then navigating inside a growing world, with user votes determining what happens next. Medical Simulations: Building interactive training environments where medical procedures can be visualized and practiced live. Cooking Simulations: Interactive kitchens where learners can experiment with ingredients and steps, seeing real-time reactions. Video Editing: Editing footage by prompting or directing, allowing for real-time visual effects, object removal, or background changes directly within a live stream or clip.
Regarding the real-time infrastructure required for these world models, Ahres stressed that 'serving a world is not like serving a model.' Key differences include: Streaming instead of requests: There's no final file to wait for; the connection stays open and stateful, streaming output while inputs flow in. Frames are shipped instantly, without batching. Every world is a live session: Each world has memory, maintaining its state as a user moves through it. Sessions are pinned to a single GPU due to statefulness and cannot be load-balanced mid-stream. Sessions stay warm and are resumed cleanly, and idle worlds expire on a timer to reclaim GPU resources. * A real-time experience, everywhere: Real-time experiences demand sub-100ms latency globally. This requires running GPUs in regions across the world, geo-routing each session to the nearest available compute, ensuring a truly global and responsive experience without developers needing to manage distributed infrastructure.
Reactor aims to simplify this complex infrastructure with a developer-first API, allowing developers to integrate these real-time world models with just a few lines of code.