Dean Leittersdorf introduces Over Zoom, then enters a prompt that makes me feel like I have just taken psychedelic mushrooms: “Wild West, space, Roman, gold, under water.” He feeds in words to the artificial intelligence model developed by his startup, Decart, which manipulates live video in real time.
“I have no idea what will happen,” says Leitersdorf with a laugh, shortly before it transforms into a strange, golden, upgraded version of Julius Caesar in Poncho.
Leittersdorf already looks a bit wild – long hair falls on his back, a pen performing acrobatics in the fingers. When we say, his image on the screen oscillates in a surreal way, because the model tries to predict what every fresh frame should look like. Leittersdorf puts his hands on his face and is transformed into more feminine features. His pen jumps between different colors and shapes. He adds more hints that take us to fresh psychedelic kingdoms.
DECART Video-Video model, MirageIt is both an impressive feat of engineering and a sign of how AI can soon shake the live industry. Tools such as Sora OpenNai can conjure up an increasingly realistic video material with a hint. Mirage now allows you to manipulate video in real time.
On Thursday Decart starts website and an application that will allow users to create their own movies and modify YouTube clips. The site offers several default topics, including “anime”, “Dubai Skyline”, “Cyberpunk” and “Versailles Palace”. During our interview, Leittersdorf sends someone a played clip Fortnite And the scene transforms from the well -known world Battle Royale into a version set under water.
Decart technology has great potential for games. In November 2024, the company demonstrated the game called Oasis which applied a similar approach to Mirage to generate playable Minecraft-A world in flight. Users can get closer to the texture, and then enlarge again to produce fresh playable scenes in the game.
Manipulating live scenes in real time is even more calculated. Decart wrote a low level code to squeeze quick calculations from NVIDIA systems to achieve a feat. Mirage generates 20 frames per second with a resolution of 768 × 432 and a delay of 100 milliseconds per frame-which comes to a decent quality Tiktok clip.