Adobe’s New AI Prototype Will Make You Dance to its Tunes

Adobe's new AI prototype comes with an option for synchronized dance moves with a partner

Shaking a leg or two comes easy for many but for some, it will never happen unless they are under influence. Oh no, don't even think about it. We are not talking about Dutch courage but about an AI that can make you dance. It will make you dance under its influence, though not literally. Adobe in the recent Adobe Max 2022 event, teased a prototype AI project that can animate a still picture of a person into a dancing puppet. Project Motion Mix is Adobe's new AI prototype that requires only the full-body picture as input to deliver the dance moves.

The Adobe prototype AI system combines artificial intelligence powered motion generation and Adobe's 'human rendering technologies' to create dancing animations. Once the user uploads the picture the software places the person in different environments with an option for synchronized dance moves with multiple dancers. And wait! One can choose from a set of pre-defined dance styles.

Using conventional software, creating a looping human animation is technically demanding on part of the animator and also time-consuming. He needs to capture each unique move, add it to the animation and render it into a continuous video. This process is particularly difficult if, for say, a professional dancer's move has to be replicated. But with AI-based motion generation, it becomes a matter of choosing a few options.

Although Motion Mix appears to be a quirky idea, it is not as new. Remember AI generating face-swapping deep fakes which can copy a person's dance moves into another body? Or the customizable Jib-Jab holiday cards? Or the last year's Morpheus, Adobe's own deepfake AI tool? Motion Mix appears to be only another version of deep fakes software sans the option of creating an impersonation video!!

However, Motion Mix has its own challenges for it to be accepted as a deepfake simulacrum. From the demo video published on the internet, it is pretty much evident that it is not a tool one would like to try on oneself right away. The software fails to generate clear images with defined boundaries with blurry and misshaped arms and limbs. Even though it is still in its prototype stage, and it is uncertain when Adobe would add this AI prototype tool to its user-facing services, it is a tool that is going to be instrumental in creating viral videos. We all have moments when we want to do a 'Throw it back' and want everyone to watch it. Hope you agree!!