Animaj Introduces Sketch-to-Motion AI Tool [Video]

Animaj has launched Sketch-to-Motion, an AI tool which turns rough sketches into fully-rendered 3D animations with one click.

Built on Animaj’s advanced AI models, the tool operates in a fully editable 3D environment, enabling seamless creative adjustments at any stage of the process. The system is built around two main types of models: sketch-to-pose and 3D motion in-betweening.

Sketch-to-pose models use ResNet50 architecture and are trained on hundreds of thousands of pairs of sketches and their corresponding 3D poses for each character. These models can accurately predict the rig controller values of a character from any input sketch.

Motion in-betweening models focus on predicting the intermediate poses between the key poses of the characters. Key poses are typically spaced a few frames apart. These models leverage Long Short-Term Memory (LSTM) architecture to ensure the movement remains consistent over time.

“Sketch-to-Motion changes everything about how we create animations,” said Sixte de Vauplane, …