Meta launches tool to convert drawings into animations thanks to artificial intelligence

Meta launches tool to convert drawings into animations thanks to artificial intelligence

Meta has unveiled an open source project called Animated Drawings which allows artists, creators and developers to add motion and animation to characters they have drawn or created.

Here’s how Animated Drawings works

This initiative, from the Fundamental AI Research (FAIR) team of the division dedicated to the. Artificial Intelligence Meta AI, started in 2021 as part of work on computer vision. They applied object detection, pose estimation, and image processing and segmentation models “to quickly create a digital version of the drawing.”

The company explained in a statement that, once these parameters were assessed, they thought about the ability to deform these drawings and animate them using traditional computer graphics techniques.

Then, they raised a demo “in the hope of getting to collect 10 thousand drawings” to be able to train their machine learning model (‘machine learning’) with these samples. The opening of this system had an “overwhelmingly positive” response, to the point that, in the first few months, users had uploaded more than 1.6 million images.

While this first demo indicated that the drawings should be of human beings, some users shared creations of brand logos, animals such as birds and fish, and other shapes that, initially, this tool did not support.


In this regard, the company has commented that, while it advised that “there was interest in more drawing and animation-based experiences,” rather than include all the requested features, it opted to release an open source version of the models used in the demo of Animated Drawings. Thus, Meta has acknowledged that he has done so to inspire other developers to create experiences that use animation assets from drawings.

Accordingly, the developers have created a publicly accessible website where users can upload their creations from the device. This tool scans the drawing and allows users to delimit the characters they wish to animate, in case a drawing with multiple characters is shared.

Once recognized by this system, several animation options are offered, which are collected in the ‘All’ section and classified according to what each one proposes in sections such as ‘Dance’, ‘Fun’, ‘Jumping’ and ‘Walking’.

Once the desired animation has been chosen, the platform allows either downloading it or sharing it through social networks such as Facebook or Twitter or the WhatsApp messaging platform. It also includes the option of sending the animation by e-mail. (Europa Press)

We recommend METADATARPP’s technology podcast. News, analysis, reviews, recommendations and everything you need to know about the technological world.


Daniel Chapman