The feature known from Photoshop will work in movies. You can now delete unwanted items from recordings

The April update of the Adobe package adds a new feature that is probably the most important change in After Effects over the past years. Content-aware Fill gives you the ability to remove unwanted elements from movies.

Content-aware Fill, a content-filled fill, is a function that literally transforms Photoshop. I remember correctly when I watched videos together with my friends in college showing this function in practice. We could not believe that the program is able to reliably remove unwanted elements from photos.

If you have not had the opportunity to use this tool, you need to know that it consists not only of cutting the fragment of the image, but also filling the free space with the generated image created on the basis of the environment. The program analyzes the background and is able to create structures, i.e. to add greenery or sky in a realistic, difficult to capture way.

Now Content-aware Fill goes to the video for the first time.

Two years ago, during Adobe MAX 2017 , the producer showed the operation of the Cloak Project algorithms. Everything made a huge impression, but probably no one thought that this solution will be implemented so quickly into the final version of the program.

Meanwhile, in the latest Adobe Creative Cloud update , After Effects has been able to remove elements from the environment. The whole looks as follows.

https://youtu.be/25ltIoHtiO4

The effects really make an impression.

The whole is possible thanks to the Adobe Sensei algorithms, i.e. the artificial intelligence of Adobe, which in recent months has allowed to implement the expected and truly innovative functions in the Adobe programs.

Why is adding Content-aware Fill in video such a big event?

Generating a background with the removed element in the picture is a relatively simple task. What else in the film, which I have at least 24 fps, and sometimes even 60 fps. Such an operation carried out on video requires not only more computing power, but at the same time must ensure smooth movement.

The program can not generate 24 incidental backgrounds per second. The whole must adapt to moving the movie in a reliable way. Achieving this effect is possible thanks to the SI algorithms used by Adobe, which not only analyze the processed film, but also compare it with thousands or even millions of previously edited recordings.

It is a great day for the film industry.

Over time, the Content-aware Fill mechanism will be improved, as has been done in Photoshop. And while today, virtually all large programs for image editing are equipped with Content-aware (or Inpaint), none of them apply it as well as Photoshop.

Today, I can not imagine Photoshop without filling in with content. I use it every day, also in photos of equipment on Spider's Web, for example to remove pollen and dust from shiny glass cases. I wonder if after some time I will say the same thing about Content-aware in the film.

The feature known from Photoshop will work in movies. You can now delete unwanted items from recordings