Published: Tue, March 06, 2018
Tech | By

After This Update, YouTube Vloggers Will No Longer Need a Green Screen

After This Update, YouTube Vloggers Will No Longer Need a Green Screen

The ability to download YouTube videos for offline view is one of the main features offered by YouTube Red, a Google service that requires a subscription. The feature is debuting as a beta in the YouTube app, but only for a limited set of content creators.

Google stated that the testing had been kept limited to a small group, but added that with the improvement and expansion of the segmentation technology, the tech would be integrated into Google's broader Augmented Reality services.

Of course the results are not flawless, there are some halo-like artifacts around the edges of dark clothing, for example but naturally this is the next step after Google's AI-powered portrait mode for still photos on the Pixel 2. The Mobile Real-time Video Segmentation, or the background replacement tool is available in YouTube's new "stories" video format.

Vloggers who tested the segmentation tool noted that the feature is not flawless, but what it can do in beta is quite impressive.

Google already uses AI in a related feature today on its Google Pixel 2 phones.


Surely, the release of a public version of the algorithm will learn to be more careful, careful trimming and fitting the edges of the layer of the video and background.

"Once the software masks out the background on the first image, the program uses that same mask to predict the background in the next frame". But if you're one of them, you'll now have a new tool to create custom videos.

There's a lot more information about how the technology works over on the Google Research blog, including details about the data the company used in training. "Our new segmentation technology allows creators to replace and modify the background, effortlessly increasing videos' production value without specialized equipment", read the blog post. Unlike many online publications, we don't have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.

Will a similar feature be available on Instagram at some point? Snapchat have also entered the AR game with their brand new filters.

Like this: