Samsung introduced Single Shot with the Galaxy S20 series, this year it upped the AI intelligence for a much improved version for the new Galaxy S21 phones. Here’s a quick explanation of what’s going on behind the scenes.
The improved Single Shot takes up to 10 photos per second while recording video for 15 seconds (up from 5 seconds on the S20). The video and photos are then analyzed by the AI, which selects the best moments and suggests ways to improve the captured content.
For photos of people or pets, it can apply Portrait mode and blur the background (you can read how AI creates precise bokeh effects here). The aesthetic engine looks at facial expressions to drop photos where someone has blinked or is looking down. This engine is formed on a database of 300,000 photos that have been selected by professionals.
Another AI engine eliminates photos with poor framing. This was formed on an even larger database of 100 million snapshots. If it’s more of a landscape shot, Smart Crop just keeps the interesting part and calls a variety of AI filters to change colors and lighting.
Then the video. If it is a slow paced scene, the phone will apply a 3x fast forward effect. If, instead, there is fast action, it will use dynamic idle. S21 phones also have Boomerang, Reverse, and Highlight video modes in their arsenal.
The highlighted video automatically creates a slideshow from the best photos and most interesting moments from the videos.
Another cool trick is called Scene Relighting. He uses a Generative Confrontation Network (GAN) to imagine a 24-hour time-lapse video from a single photo. It selects the sky, clouds, trees, water, buildings, etc., then animates the scene from morning to sunset and even at night.
Source (in Italian)
