Most people touch up their selfies to remove pimples or ruddy patches without a second thought. Facebook wants you to have the same attitude about removing pesky eyelids from photos, too.
Using a machine learning technique called ‘generative adversarial network,’ or GAN, Facebook researchers taught an AI to observe a picture in which you blinked, compare it to an unblinking photo of you, and then use “in-painting” to substitute your closed eyelids for open eyes.
Facebook researchers Brian Dolhansky and Cristian Canton Ferrer released a paper Monday that detailed the process. Eventually, Facebook could add GAN as a feature to its Facebook or Instagram apps, though the paper does not suggest this is an option.
Dolhansky and Ferrer taught their AI to match features like iris color, skin tone, eye contours and lighting. They then gave photos to participants in their study and asked them to pick which eyes were the originals. 54% of the time, they either picked the in-painted eyes or couldn’t tell the difference.
(Read more)