Technology
  1. Home
  2. Tech
  3. Innovation
Save
Print

Disney building facial recognition to figure out when you'll laugh during Toy Story 5

13 reading now
Show comments

The Walt Disney Company is using AI to determine how much audiences enjoy every single moment of its films.

At IEEE's Computer Vision and Pattern Recognition last weekend, Disney Research and Caltech explained their technique for tracking the facial expressions of people watching movies.

Up Next

ASX winners and losers - a snapshot

null
Video duration
00:43

More BusinessDay Videos

null
Video duration
03:01

Can earnings shake life back into the ASX ...
null
Video duration
00:59

AustralianSuper flags equities risk
null
Video duration
01:12

Twitter shares tumble
null
Video duration
01:26

Tech slides on Wall Street
null
Video duration
01:24

Apple iPhone turns 10
More videos

Musk and Zuckerberg trade barbs over AI

Should we fear or embrace Artificial Intelligence? Elon Musk and Mark Zuckerberg have opposing views.

The research team calls its new algorithm "factorised variational autoencoders" (FVAEs). They claim the technology is so effective at recognising complex expressions that, after analysing a single audience member's face for about ten minutes, it can even predict that face's future expressions throughout the remainder of a film.

In order to build a dataset of millions of facial landmarks to feed into a neural network, researchers used infrared cameras to film the audiences of 150 showings of nine movies, including recent Disney films Star Wars: The Force Awakens, Zootopia, Inside Out, and Big Hero 6.

The resulting AI system was then tested on other audiences. After it tracked moviegoers' facial reaction patterns for a few minutes, FVAEs were then able to predict when they would smile or laugh (as tied to significant moments in the films), outperforming other methods of predictive analysis given far more data. As research progresses, FVAEs could also presumably track other emotions like fear and sadness.

Advertisement

Disney isn't the only film company that wants to better understand how viewers react to movies. Over the last five years, Dolby Laboratories has been studying movie watchers on a neurophysiological level, strapping biosensors onto volunteers to track their reactions as they experience movies. The company does these tests to prove that its audio and visual technology can elicit stronger responses than its competition.

But it will be interesting to see how Disney, the world's second-largest media conglomerate, uses the data they collect from tracking audiences faces, as this AI facial tracking system could help it understand audience reactions much better than human market researchers. "Understanding human behaviour is fundamental to developing AI systems that exhibit greater behavioural and social intelligence," said Caltech machine learning professor Yison Yue in a press statement. "After all, people don't always explicitly say that they are unhappy or have some problem."

Critics, actors, and directors already complain that the demands of Hollywood studios are stripping directors of their creative control. Imagine what the production and editing process will be like once executives can use AI to ensure each scene evokes the appropriate response.

Explore the smart design, breakthrough science and awe-inspiring tech shaping your future at Gizmodo Australia.

0 comments