No one agrees on their favorite movies, so be careful where you look for recommendations.
Pascal Wallisch, Clinical Assistant Professor of Psychology at New York University, explores why it’s so hard to find your next favorite film.
Pascal Wallisch serves as clinical assistant professor of psychology at New York University, where he heads the Fox lab.
Predicting Movie Taste
We were interested in how subjective the movie taste of individuals is.
To find out, we asked over 3000 study participants to rate a large and representative sample of major motion pictures on a scale from 0 to 4 stars.
When we compared these ratings, we found that individuals agree a little better than one would expect from chance, but not by much. In other words, given this low inter-subjective agreement, disagreements about movie quality should be expected routinely.
As a matter of fact, we did not find a single movie – good or bad – that everyone agreed on.
So if movie taste is radically idiosyncratic, the question is whether experts – movie critics – can tell you whether or not you will like any given movie.
The answer is no – movie critics do no better than non-critics. Even the most renowned movie critics we studied, such as Roger Ebert did no better than a randomly picked person in our sample, suggesting that their renown is not due to prediction accuracy.
However, if you aggregate individual information, the picture becomes more nuanced. Pooling ratings from many non-critics such as in the Internet Movie Database allows to achieve a prediction accuracy close to the maximum that is theoretically possible, given the inherent diversity of taste in the population.
Conversely, aggregators of critic information such as Rotten Tomatoes predict well what a critic will like, but predict what non critics will like only slightly better than individual non-critics, highlighting the divide between critics and the people who use their reviews as viewing recommendations.
This study also illustrates the subjective nature of appraisal. Everyone saw the same movies, but there is very strong disagreement about what is enjoyable, implying a highly complex and multidimensional evaluative landscape inhabited by our minds, only some of which is shared with other individuals.
Comments
One response to “Pascal Wallisch, New York University – Predicting Movie Taste”
But reviews serve primarily as consumer information, and as such most people learn by regularly reading specific critics what that person’s criteria or tastes are. They can then use that information to shape their own consumer judgement. I can ask a 12 year old boy which Star Wars or Transformer movie he likes best and why and get a fairly useful amount of information. But I still wouldn’t seek out either series because I prefer other types. The mention of Ebert is interesting because when he and Gene Siskel were sparring partners in heir news reviews and TV show, everyone understood that Siskel always had a regard for family films–he would tell you if a film was suitable for children, and why or why not. Ebert (himself childless) never even thought about that. Since I often in those days went to the movies with my widowed mom, our choice was more likely to find Siskel a useful guide. IF I was going on my own or with my peers, Ebert was a better guide because he liked edgier, bolder, more transgressive films. But both were useful because over time, I could tell from what they said or wrote about a film if it was a likely film for me to enjoy. Chuck Kleinhans