Topic: Visual over audio?

[Nichi]

Interesting...

Musicians' appearances matter more than their sound
Our judgements of quality depend more on how a musician moves than what they sound like.

by Philip Ball

19 August 2013

He is sometimes called the first rock star. He would whip his long hair around as he played, beads of sweat flying into the audience, and women would swoon or throw their clothes on to the stage. This is not Mick Jagger or Jimmy Page, but Franz Liszt, the nineteenth-century Hungarian pianist whose theatrical recitals made the composer Robert Schumann say that “a great deal of poetry would be lost” had Liszt played behind a screen.

But who cares about the histrionics — it’s the music that matters, right? Not according to the latest study, which shows that people’s judgements about the quality of a musical performance are influenced more by what they see than by what they hear.

The findings, reported this week in the Proceedings of the National Academy of Sciences by social psychologist Chia-Jung Tsay of University College London1, may be embarrassing and even shocking to music lovers. The vast majority of participants in Tsay’s experiments — around 83% of both untrained participants and professional musicians — insisted at the outset that sound was their key criterion for assessing video and audio recordings of performances.

Yet it wasn’t. The participants were presented with recordings of the three finalists in each of ten prestigious international competitions, and were asked to guess the winner. With just sound, or sound and video, novices and experts both guessed right at about the same level as chance (33% of the time), or a little less. But with silent video alone, the success rate for both was about 46–53%. The experts did no better than the novices.
Performance art

The results might force some to rethink what musical performance is really about. “As a classical musician, I was initially somewhat disturbed” by the findings, says Tsay, who is herself an acclaimed pianist. “It was surprising to find that there is such a wide gap between what we believe matters in the evaluation of music performance and what is actually being used to judge performances.”

But philosopher of music Vincent Bergeron of the University of Ottawa in Canada isn’t worried. “One could plausibly argue that music made for performance, such as classical music, is a visual as well as a sonic art, and that it should also be evaluated on the basis of how it looks,” he says, adding: “This is a brilliant paper.”

Tsay thinks that, at least for this kind of music, visual cues carry implications about the degree of passion and motivation that the performer displays. These are qualities that many participants in the study cited as important. Musical novices might identify them even more accurately than the ‘experts’ can, Tsay says, because novices are unencumbered by the sound “that professional musicians unintentionally and non-consciously discard”.

Music neuropsychologist Daniel Levitin of McGill University in Montreal, Canada, agrees that Tsay’s results might have been anticipated. “In a sense, the visual channel is more primordial than the auditory,” he says.

However, there are limits to how much what you see can override what you hear. That might happen for competition finals, where all performers are comparably excellent, but previous studies of the role of visual information in musical assessment have shown that trained musicians have no problem distinguishing between good and significantly poorer performances.

Perhaps the key remaining question is whether the visual information is reliable — helping us to pick out the most deserving winner, for instance — or misleading, making us prefer performers who rely on visual flair rather than on musical depth.

But accepting body language as part of a musical performance could also be seen as entirely reasonable, because it adds more to the quality of the experience than just the sound. “Many performers do have the intuition that the role of visual information is an important one”, says Tsay. Mick Jagger knows that well enough, and so did Franz Liszt.

    Nature
    doi:10.1038/nature.2013.13572

References

    Tsay, C.-J. Proc. Natl Acad. Sci. USA http://dx.doi.org/10.1073/pnas.1221454110 (2013).

http://www.nature.com/news/musicians-appearances-matter-more-than-their-sound-1.13572?WT.mc_id=FBK_NatureNews

[Nichi]

This may be true about the masses, but I swear I go for the sound over the appearance. In fact, I often close my eyes as something live is playing, so I can 'hear' better..

[Firestarter]

It is seasonal so not on right now but one of the things I watch is a show called The Voice. The judges in the beginning, have their chairs turned around, and how they choose the contestants is on their voice. However later with advancing, America does vote. Im sure appearance is part of it, but in the end I disagree with the article. I think the voice and the way an audience is moved really does it. like on the show some folks didnt 'look' like stars so to speak, but America advanced them nonetheless.

[Michael]

I found that article confusing. It seemed to say that the people being tested picked the winner better if they didn't hear the sound. I'm still not sure what that means.

Does it mean that the judges were more influenced by the visuals than the audio? Thus those in the experiment got closer to the minds of the judges by discarding the sound? That they got it right a third of the time with sound and visual, doesn't mean anything to me - it's not as if the judges are objective evaluators.

I can't see that this study means people are more influenced by visual. It shows the judges of the competition were in the same boat as the testees - it was sheer chance who won. Then it shows that without sound people evaluated expression, not music. That they got closer to the choice of the judges, can only mean the judges consciously placed more importance on expression than sound, which is quite likely - they are often given a score sheet to help them decide, where as the testees were just told which one was best.

Any conclusions of such a study are very open to question.

If I watch a musician with the sound off, I am evaluating their skill in mime, not music. To me, public performance is about entertainment, including both music and visual. Not all musicians are entertainers. But stepping away from those populist words like passion and motivation, which have become a big fashion of late, I do include in my appreciation of an audio-visual performance, public or private, the quality of becoming a perfect channel for the music. I don't like seeing a musician 'lost' in the music, but I do like to see them fully into it.

[Nichi]

No pleasure (for me) in watching a live performance with the sound off.