Hey, I Know You!

Written by: Melissa Brisbin

show/hide words to know

Functional magnetic resonance imaging (fMRI): a way of imaging brain activity that is based on changes in blood flow in the brain....more

What’s in the Story?

Cat on Phone

Scientists are learning why cats can't tell who is on the phone, but humans are masters at matching voices to faces.

You have probably seen toddlers talking to their moms on the phone before. Even though they can't see their moms, little kids' faces light up as they recognize the voice of someone important. Usually toddlers are very “hands-on,” and need to touch and see things in the real world to understand them. So how do they recognize mom's voice without actually seeing her face?

Scientists are curious how this happens, not just for little kids but for everyone.  How do we know who we are talking to on the phone when we can only hear a voice? In the PLOS Biology article, “Implicit Multisensory Associations Influence Voice Recognition,” scientists examine how our brains connect a person’s face and that person's voice.

Brain Basics

Ear Brain

Sound enters the ear and is processed deep within the brain. This image shows that very complicated process. Click image to open larger version. Wikimedia Commons- Chittka L. and Brockmann A.

As you probably know, the brain is a complex organ that controls our entire body. But for now, let's focus on the parts of the brain that help us recognize people’s voices and faces.  

The part that tells us about a person’s voice is the auditory area, and the part that tells us about a person’s face is the visual area. These parts of the brain work together to identify a person. When two senses work together like this, scientists call it a “multiple sensory modality,” which basically means that the two (multiple) senses are so connected that they act like one sense. 

What makes the connection between sight and hearing so strong is the fact that both senses give similar information about a person. For example, a girl’s voice sounds different than a boy’s voice and their faces have different features as well. Using this idea in our example of the boy on the phone, when he hears his mom’s voice on the phone, the auditory part of his brain tells the visual part of his brain to turn on too, so the child can both “see” and hear mom.

Are You My Mommy?

Experimental Design

Scientists divided volunteers into two groups. One group matched faces with voices. The other group focused on names and voices. Click image to see larger version from article.

To see how a little boy could recognize his mom’s voice over the phone, scientists conducted an experiment. They used a special technology called functional magnetic resonance imaging to see what parts of the brain were active during the study. They then collected two groups of people for the experiment. One group was exposed to pairs of voices and faces, similar to how the little boy on the telephone recognized his mom’s voice and face together. The other group was exposed to pairs of voices and names.

After each group was familiar with their pairs, scientists mixed up the order. For the first group they placed different faces and voices together, and for the second group they mixed up the names and voices.

Experimental results

The red areas are the parts of the brain that were active during the experiment. More parts of the brain were active when volunteers matched voices and faces than when they matched names and voices. Click image to see larger version from article.

Remembering what they first heard and saw, each group had to take the jumbled results and try to match them back together. While they did this, scientists were closely observing brain activity. Individuals from both groups showed an increase in brain activity when matching the pairs back together. But the group members who were exposed to both faces and voices were much quicker to correctly match everything. The voice/face volunteers were also the only ones who showed an increase in brain activity in the facial recognition area of the brain. This shows that sight and hearing are very strongly connected.

Applying this idea to our first example, when the child hears his mom’s voice, two parts of the brain are active. The little boy’s visual area of the brain lets him “see” her face, and the auditory area of the brain lets him hear her voice. The connection our brains make between people’s voices and faces develop when we are very young, and is a strong communication skill that grows as we do.


 Additional images via Wikimedia Commons. Woman on cellphone by Dgultekin.

View Citation

You may need to edit author's name to meet the style formats, which are in most cases "Last name, First name."

Bibliographic details:

  • Article: Hey, I Know You!
  • Author(s): Melissa Brisbin
  • Publisher: Arizona State University School of Life Sciences Ask A Biologist
  • Site name: ASU - Ask A Biologist
  • Date published: January 8, 2012
  • Date accessed: March 6, 2024
  • Link: https://askabiologist.asu.edu/plosable/hey-i-know-you

APA Style

Melissa Brisbin. (2012, January 08). Hey, I Know You!. ASU - Ask A Biologist. Retrieved March 6, 2024 from https://askabiologist.asu.edu/plosable/hey-i-know-you

American Psychological Association. For more info, see http://owl.english.purdue.edu/owl/resource/560/10/

Chicago Manual of Style

Melissa Brisbin. "Hey, I Know You!". ASU - Ask A Biologist. 08 January, 2012. https://askabiologist.asu.edu/plosable/hey-i-know-you

MLA 2017 Style

Melissa Brisbin. "Hey, I Know You!". ASU - Ask A Biologist. 08 Jan 2012. ASU - Ask A Biologist, Web. 6 Mar 2024. https://askabiologist.asu.edu/plosable/hey-i-know-you

Modern Language Association, 7th Ed. For more info, see http://owl.english.purdue.edu/owl/resource/747/08/
Woman talking on cellphone
Sometimes you can tell who is on the phone just by hearing their voice.

Be Part of
Ask A Biologist

By volunteering, or simply sending us feedback on the site. Scientists, teachers, writers, illustrators, and translators are all important to the program. If you are interested in helping with the website we have a Volunteers page to get the process started.

Donate icon  Contribute

Share this page:

 

Share to Google Classroom