I see what you're saying: How some visualize sound

By Charles Choi, LiveScience 

Some people may actually see sounds, say researchers who found this odd ability is possible when the parts of the brain devoted to vision are small.

These findings points to a clever strategy the brain might use when vision is unreliable, investigators added.

Scientists took a closer look at the sound-induced flash illusion. When a single flash is followed by two bleeps, people sometimes also see two illusory consecutive flashes.

Past experiments revealed there are strong differences between individuals when it comes to how prone they are to this illusion. "Some would experience it almost every time a flash was accompanied by two bleeps, others would almost never see the second flash," said researcher Benjamin de Haas, a neuroscientist at University College London.

These differences suggested to de Haas and his colleagues that maybe variations in brain anatomy were behind who saw the illusion and who did not. To find out, the researchers analyzed the brains of 29 volunteers with magnetic resonance imaging (MRI) and tested them with flashes and bleeps. [ Animation of Illusion and Photos of Other Illusions ]

On average, the volunteers saw the illusion 62 percent of the time, although some saw it only 2 percent of the time while others saw it 100 percent of the time. They found the smaller a person's visual cortex was — the part of the brain linked with vision —the more likely he or she experienced the illusion.

"If we both look at the same thing, we would expect our perception to be identical," de Haas told LiveScience. "Our results demonstrate that this not quite true in every situation — sometimes what you perceive depends on your individual brain anatomy."

The researchers suggest this illusion could reveal a way the brain compensates for imperfect visual circuitry.

"The visual brain's representation of what hits the eye is very efficient but not perfect — there is some uncertainty to visual representations, especially when things happen quickly, like the rapid succession of flashes in the illusion," de Haas said. "We speculate that this kind of uncertainty is bigger in brains that dedicate a smaller proportion of neurons to visual areas, just like a camera with fewer megapixels will give you a lower image quality."

"If this speculation holds, it would make perfect sense for smaller visual brains to make more use of the additional information provided by the ears," de Haas explained. "In the real world, sources of light and sound are often identical, and combining them will be advantageous. Imagine you take a twilight walk in a forest and scare up some animal in the undergrowth. The best strategy for finding out whether you are dealing with a hedgehog or a bear will involve combining visual information, like moving twigs and branches, with auditory information, like cracking wood."

Much remains unknown about the roots of this illusion. For instance, only about a quarter of the individual differences regarding the illusion could be explained by brain anatomy. "We still haven't explained the rest," de Haas said.

Future research can also explore "whether the relationship between visual cortex size and audiovisual perception is specific to this illusion or holds for other audiovisual illusions as well," de Haas said.

Other such illusions include the so-called McGurk effect, when the visual component of one sound is paired with the auditory component of another sound, leading people to mysteriously perceive a third sound — for instance, when the syllables "ba-ba" are spoken over the lip movements for "ga-ga," the perception is of "da-da."

"Seeing feels like an objective, immediate way to access the world, but it can be shaped by so many things — hearing, individual brain anatomy, who knows what else?" de Haas said.

The scientists detailed their findings online Oct. 24 in the journal Proceedings of the Royal Society B.

More from LiveScience:

Want more weird health news? Find The Body Odd on Facebook.

Discuss this post

I have had synesthesia for as long as I have been aware of my surroundings.Since I was a very young child,I have seen sounds and I see words in color. I just assumed everyone had this ability until I was in my 20's and saw Tony Randall on the Tonight Show. He said as a child he went to a circus and heard a lion roar, and a brown horn seemed to come out of its mouth. Since then, I realize how unusual it is,but I consider it a gift. The colors of words help me remember things and help me look at the world in a unique way. I suspect a lot of artists and musicians have synesthesia and use it in their work. Just watch "Tantasia" sometime and see how the artist interprets the sound of the music that is being played.

  • 1 vote
Reply#1 - Wed Oct 24, 2012 3:29 AM EDT

Grovie, that's awesome, I remember seeing a piece on synesthesia on 60 minutes, or one of those shows. There was one guy whowas able to memorize Pi out to some ridiculous number of decimal places thanks to his ability to see numbers as colors! He painted it, to me it looked like a swirling, nebulous, cloud of colors, but to him it was Pi! Fascinating stuff.

I wonder though if in your experience this ability has come at the cost of some more common ability, like to remember people's faces or something like that (maybe I'm getting some conditions confused there, but you know what I mean, lol)...

btw - The article didn't explain the experiment very well. Found a little better detail in the Live Science link: "Researchers found that subjects shown a single flash of light sandwiched between two tones in quick succession reported seeing an illusory second light flash."

  • 1 vote
#1.1 - Wed Oct 24, 2012 9:15 AM EDT

@cjsks: Don't know where all the boundaries are, but you can use an analogy of processing resources. If both sight and sound regions of the brain are used when listening it isn't surprising that they will have greater/expanded abilities. But assuming the axiom nothing is free and that natural selection would have made us all synesthesists if there wasn't a compelling trade off there must be one. Perhaps there is a loss of "parallel" attention that isn't much of a problem now that people aren't dodging wild animals that want to eat them. Or maybe it is in raw calories consumed. More regions of the brain that are always on might be a disadvantage during periods of starvation.

    #1.2 - Wed Oct 24, 2012 2:04 PM EDT
    Reply

    In the science fiction book, "Pilgrimage: the Book of the People", by Zenna Henderson, human looking alien beings crash land on earth and attempt, over a period of a century, to "blend in" and live normally. They found this hard to do, because they could, among other things, see sounds, hold light in their hands, and taste colors. I always thought this was "fantasy". Amazing to learn that some humans CAN in fact "see" sounds.

      Reply#2 - Wed Oct 24, 2012 8:47 AM EDT

      Gives new meaning to "taste the rainbow" doesn't it!

        #2.1 - Wed Oct 24, 2012 9:16 AM EDT
        Reply
        You're in Easy Mode. If you prefer, you can use XHTML Mode instead.
        As a new user, you may notice a few temporary content restrictions. Click here for more info.