The faces spark with the switch. For some hearing noise for the first time, it’s a look of joyful awe; for others it’s startlement at the sudden coloring of the vibrations that always surrounded them.
This child’s face can explain the miracle of the cochlear implant — a device that bypasses a deaf person’s damaged nerve cells, simulating a sense of sound in the brain — better than I can.
That child will probably grow up with a near-normal ability to decipher speech in relative quiet. He probably will have a natural sounding voice. But as of now, he will not be able to hear music — or at least all the aspects of it. He’ll hear the rhythm, the beats of the music, but he won’t be able to discern pitch or the melody. He won’t be able to differentiate between a flute and an oboe. To him, it will all be noise. But maybe not for his whole life: Science is getting closer to giving music to the deaf.
“You do polls of people who have cochlear implants, the first thing they want to do is hear speech,” says Jay Rubinstein, a surgeon who installs the implants (he’s also fittingly the brother of Jon Rubinstein, a coinventor of the iPod). “The second thing they want to do generally is hear speech in background noise. The third thing is music.” But we can really only give them the first. Even our best software can’t distinguish one voice among many — just try giving Siri a command in a noisy room. And the reduced pitch information makes understanding tonal languages like Chinese much harder. “All the electrical is all done rather crudely compared to normal listening, quite crudely,” says Les Atlas, an audiological-systems researcher at the University of Washington.
Let’s take a listen. This is what a person with a traditional implant might hear when listening to a song (these are all simulations, as it is impossible to actually hear what another human hears, save for outright telepathy).
This is what the rest of us hear.
The difference is incomparable. The first is creepy noise, the second is music. And that’s the gap that Atlas, Rubinstein, and their collaborators are trying to bridge with a new approach to cochlear-implant processing.
In modulating the sounds coming through the implant, Atlas and his team have been able to increase the perception of music among eight test subjects. “Imagine that instead of playing a piano with your fingers, you are playing it with your forearms,” Atlas says of the music that comes through with a traditional processor. Now “imagine you can take those piano keys and you can push them up and down really fast, at the rate of the pitch. It’s 100 times per second, 200 times, 300 times. That’s what we added.” And in adjusting the noise in that manner, those forearm smashes of the keys begin to sound more like fist smashes of the keys. There’s a bit more resolution to the sound.
Here’s that same file from above, but with Atlas’s new process.
Obviously, it isn’t all the way there. But it’s the origins of melody. “They’d like to take it home,” Rubinstein said of the reactions of the eight subjects tested with the new process. Seven of them showed a substantial ability to differentiate musical instruments. Three of the subjects showed better recognition of melody (though not statistically significant in the small sample size.) “But two out of those three showed huge improvements in melody perception.”
This isn’t a superficial enhancement so implant users can listen to the latest Top 40s on their Beats by Dre. Life with less stimulus is less stimulating. Because of the degraded signals that come through the cochlear implants, it takes more mental power to process speech, which can be isolating.
Hearing loss, write researchers in the International Journal of Audiology, often leads to “withdrawal from social activities, rejection of invitations to parties, and no more visits to theatres, cinemas, churches, lectures, etc. This, in turn, leads to reduced intellectual and cultural stimulation, and an increasingly passive and isolated citizen.” Atlas knows this firsthand, having watched his father and grandfather struggle with hearing loss in a musical family. “They seemed at first isolated because it was hard to understand people,” he says, “but felt even more isolated because they couldn’t enjoy music, which was a pretty big part of our family.” I know it too, remembering my nearly deaf grandpa retreating to the world between the couch and closed-caption television. Hearing loss as we age relates to cognitive decline, with those hard of hearing declining at a rate 40 percent faster.
For now, Atlas and Rubinstein’s developments will be confined to the lab. “It’s too computationally complex to do on a wearable speech processor,” Rubinstein said. They’ll turn now to devising a simplified approach.
Hearing music for a first time can be a profound experience, because it is so integral to the human experience. “We humans are a musical species no less than a linguistic one,” writes the neurologist and author Oliver Sacks. “And to this largely unconscious structural appreciation of music is added an often intense and profound emotional reaction to music.”
Austin Chapman didn’t have implants, but when he got an advanced pair of hearing aids that allowed him to hear music for the first time, it was a revelation — in an almost spiritual sense. “Being able to hear the music for the first time ever was unreal,” he wrote. “When Mozart’s “Lacrimosa” came on, I was blown away by the beauty of it. At one point of the song, it sounded like angels singing and I suddenly realized that this was the first time I was able to appreciate music. Tears rolled down my face and I tried to hide it.”
What We're Following See More »
The White House on Wednesday laid out its plan for tax reform, with Treasury Secretary Steven Mnuchin saying it would be "the biggest tax cut and the largest tax reform in the history of our country." The tax code would be broken down into just three tax brackets, with the highest personal income tax rate cut from 39.6 percent to 35 percent. The plan would also slash the tax rate on corporations and small businesses from 35 percent to 15 percent. "The White House plan is a set of principles with few details, but it’s designed to be the starting point of a major push to urge Congress to pass a comprehensive tax reform package this year," said National Economic Council Director Gary Cohn.
"An emerging government funding deal would see Democrats agree to $15 billion in additional military funding in exchange for the GOP agreeing to fund healthcare subsidies, according to two congressional officials briefed on the talks. Facing a Friday deadline to pass a spending bill and avert a shutdown, Democrats are willing to go halfway to President Trump’s initial request of $30 billion in supplemental military funding."
The Michael Flynn story is not going away for the White House as it tries to refocus its attention. The White House has denied requests from the House Oversight Committee for information and documents regarding payments that the former national security adviser received from Russian state television station RT and Russian firms. House Oversight Chairman Jason Chaffetz and ranking member Elijah Cummings also said that Flynn failed to report these payments on his security clearance application. White House legislative director Marc Short argued that the documents requested are either not in the possession of the White House or contain sensitive information he believes is not applicable to the committee's stated investigation.
The U.S. deployed "F-35 joint strike fighters" to Estonia on Tuesday. The "jets will stay in Estonia for several weeks and will be a part of training flights with U.S. and other NATO air forces." The move comes at a time of high tension between the U.S. and Estonia's neighbor, Russia. The two nations have been at odds over a number of issues recently, most of all being Vladimir Putin's support of Syrian President Bashar al-Assad in light of Assad's chemical weapons attack on his own people in the midst of a civil war.