In a medical first, researchers harnessed the brain waves of a paralyzed man unable to speak — and turned what he intended to say into sentences on a computer screen.
It will take years of additional research but the study, reported Wednesday, marks an important step toward one day restoring more natural communication for people who can’t talk because of injury or illness.
“Most of us take for granted how easily we communicate through speech,” said Dr. Edward Chang, a neurosurgeon at the University of California, San Francisco, who led the work. “It’s exciting to think we’re at the very beginning of a new chapter, a new field” to ease the devastation of patients who lost that ability.
Today, people who can’t speak or write because of paralysis have very limited ways of communicating. For example, the man in the experiment, who was not identified to protect his privacy, uses a pointer attached to a baseball cap that lets him move his head to touch words or letters on a screen. Other devices can pick up patients’ eye movements. But it’s a frustratingly slow and limited substitution for speech.
Tapping brain signals to work around a disability is a hot field. In recent years, experiments with mind-controlled prosthetics have allowed paralyzed people to shake hands or take a drink using a robotic arm -- they imagine moving and those brain signals are relayed through a computer to the artificial limb.
Chang’s team built on that work to develop a “speech neuroprosthetic” -- decoding brain waves that normally control the vocal tract, the tiny muscle movements of the lips, jaw, tongue and larynx that form each consonant and vowel.
Volunteering to test the device was a man in his late 30s who 15 years ago suffered a brain-stem stroke that caused widespread paralysis and robbed him of speech. The researchers implanted electrodes on the surface of the man’s brain, over the area that controls speech.
A computer analyzed the patterns when he attempted to say common words such as “water” or “good,” eventually becoming able to differentiate between 50 words that could generate more than 1,000 sentences.
Prompted with such questions as “How are you today?” or “Are you thirsty” the device eventually enabled the man to answer “I am very good” or “No I am not thirsty” -- not voicing the words but translating them into text, the team reported in the New England Journal of Medicine.
It takes about three to four seconds for the word to appear on the screen after the man tries to say it, said lead author David Moses, an engineer in Chang’s lab. That’s not nearly as fast as speaking but quicker than tapping out a response.
In an accompanying editorial, Harvard neurologists Leigh Hochberg and Sydney Cash called the work a “pioneering demonstration.”
They suggested improvements but said if the technology pans out it eventually could help people with injuries, strokes or illnesses like Lou Gehrig’s disease whose “brains prepare messages for delivery but those messages are trapped.”
Chang’s lab has spent years mapping the brain activity that leads to speech. First, researchers temporarily placed electrodes in the brains of volunteers undergoing surgery for epilepsy, so they could match brain activity to spoken words.
Only then was it time to try the experiment with someone unable to speak. How did they know the device interpreted his words correctly? They started by having him try to say specific sentences such as, “Please bring my glasses,” rather than answering open-ended questions until the machine translated accurately most of the time.
Next steps include ways to improve the device’s speed, accuracy and vocabulary size — and maybe one day allow a computer-generated voice rather than text on a screen — while testing a small number of additional volunteers.
AP Newsroom
Fri Jul 16 2021
In this 2017 photo provided by the University of California, San Francisco, neurosurgeon Dr. Edward Chang is reflected in a computer monitor displaying brain scans as he performs surgery at UCSF. (Barbara Ries/UCSF via AP)
COP29 climate summit draft proposes rich countries pay $250 billion per year
The draft finance deal criticised by both developed and developing nations.
Bomb squad sent to London's Gatwick Airport after terminal evacuation
This was following the discovery of a suspected prohibited item in luggage.
Kelantan urges caution amidst northeast monsoon rains
Kelantan has reminded the public in the state to refrain from outdoor activities with the arrival of the Northeast Monsoon season.
Former New Zealand PM Jacinda Ardern receives UN leadership award
Former New Zealand prime minister Jacinda Ardern was given a global leadership award by the United Nations Foundation.
ICC'S arrest warrants for Netanyahu, Gallant an apt decision - PM
The decision of the ICC to issue arrest warrants against Benjamin Netanyahu and Yoav Gallant is apt, said Datuk Seri Anwar Ibrahim.
KTMB provides two additional ETS trains for Christmas, school holidays
KTMB will provide two additional ETS trains for the KL Sentral-Padang Besar route and return trips in conjunction with the holidays.
BNM'S international reserves rise to USD118 bil as at Nov 15, 2024
Malaysia's international reserves rose to US$118.0 billion as at Nov 15, 2024, up from US$117.6 billion on Oct 30, 2024.
Findings by dark energy researchers back Einstein's conception of gravity
The findings announced are part of a years-long study of the history of the cosmos focusing upon dark energy.
NRES responds to Rimbawatch press release on COP29
The Ministry of Natural Resources and Environmental Sustainability (NRES) wishes to offer the following clarifications to the issues raised.
Online Safety Bill and Anti-Cyberbullying Laws must carefully balance rights and protections
The Online Safety Advocacy Group (OSAG) stands united with people in Malaysia in the fight against serious online harms.
Malaysia's inflation at 1.9 pct in Oct 2024 - DOSM
Malaysia's inflation rate for October 2024 has increased to 1.9 per cent, up from 1.8 per cent in September this year.
Saudi Arabia showcases Vision 2030 goals at Airshow China 2024
For the first time, Saudi Arabia is participating in the China International Aviation & Aerospace Exhibition held recently in Zhuhai.
King Charles' coronation cost GBP 71mil, govt accounts show
The coronation of Britain's King Charles cost taxpayers GBP72 million (US$90 million), official accounts have revealed.
Couple and associate charged with trafficking 51.9 kg of meth
A married couple and a man were charged in the Magistrate's Court here today with trafficking 51.974 kilogrammes of Methamphetamine.
PDRM to consult AGC in completing Teoh Beng Hock investigation
The police may seek new testimony from existing witnesses for additional insights into the investigation of Teoh Beng Hock's death.
Thai court rejects petition over ex-PM Thaksin's political influence
Thailand's Constitutional Court rejects a petition seeking to stop Thaksin Shinawatra from interfering in the running the Pheu Thai party.
Abidin takes oath of office as Sungai Bakap assemblyman
The State Assemblyman for Sungai Bakap, Abidin Ismail, was sworn in today at the State Assembly building, Lebuh Light.
UPNM cadet officer charged with injuring junior, stomping on him with spike boots
A cadet officer at UPNM pleaded not guilty to a charge of injuring his junior by stomping on the victim's stomach with spike boots.
How Indian billionaire Gautam Adani's alleged bribery scheme took off and unraveled
The indictment was unsealed on Nov. 20, prompting a $27 billion plunge in Adani Group companies' market value.
Elon Musk blasts Australia's planned ban on social media for children
Several countries have already vowed to curb social media use by children through legislation, but Australia's policy could become one of the most stringent.