Monkey Thinks Robot into Action

Continued from page 1

Schwartz and his team used relatively simple algorithms to decode the patterns of neural activity recorded during the observation phase, and then used that information to control the robotic arm in real time. (Scientists can deduce both direction and speed of an intended movement from the activity of ensembles of neurons in the motor cortex: activity of specific collections of cells indicates direction, while the amplitude of the overall signal dictates speed.)

After just two days of training, the monkeys learned to control the arm in three dimensions and to control the gripper placed at the end that functions as a hand. The animals even learned to use the arm in ways in which they hadn't been trained: an accompanying video shows an animal using the arm to push a piece of food into his mouth. In a second video, the monkey brings the gripper back to his mouth and licks it, ignoring another piece of food. "He gets so good at using the tool that he may think about it as part of his own body," says Schwartz. He likens the training process to learning to use a mouse to control a computer cursor. After a certain learning period, "you're not thinking about how you have to activate a muscle in an index finger to push the left mouse button," he says. "In that way, you've embodied the cursor on the screen."

Schwartz and his collaborators are now testing the technology in humans. The first test run, begun just last week, is in an epilepsy patient who is undergoing a diagnostic test, known as electrocorticography, in which electrodes are surgically placed on the surface of the brain to try to identify the source of seizures. The surface electrodes are more precise than noninvasive scalp recordings and are less invasive than electrodes implanted into the brain, although they give a cruder level of control. Scientists will piggyback on that diagnostic test and try to use the signals recorded from the electrodes to control a computer program.

If successful, the researchers will begin testing the technology in ALS patients. In the end stages of this disease, patients are completely paralyzed; a brain-controlled computer program could help them do basic things, such as write an e-mail. "We think this could give them a way of communicating with others that's faster than existing methods," says Schwartz. "We hope to be able to create an interface for moderate typing speed, about 30 to 40 words a minute."

The researchers aim to test fully implanted electrodes, like those used in the monkey to control the robotic arm, in humans within the next two years. "With humans, I fully expect to get a lot better control," says Schwartz. In addition to being easier to train, humans can hopefully explain what's difficult or needs to be improved, he says.

Even if those tests are successful, significant hurdles remain before such devices can be routinely used in patients. The electrodes currently in use aren't ideal for long-term recording: the signals degrade over time. And the entire system will ultimately need to be made portable and wireless, or at least user friendly. "We need to make it easy enough so that patients can practice anytime they want to, rather than having a technician come out to the house and set up complicated equipment," says Schwartz. "We hope there will be improvement in electrode arrays--everything from bioactive coatings to telemetry. In two years, a lot of that should be in place."