When the human brain learns something new, it adapts. But when artificial intelligence learns something new, it tends to forget information it already learned.
As companies use more and more data to improve how AI recognizes images, learns languages and carries out other complex tasks, a paper publishing in Science shows a way that computer chips could dynamically rewire themselves to take in new data like the brain does, helping AI to keep learning over time.
“The brains of living beings can continuously learn throughout their lifespan. We have now created an artificial platform for machines to learn throughout their lifespan,” said the senior author.
Unlike the brain, which constantly forms new connections between neurons to enable learning, the circuits on a computer chip don’t change. A circuit that a machine has been using for years isn’t any different than the circuit that was originally built for the machine in a factory.
This is a problem for making AI more portable, such as for autonomous vehicles or robots in space that would have to make decisions on their own in isolated environments. If AI could be embedded directly into hardware rather than just running on software as AI typically does, these machines would be able to operate more efficiently.
In this study, the team built a new piece of hardware that can be reprogrammed on demand through electrical pulses. The author believes that this adaptability would allow the device to take on all of the functions that are necessary to build a brain-inspired computer.
“If we want to build a computer or a machine that is inspired by the brain, then correspondingly, we want to have the ability to continuously program, reprogram and change the chip,” the author said.
The hardware is a small, rectangular device made of a material called perovskite nickelate, which is very sensitive to hydrogen. Applying electrical pulses at different voltages allows the device to shuffle a concentration of hydrogen ions in a matter of nanoseconds, creating states that the researchers found could be mapped out to corresponding functions in the brain.
When the device has more hydrogen near its center, for example, it can act as a neuron, a single nerve cell. With less hydrogen at that location, the device serves as a synapse, a connection between neurons, which is what the brain uses to store memory in complex neural circuits.
Through simulations of the experimental data, the team and their collaborators showed that the internal physics of this device creates a dynamic structure for an artificial neural network that is able to more efficiently recognize electrocardiogram patterns and digits compared to static networks. This neural network uses “reservoir computing,” which explains how different parts of a brain communicate and transfer information.
Researchers also demonstrated in this study that as new problems are presented, a dynamic network can “pick and choose” which circuits are the best fit for addressing those problems.
Since the team was able to build the device using standard semiconductor-compatible fabrication techniques and operate the device at room temperature, the author believes that this technique can be readily adopted by the semiconductor industry.
“We demonstrated that this device is very robust,” said another author. “After programming the device over a million cycles, the reconfiguration of all functions is remarkably reproducible.”
The researchers are working to demonstrate these concepts on large-scale test chips that would be used to build a brain-inspired computer.
https://www.science.org/doi/10.1126/science.abj7943
An adaptive device for AI neural networks
- 926 views
- Added
Latest News
Citrullination is a key pla…
By newseditor
Posted 14 Sep
Senolytic therapy clinical…
By newseditor
Posted 14 Sep
Genetic tools probe microbi…
By newseditor
Posted 13 Sep
A secret passage for mutant…
By newseditor
Posted 11 Sep
Specialized T cells in the…
By newseditor
Posted 10 Sep
Other Top Stories
Reducing tau levels in excitatory neurons soon after birth can prev…
Read more
Brain circuit that helps in finding your car in a parking lot
Read more
PHGDH expression and Alzheimer's disease
Read more
Older men with high body-mass index have more sperm cell irregulari…
Read more
Channels for CSF to enter the skull bone marrow and its implications
Read more
Protocols
Genetic manipulation of Pat…
By newseditor
Posted 13 Sep
Single-nucleus RNA sequenci…
By newseditor
Posted 08 Sep
Engineering RNA export for…
By newseditor
Posted 25 Aug
ATP production from electri…
By newseditor
Posted 21 Aug
Labeling PIEZO2 activity in…
By newseditor
Posted 20 Aug
Publications
Timing of lifespan influenc…
By newseditor
Posted 16 Sep
Transformer-based biomarker…
By newseditor
Posted 16 Sep
Somatic variants of MAP3K3…
By newseditor
Posted 16 Sep
The NLRP3 inflammasome and…
By newseditor
Posted 15 Sep
Targeting the metabolism of…
By newseditor
Posted 15 Sep
Presentations
Hydrogels in Drug Delivery
By newseditor
Posted 12 Apr
Lipids
By newseditor
Posted 31 Dec
Cell biology of carbohydrat…
By newseditor
Posted 29 Nov
RNA interference (RNAi)
By newseditor
Posted 23 Oct
RNA structure and functions
By newseditor
Posted 19 Oct
Posters
A chemical biology/modular…
By newseditor
Posted 22 Aug
Single-molecule covalent ma…
By newseditor
Posted 04 Jul
ASCO-2020-HEALTH SERVICES R…
By newseditor
Posted 23 Mar
ASCO-2020-HEAD AND NECK CANCER
By newseditor
Posted 23 Mar
ASCO-2020-GENITOURINARY CAN…
By newseditor
Posted 23 Mar