Run a supercomputer every second of every day, and eventually its storage will fill up, its speed decrease, and its components burn out.
Yet our brains run with astonishing efficacy nearly every moment of our lives. For 40 years, scientists have wondered how delicate biological components, strung together in a seemingly chaotic heap, can maintain continuous information storage over decades. Even as individual neurons die, our neural networks readjust, fine-tuning their connections to sustain optimal data transmission. Unlike a game of telephone with messages that increasingly deteriorate, somehow our neurons self-assemble into a magical state, where they can renew almost every single component of their interior protein makeup, yet still hold onto the memories stored within.
This week, a team from Washington University in St. Louis combined neural recordings from rats with computer modeling to uncover one of the largest mysteries of the brain: why, despite noisy components, its so damn powerful. By analyzing firing patterns from hundreds of neurons over days, the team found evidence that supports a type of computational regime that may underlie every thought and behavior that naturally emerge from electrical sparks in the brainincluding consciousness.
The answer, as it happens, has roots in an abstruse and controversial idea in theoretical physics: criticality. For one of the first times, the team observed an abstract pull that lures neural networks back into an optimal functional state, so they never stray far from their dedicated set points determined by evolution. Even more mind-blowing? That attractive force somehow emerges from a hidden universe of physical laws buried inside the architecture of entire neural networks, without any single neuron dictating its course.
Its an elegant idea: that the brain can tune an emergent property to a point neatly predicted by the physicists, said lead author Dr. Keith Hengen.
Attractor point sounds like pickup artist lingo, but its a mathematical way to describe balance in natural forces (cue Star Wars music). An easy-to-imagine example is a coiled spring, like those inside mattresses: you can stretch or crush them over years, but they generally snap back to their initial state.
That initial state is an attractor. A similar principle, though far more abstract, guides neural activity, especially the main drivers of the brains communication: inhibitory and excitatory neurons. Think of them as the yin and yang of electrical activity in the brain. Both send spikes of electricity to their neighbors, with inhibitory neurons dampening the transmission and excitatory ones amplifying the message. The more signals come in, the more spikes they send outsomething called a firing rate, kind of like the beats-per-minute music of brain activity.
Yet even individual neurons have a capped level of activation. Normally, they can never fire so much it messes up their physical structures. In other words, neurons are self-limiting. On a wider scale, neural networks also have a global tuning nob that works on the majority of synapses, mushroom-shaped structures protruding from neural branches where neurons talk to each other.
If the network gets too excited, the nob dials down to quiet transmission signals before the brain over-activates to a state of chaosseeing things that arent there, such as in schizophrenia. But the dial also prevents neural networks from being too lackadaisical, as can happen in other neurological disorders including dementia.
When neurons combine, they actively seek out a critical regime, explained Hegen. Somehow groups of interlinked neurons achieve a state of activity right at the border of chaos and quiescence, ensuring they have an optimally high level of information storage and processingwithout tipping over into an avalanche of activity and subsequent burnout.
Understanding how the brain reaches criticality is enormous, not just for preserving the brains abilities with age and disease, but also for building better brain-mimicking machines. So far, the team said, work on criticality has been theoretical; we wanted to hunt down actual signals in the brain.
Hegens team took advantage of modern high-density electrodes, which can record from hundreds of neurons over a period of days. They set off with two questions: one, can the cortexthe outermost brain region involved in higher cognitive functionsmaintain brain activity at a critical point? Two, is it because of individual neurons, which tend to constrain their own activity levels?
Here comes the fun part: rats with pirate-eye patches. Blocking incoming light signals in one eye causes massive reorganization of neural activity over time, and the team monitored these changes over the course of a week. First, in rats running around their cages with implanted electrodes, the team recorded their neural activity while the animals had both eyes open. Using a mathematical method to parse the data into neuronal avalanchescascades of electrical spikes that remain relatively local in a networkthe team found that the visual cortex undulated on the brink of criticality, regardless of daytime or night. Question one, solved.
The team next occluded a single eye in their rats. After a little more than a day, neurons that carry information from the pirate patch-eye went quiet. Yet by day five, the neurons rebounded back in activity to their attractor baselineexactly what the team predicted.
But surprisingly, network criticality didnt follow a similar timeline. Almost immediately after blocking the eye, scientists saw a massive shift in their network state away from criticalitythat is, away from optimal computation.
It seems that as soon as theres a mismatch between what the animal expects and what its getting through that eye, the computational dynamic falls apart, said Hengen.
In two days, however, the network inched back to a near criticality state, long before individual neurons recovered their activity levels. In other words, maximal computation in the brain isnt because individual neuron components are also working at their maximum; rather, even with imperfect components, neural networks naturally converge towards criticality, or optimal solutions.
Its an emergent property at its finest: the result of individual neural computation is more than its sum. [Its] what we [can] learn from lots of electrodes, commented Dr. Erik Herzog, a neuroscientist at Washington University who was not involved in the study.
Emergent phenomena, such as complex thought and consciousness, are often brushed to philosophical discussionare our minds more than electrical firing? Is there some special, abstract property such as qualia that emerges from measurable, physical laws?
Rather than resorting to hand-waving theories, the team went the second route: they hunted down the biological bases of criticality. Using computational methods, they tried a handful of different models of the visual cortex, playing around with various parameters until they found a model that behaved the same way as their one-eyed rats.
We explored over 400 combinations of different parameters, the team said, and less than 0.5 percent of the models matched our observation. The successful models had one thing in common: they all pointed to inhibitory connections as the crux of achieving criticality.
In other words, optimal computation in the brain isnt because of magic fairy dust; the architecture of inhibitory connections is a foundational root upon which mind-bending abstract physical principles, such as criticality, can grow and guide brain function.
Thats enormously good news for deep learning and other AI models. Most currently employ few inhibitory connections, and the study immediately points at a way to move towards criticality in artificial neural networks. Larger storage and better data transmissionwho doesnt want that? Going even further, to some, criticality may even present a way towards nailing down consciousness in our brains and potentially in machines, though the idea is controversial.
More immediately, the team believes that criticality can be used to examine neural networks in neurological disorders. Impaired self-regulation can result in Alzheimers, epilepsy, autism, and schizophrenia, said Hengen. Scientists have long known many of our most troubling brain disorders are because of network imbalances, but pinpointing a measurable, exact cause is difficult. Thanks to criticality, we may finally have a way to peek inside the hidden world of physical laws in our brainsand tune them towards health.
It makes intuitive sense, that evolution selected for the bits and pieces that give rise to an optimal solution [in brain computation]. But time will tell. Theres a lot of work to be done, said Hengen.
Image Credit: Wikimedia Commons
Continue reading here:
This Strange Rule Is What Makes the Human Brain So Powerful - Singularity Hub
- Downloads - Singularity Viewer [Last Updated On: December 25th, 2016] [Originally Added On: December 25th, 2016]
- What is Singularity (the)? - Definition from WhatIs.com [Last Updated On: January 5th, 2017] [Originally Added On: January 5th, 2017]
- When Electronic Witnesses Are Everywhere, No Secret's Safe - Singularity Hub [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Report: AMD Ryzen Performance in Ashes of the Singularity Benchmark - PC Perspective [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Do you believe in the Singularity? - Patheos (blog) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Editorial Note From the Singularity Hub Team - Singularity Hub [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Discover the Most Advanced Industrial Technologies at Exponential Manufacturing - Singularity Hub [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- 10th Letter looks at nature in the time of the Singularity - Creative Loafing Atlanta [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Donald Trump Is the Singularity - Bloomberg View - Bloomberg.com - Bloomberg [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Wearable Devices Can Actually Tell When You're About to Get Sick - Singularity Hub [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- AMD 8-core Ryzen benchmark show up on Ashes Of The Singularity ... - VR-Zone [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Robot Cars Can Teach Themselves How to Drive in Virtual Worlds - Singularity Hub [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Physicists Unveil Blueprint for a Quantum Computer the Size of a Soccer Field - Singularity Hub [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- How Robots Helped Create 100000 Jobs at Amazon - Singularity Hub [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Ready to Change the World? Apply Now for Singularity University's 2017 Global Solutions Program - Singularity Hub [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Singularity Containers for Science, Reproducibility, and HPC - Linux.com (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Families Finally Hear From Completely Paralyzed Patients Via New Mind-Reading Device - Singularity Hub [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- artificial intelligence: the fear of a technological singularity ... - ETtech.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Holograms Aren't The Stuff of Science Fiction Anymore - Singularity Hub [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- How the World Has Changed From 1917 to 2017 - Singularity Hub [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Preparing for the Singularity - Inverse [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Our Health Data Can Save Lives, But We Have to Be Willing to Share - Singularity Hub [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Ashes of the Singularity merges with standalone expansion Escalation, no upgrade fee - PCGamesN [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Just Stand Inside this Room and it Will Wirelessly Charge Your Phone - Singularity Hub [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- AMD bundles Ashes of the Singularity with FX processors ahead of Ryzen's launch - PCWorld [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Ashes of the Singularity: Escalation being merged with the original game - PC Invasion (blog) [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Singularity - GameSpot [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- The roots of technological singularity can be traced backed to the Stone Age - Wired.co.uk [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- Jide's new OS is like an Android version of Windows 10's Continuum - The Verge [Last Updated On: February 22nd, 2017] [Originally Added On: February 22nd, 2017]
- Jide Announces Remix Singularity: The Continuum Alternative for Android - XDA Developers (blog) [Last Updated On: February 22nd, 2017] [Originally Added On: February 22nd, 2017]
- New Tech Makes Brain Implants Safer and Super Precise - Singularity Hub [Last Updated On: February 23rd, 2017] [Originally Added On: February 23rd, 2017]
- One Android company wants to use smartphones to make PCs truly dead - BGR [Last Updated On: February 23rd, 2017] [Originally Added On: February 23rd, 2017]
- Remix tries its hand at the mobile-desktop hybrid OS with Singularity - Android Police [Last Updated On: February 23rd, 2017] [Originally Added On: February 23rd, 2017]
- Financial Leaders: Make Your Mark on the Future at Exponential Finance - Singularity Hub [Last Updated On: February 23rd, 2017] [Originally Added On: February 23rd, 2017]
- Remix Singularity is Jide's Android answer to Windows Continuum - SlashGear [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- AMD Radeon RX 580 Ashes of the Singularity Benchmarks Leaked 4K, Ryzen Combo, CrossFire and More! - Wccftech [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Damon Wayans Jr. Joins FX Sci-Fi Comedy Singularity - Den of Geek US [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- After Man? From Singularity to Specificity - Peace Research Institute Oslo (PRIO) (press release) (blog) [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Why the Potential of Augmented Reality Is Greater Than You Think - Singularity Hub [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Damon Wayans Jr In Evan Goldberg & Seth Rogen AI comedy - /FILM [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Ashes of Singularity: Escalation Gets an Update - CGMagazine [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Google Updates: Scuba, Singularity, SMS and suing - The INQUIRER [Last Updated On: February 24th, 2017] [Originally Added On: February 24th, 2017]
- Singularity Art Show Tonight In San Francisco! [Last Updated On: February 25th, 2017] [Originally Added On: February 25th, 2017]
- Stardock celebrate v2.1 of Ashes of the Singularity: Escalation with a ... - PCGamesN [Last Updated On: February 27th, 2017] [Originally Added On: February 27th, 2017]
- Video: AI Is Getting Smarter, Says Singularity University's Neil ... - Wall Street Journal (subscription) (blog) [Last Updated On: February 28th, 2017] [Originally Added On: February 28th, 2017]
- This Neural Probe Is So Thin, The Brain Doesn't Know It's There - Singularity Hub [Last Updated On: March 1st, 2017] [Originally Added On: March 1st, 2017]
- Citizen Science Means Anyone Could Discover Planet NineEven You - Singularity Hub [Last Updated On: March 1st, 2017] [Originally Added On: March 1st, 2017]
- Singularity University establishes new organisation in Denmark - Ministry of Foreign Affairs of Denmark [Last Updated On: March 1st, 2017] [Originally Added On: March 1st, 2017]
- Singularity University opening organisation in Denmark - The Copenhagen Post - Danish news in english [Last Updated On: March 1st, 2017] [Originally Added On: March 1st, 2017]
- Does Zapping Your Brain Actually Help You Learn Faster? - Singularity Hub [Last Updated On: March 2nd, 2017] [Originally Added On: March 2nd, 2017]
- What You Need to Know About Elon Musk's Plan to Fly People to the Moon - Singularity Hub [Last Updated On: March 2nd, 2017] [Originally Added On: March 2nd, 2017]
- Singularity: Explain It to Me Like I'm 5-Years-Old - Futurism - Futurism [Last Updated On: March 3rd, 2017] [Originally Added On: March 3rd, 2017]
- Singularity for PC Reviews - Metacritic [Last Updated On: March 4th, 2017] [Originally Added On: March 4th, 2017]
- Singularity (mathematics) - Wikipedia [Last Updated On: March 4th, 2017] [Originally Added On: March 4th, 2017]
- See How This House Was 3D Printed in Just 24 Hours - Singularity Hub [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- NYC's Metrograph theater is running a sci-fi film series featuring Blade Runner, Ex Machina, and Metropolis - The Verge [Last Updated On: March 8th, 2017] [Originally Added On: March 8th, 2017]
- 3 Exciting Biotech Trends to Watch Closely in 2017 - Singularity Hub [Last Updated On: March 9th, 2017] [Originally Added On: March 9th, 2017]
- New Burger Robot Will Take Command of the Grill in 50 Fast Food Restaurants - Singularity Hub [Last Updated On: March 9th, 2017] [Originally Added On: March 9th, 2017]
- Are These Giant Neurons the Seat Of Consciousness in the Brain? - Singularity Hub [Last Updated On: March 10th, 2017] [Originally Added On: March 10th, 2017]
- How Fully Synthetic Complex Life Just Got a Lot Closer - Singularity Hub [Last Updated On: March 12th, 2017] [Originally Added On: March 12th, 2017]
- Singularity University launches inaugural Canada Summit | BetaKit - BetaKit [Last Updated On: April 8th, 2017] [Originally Added On: April 8th, 2017]
- Singularity - Everything2.com [Last Updated On: April 8th, 2017] [Originally Added On: April 8th, 2017]
- Singularity (Game) - Giant Bomb [Last Updated On: April 8th, 2017] [Originally Added On: April 8th, 2017]
- Ashes of the Singularity: Escalation on Steam [Last Updated On: April 8th, 2017] [Originally Added On: April 8th, 2017]
- Approaching the World of Collaboration Singularity - CommsTrader [Last Updated On: June 6th, 2017] [Originally Added On: June 6th, 2017]
- Berkeley Lab's Open-Source Spinoff Serves Science | Berkeley Lab - Lawrence Berkeley National Laboratory [Last Updated On: June 7th, 2017] [Originally Added On: June 7th, 2017]
- Beyond Politics: Innovating for a Sustainable Future - Singularity Hub [Last Updated On: June 7th, 2017] [Originally Added On: June 7th, 2017]
- Tune Into the Future of Fintech at Exponential Finance This Week - Singularity Hub [Last Updated On: June 7th, 2017] [Originally Added On: June 7th, 2017]
- Experts Weigh in on AI and the Singularity - Futurism [Last Updated On: June 7th, 2017] [Originally Added On: June 7th, 2017]
- Singularity | Mass Effect Wiki | Fandom powered by Wikia [Last Updated On: June 7th, 2017] [Originally Added On: June 7th, 2017]
- Quantum Computers Will Analyze Every Financial Model at Once - Singularity Hub [Last Updated On: June 8th, 2017] [Originally Added On: June 8th, 2017]
- Deloitte and Singularity University Extend Their Relationship To ... - PR Newswire (press release) [Last Updated On: June 8th, 2017] [Originally Added On: June 8th, 2017]
- Ashes of the Singularity: Escalation 2.3 update adds a new campaign today - PC Gamer [Last Updated On: June 8th, 2017] [Originally Added On: June 8th, 2017]
- Singularity and Docker | Singularity [Last Updated On: June 8th, 2017] [Originally Added On: June 8th, 2017]
- Ashes of the Singularity gets a new fully-voiced campaign - PCGamesN [Last Updated On: June 9th, 2017] [Originally Added On: June 9th, 2017]
- At Exponential Finance, the Singularity University Explores Visionary Applications of Blockchains - Crypto Insider (press release) (blog) [Last Updated On: June 9th, 2017] [Originally Added On: June 9th, 2017]
- Get It While It's Hot: Why Fintech Is a Goldmine for Investors - Singularity Hub [Last Updated On: June 10th, 2017] [Originally Added On: June 10th, 2017]
- Forget Police Sketches: Researchers Perfectly Reconstruct Faces by Reading Brainwaves - Singularity Hub [Last Updated On: June 14th, 2017] [Originally Added On: June 14th, 2017]
- Singularity Summit comes to SA | IT-Online - IT-Online [Last Updated On: June 16th, 2017] [Originally Added On: June 16th, 2017]
- These 7 Disruptive Technologies Could Be Worth Trillions of Dollars - Singularity Hub [Last Updated On: June 17th, 2017] [Originally Added On: June 17th, 2017]