Despite the enormous speed at processing reams of data and providing valuable output, artificial intelligence applications have one key weakness: Their brains are located at thousands of miles away.
Most AI algorithms need huge amounts of data and computing power to accomplish tasks. For this reason, they rely on cloud servers to perform their computations, and arent capable of accomplishing much at the edge, the mobile phones, computers and other devices where the applications that use them run.
In contrast, we humans perform most of our computation and decision-making at the edge (in our brain) and only refer to other sources (internet, library, other people) where our own processing power and memory wont suffice.
This limitation makes current AI algorithms useless or inefficient in settings where connectivity is sparse or non-present, and where operations need to be performed in a time-critical fashion. However, scientists and tech companies are exploring concepts and technologies that will bring artificial intelligence closer to the edge.
A lot of the worlds computing power goes to waste as thousands and millions of devices remain idle for a considerable amount of time. Being able to coordinate and combine these resources will enable us to make efficient use of computing power, cut down costs and create distributed servers that can process data and algorithms at the edge.
Distributed computing is not a new concept, but technologies like blockchain can take it to a new level. Blockchain and smart contracts enable multiple nodes to cooperate on tasks without the need for a centralized broker.
This is especially useful for Internet of Things (IoT), where latency, network congestion, signal collisions and geographical distances are some of the challenges we face when processing edge data in the cloud. Blockchain can help IoT devices share compute resources in real-time and execute algorithms without the need for a round-trip to the cloud.
Another benefit to using blockchain is the incentivization of resource sharing. Participating nodes can earn rewards for making their idle computing resources available to others.
A handful of companies have developed blockchain-based computing platforms. iEx.ec, a blockchain company that bills itself as the leader in decentralized high-performance computing (HPC), uses the Ethereum blockchain to create a market for computational resources, which can be used for various use cases, including distributed machine learning.
Golem is another platform that provides distributed computing on the blockchain, where applications (requestors) can rent compute cycles from providers. Among Golems use cases is training and executing machine learning algorithms. Golem also has a decentralized reputation system that allows nodes to rank their peers based on their performance on appointed tasks.
From landing drones to running AR apps and navigating driverless cars, there are many settings where the need to run real-time deep learning at the edge is essential. The delay caused by the round-trip to the cloud can yield disastrous or even fatal results. And in case of a network disruption, a total halt of operations is imaginable.
AI coprocessors, chips that can execute machine learning algorithms, can help alleviate this shortage of intelligence at the edge in the form of board integration or plug-and-play deep learning devices. The market is still new, but the results look promising.
Movidius, a hardware company acquired by Intel in 2016, has been dabbling in edge neural networks for a while, including developing obstacle navigation for drones and smart thermal vision cameras. Movidius Myriad 2 vision processing unit (VPU) can be integrated into circuit boards to provide low-power computer vision and image signaling capabilities on the edge.
More recently, the company announced its deep learning compute stick, a USB-3 dongle that can add machine learning capabilities to computers, Raspberry PIs and other computing devices. The stick can be used individually or in groups to add more power. This is ideal to power a number of AI applications that are independent of the cloud, such as smart security cameras, gesture controlled drones and industrial machine vision equipment.
Both Google and Microsoft have announced their own specialized AI processing units. However, for the moment, they dont plan to deploy them at the edge and are using them to power their cloud services. But as the market for edge AI grows and other players enter the space, you can expect them to make their hardware available to manufacturers.
Credit: Shutterstock
Currently, AI algorithms that perform tasks such as recognizing images require millions of labeled samples for training. A human child accomplishes the same with a fraction of the data. One of the possible paths for bringing machine learning and deep learning algorithms closer to the edge is to lower their data and computation requirements. And some companies are working to make it possible.
Last year Geometric Intelligence, an AI company that was renamed to Uber AI Labs after being acquired by the ride hailing company, introduced a machine learning software that is less data-hungry than the more prevalent AI algorithms. Though the company didnt reveal the details, performance charts show that XProp, as the algorithm is named, requires much less samples to perform image recognition tasks.
Gamalon, an AI startup backed by the Defense Advanced Research Projects Agency (DARPA), uses a technique called Bayesian Program Synthesis, which employs probabilistic programming to reduce the amount of data required to train algorithms.
In contrast to deep learning, where you have to train the system by showing it numerous examples, BPS learns with few examples and continually updates its understanding with additional data. This is much closer to the way the human brain works.
BPS also requires extensively less computing power. Instead of arrays of expensive GPUs, Gamalon can train its models on the same processors contained in an iPad, which makes it more feasible for the edge.
Edge AI will not be a replacement for the cloud, but it will complement it and create possibilities that were inconceivable before. Though nothing short of general artificial intelligence will be able to rival the human brain, edge computing will enable AI applications to function in ways that are much closer to the way humans do.
This post is part of our contributor series. The views expressed are the author's own and not necessarily shared by TNW.
Read next: How to follow today's eclipse, even if you live outside the US
Read the rest here:
How do you bring artificial intelligence from the cloud to the edge? - TNW
- Rotational spectra of isotopic species of methyl cyanide, CH_3CN, in their ground vibrational states up to terahertz frequencies [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Cosmological parameter extraction and biases from type Ia supernova magnitude evolution [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Continuous monitoring of pulse period variations in Hercules X-1 using Swift/BAT [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Constraining the ortho-to-para ratio of H{_2} with anomalous H{_2}CO absorption [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- A photometric and spectroscopic study of the new dwarf spheroidal galaxy in Hercules - Metallicity, velocities, and a clean list of RGB members [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Luminosities and mass-loss rates of SMC and LMC AGB stars and red supergiants [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Electron beam – plasma system with the return current and directivity of its X-ray emission [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The propagation of the shock wave from a strong explosion in a plane-parallel stratified medium: the Kompaneets approximation [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Analysis of hydrogen-rich magnetic white dwarfs detected in the Sloan Digital Sky Survey [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Letter: Centaurus A as TeV \gamma-ray and possible UHE cosmic-ray source [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Young pre-low-mass X-ray binaries in the propeller phase - Nature of the 6.7-h periodic X-ray source 1E 161348-5055 in RCW 103 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Radiative rates and electron impact excitation rates for transitions in Cr VIII [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Solar granulation from photosphere to low chromosphere observed in Ba II 4554 Å line [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Does the HD 209458 planetary system pose a challenge to the stellar atmosphere models? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Effect of asymmetry of the radio source distribution on the apparent proper motion kinematic analysis [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Destriping CMB temperature and polarization maps [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Search for cold debris disks around M-dwarfs. II [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Precise data on Leonid fireballs from all-sky photographic records [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- An X-ray view of 82 LINERs with Chandra and XMM-Newton data [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Radio observations of ZwCl 2341.1+0000: a double radio relic cluster [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Candidate free-floating super-Jupiters in the young \sigma Orionis open cluster [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The metallicity gradient as a tracer of history and structure: the Magellanic Clouds and M33 galaxies [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- XMMSL1 J060636.2-694933: an XMM-Newton slew discovery and Swift/Magellan follow up of a new classical nova in the LMC [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The inner rim structures of protoplanetary discs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The solar Ba{\sf II} 4554 Å line as a Doppler diagnostic: NLTE analysis in 3D hydrodynamical model [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Magnetic evolution of superactive regions - Complexity and potentially unstable magnetic discontinuities [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Low-mass protostars and dense cores in different evolutionary stages in IRAS 00213+6530 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- PMAS optical integral field spectroscopy of luminous infrared galaxies - I. The atlas [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- First AGILE catalog of high-confidence gamma-ray sources [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Radiative hydrodynamics simulations of red supergiant stars - I. interpretation of interferometric observations [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Extrasolar planets and brown dwarfs around A–F type stars - VII. \theta Cygni radial velocity variations: planets or stellar phenomenon? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Cosmic rays and the magnetic field in the nearby starburst galaxy NGC 253 - II. The magnetic field structure [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Physical structure and water line spectrum predictions of the intermediate mass protostar OMC2-FIR4 [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The bright galaxy population of five medium redshift clusters - II. Quantitative galaxy morphology [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Dust in brown dwarfs and extra-solar planets - II. Cloud formation for cosmologically evolving abundances [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The quiet Sun magnetic field observed with ZIMPOL on THEMIS - I. The probability density function [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Complexity in the sunspot cycle [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Properties and nature of Be stars - 26. Long-term and orbital changes of \zeta Tauri [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The massive Wolf-Rayet binary LSS 1964 (=WR 29) - II. The V light curve [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Supernova progenitor stars in the initial range of 23 to 33 solar masses and their relation with the SNR Cassiopeia A [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Hertzsprung-Russell Diagram of Star Clusters [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Table of the 10 Brightest stars within 10 Parsecs of the Sun [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Hertzsprung-Russell Diagram of the Nearest Stars [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Magnitude and Color in Astronomy [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Stellar Types [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Brown Dwarfs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Spotting the Minimum [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Structure and Evolution of Brown Dwarfs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- No Bang from the Big Bang Machine [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Sizes of the Stars and the Planets [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- An Implausible Light Thrust [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- the Masses of Degenerate Objects [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Degeneracy Pressure [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Introduction to Degenerate Objects [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Radii of Degenerate Objects [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Inevitability of Black Holes [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Scientific Pig-Out [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Neutrino Cooling of Degenerate Dwarfs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Neutrino Cooling of Neutron Stars [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Overview of Supernovae [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Energetics of Thermonuclear Supernovae [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Thermonuclear Supernovae [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Nuclear Reactions in Thermonuclear Supernovae [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Core-Collapse Supernovae [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Neutrinos and SN 1987A [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Revealing the sub-AU asymmetries of the inner dust rim in the disk around the Herbig Ae star R Coronae Austrinae [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Probing the dust properties of galaxies up to submillimetre wavelengths - I. The spectral energy distribution of dwarf galaxies using LABOCA [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- On the physical origin of the second solar spectrum of the Sc II line at 4247 Å [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- On detecting the large separation in the autocorrelation of stellar oscillation times series [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Imaging the spotty surface of Betelgeuse in the H band [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Chandra observation of Cepheus A: the diffuse emission of HH 168 resolved [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- A planetary eclipse map of CoRoT-2a - Comprehensive lightcurve modeling combining rotational-modulation and transits [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- The chemical composition of carbon stars. The R-type stars [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Flow instabilities of magnetic flux tubes - IV. Flux storage in the solar overshoot region [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Fragmentation of a dynamically condensing radiative layer [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Temporal variations of the CaXIX spectra in solar flares [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Deuterium chemistry in the Orion Bar PDR - “Warm” chemistry starring CH_{2}D^+ [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Metal abundances in the cool cores of galaxy clusters [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- The nature of the X-ray binary IGR J19294+1816 from INTEGRAL, RXTE, and Swift observations [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Relating basic properties of bright early-type dwarf galaxies to their location in Abell 901/902 [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]