Were you unable to attend Transform 2022? Check out all of the summit sessions in our on-demand library now! Watch here.
Todays demand for real-time data analytics at the edge marks the dawn of a new era in machine learning (ML): edge intelligence. That need for time-sensitive data is, in turn, fueling a massive AI chip market, as companies look to provide ML models at the edge that have less latency and more power efficiency.
Conventional edge ML platforms consume a lot of power, limiting the operational efficiency of smart devices, which live on the edge. Thosedevices are also hardware-centric, limiting their computational capability and making them incapable of handling varying AI workloads. They leverage power-inefficient GPU- or CPU-based architectures and are also not optimized for embedded edge applications that have latency requirements.
Even though industry behemoths like Nvidia and Qualcomm offer a wide range of solutions, they mostly use a combination of GPU- or data center-based architectures and scale them to the embedded edge as opposed to creating a purpose-built solution from scratch. Also, most of these solutions are set up for larger customers, making them extremely expensive for smaller companies.
In essence, the $1 trillion global embedded-edge market is reliant on legacy technology that limits the pace of innovation.
MetaBeat 2022
MetaBeat will bring together thought leaders to give guidance on how metaverse technology will transform the way all industries communicate and do business on October 4 in San Francisco, CA.
ML company Sima AI seeks to address these shortcomings with its machine learning-system-on-chip (MLSoC) platform that enables ML deployment and scaling at the edge. The California-based company, founded in 2018, announced today that it has begun shipping the MLSoC platform for customers, with an initial focus of helping solve computer vision challenges in smart vision, robotics, Industry 4.0, drones, autonomous vehicles, healthcare and the government sector.
The platform uses a software-hardware codesign approach that emphasizes software capabilities to create edge-ML solutions that consume minimal power and can handle varying ML workloads.
Built on 16nm technology, the MLSoCs processing system consists of computer vision processors for image pre- and post-processing, coupled with dedicated ML acceleration and high-performance application processors. Surrounding the real-time intelligent video processing are memory interfaces, communication interfaces, and system management all connected via a network-on-chip (NoC). The MLSoC features low operating power and high ML processing capacity, making it ideal as a standalone edge-based system controller, or to add an ML-offload accelerator for processors, ASICs and other devices.
The software-first approach includes carefully-defined intermediate representations (including the TVM Relay IR), along with novel compiler-optimization techniques. This software architecture enables Sima AI to support a wide range of frameworks (e.g., TensorFlow, PyTorch, ONNX, etc.) and compile over 120+ networks.
Many ML startups are focused on building only pure ML accelerators and not an SoC that has a computer-vision processor, applications processors, CODECs, and external memory interfaces that enable the MLSoC to be used as a stand-alone solution not needing to connect to a host processor. Other solutions usually lack network flexibility, performance per watt, and push-button efficiency all of which are required to make ML effortless for the embedded edge.
Sima AIs MLSoC platform differs from other existing solutions as it solves all these areas at the same time with its software-first approach.
The MLSoC platform is flexible enough to address any computer vision application, using any framework, model, network, and sensor with any resolution. Our ML compiler leverages the open-source Tensor Virtual Machine (TVM) framework as the front-end, and thus supports the industrys widest range of ML models and ML frameworks for computer vision, Krishna Rangasayee, CEO and founder of Sima AI, told VentureBeat in an email interview.
From a performance point of view, Sima AIs MLSoC platform claims to deliver 10x better performance in key figures of merit such as FPS/W and latency than alternatives.
The companys hardware architecture optimizes data movement and maximizes hardware performance by precisely scheduling all computation and data movement ahead of time, including internal and external memory to minimize wait times.
Sima AI offers APIs to generate highly optimized MLSoC code blocks that are automatically scheduled on the heterogeneous compute subsystems. The company has created a suite of specialized and generalized optimization and scheduling algorithms for the back-end compiler that automatically convert the ML network into highly optimized assembly codes that run on the machine learning-accelerator (MLA) block.
For Rangasayee, the next phase of Sima AIs growth is focused on revenue and scaling their engineering and business teams globally. As things stand, Sima AI has raised $150 million in funding from top-tier VCs such as Fidelity and Dell Technologies Capital. With the goal of transforming the embedded-edge market, the company has also announced partnerships with key industry players like TSMC, Synopsys, Arm, Allegro, GUC and Arteris.
VentureBeat's mission is to be a digital town square for technical decision-makers to gain knowledge about transformative enterprise technology and transact. Discover our Briefings.
Link:
Machine learning at the edge: The AI chip company challenging Nvidia and Qualcomm - VentureBeat
- Machine learning provides a new picture of the great gray owl - Phys.org - April 2nd, 2024
- What is Machine Learning? Definition, Types, Tools & More - April 2nd, 2024
- Revolutionizing Industries: The Convergence of RFID, AI, and Machine Learning - yTech - April 2nd, 2024
- Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability... - April 2nd, 2024
- Dimensionality reduction for images of IoT using machine learning | Scientific Reports - Nature.com - April 2nd, 2024
- 3 Machine Learning Stocks That Could Be Multibaggers in the Making: March Edition - InvestorPlace - April 2nd, 2024
- Researchers use machine learning to improve the taste of Belgian beers Physics World - physicsworld.com - April 2nd, 2024
- PM Modi Emphasizes The Importance Of Incorporating AI & Machine Learning To Enhance Digital Infra - Business Today - April 2nd, 2024
- Accurate and rapid antibiotic susceptibility testing using a machine learning-assisted nanomotion technology platform - Nature.com - March 21st, 2024
- Machine Learning Accelerates the Simulation of Dynamical Fields - Eos - March 21st, 2024
- Quantum Machine Learning: Exploring the Intersection of New Frontiers - DataScientest - March 21st, 2024
- Advancements in Pancreatic Cancer Detection: Integrating Biomarkers, Imaging Technologies, and Machine Learning ... - Cureus - March 21st, 2024
- Google Health Researchers Propose HEAL: A Methodology to Quantitatively Assess whether Machine Learning-based Health Technologies Perform Equitably -... - March 21st, 2024
- A change in the machine learning landscape - InfoWorld - March 21st, 2024
- Informing immunotherapy with multi-omics driven machine learning | npj Digital Medicine - Nature.com - March 21st, 2024
- Crypto Entities That Neglect AI and Machine Learning Investment Will Lag Behind, Warns Binance CTO Bitcoin News - Bitcoin.com News - March 21st, 2024
- MIT Researchers Developed an Image Dataset that Allows Them to Simulate Peripheral Vision in Machine Learning Models - MarkTechPost - March 21st, 2024
- BurstAttention: A Groundbreaking Machine Learning Framework that Transforms Efficiency in Large Language Models with Advanced Distributed Attention... - March 21st, 2024
- A machine learning system to identify progress level of dry rot disease in potato tuber based on digital thermal image ... - Nature.com - January 24th, 2024
- Mind the Gap Machine Learning, Dataset Shift, and History in the Age of Clinical Algorithms | NEJM - nejm.org - January 24th, 2024
- Cracking the Business Code of Clusters Machine Learning Times - The Machine Learning Times - January 24th, 2024
- Machine-learning-based models found to have predictive abilities no better than chance in out-of-sample evaluations - 2 Minute Medicine - January 24th, 2024
- Hybrid machine learning method boosts resolution of electrical impedance tomography - Tech Xplore - January 24th, 2024
- Cow moos and burps to be monitored using machine learning - FoodNavigator.com - January 24th, 2024
- Enhancing foveal avascular zone analysis for Alzheimer's diagnosis with AI segmentation and machine learning using ... - Nature.com - January 24th, 2024
- How to Use AI and Machine Learning for Academic Research - Innovation & Tech Today - January 24th, 2024
- Smart Use of Machine Learning Algorithms: Beyond the Hype, Into Real-World Solutions - Medium - January 24th, 2024
- How A.I./Machine Learning Is Boosting the Diversity of U.S. Med Students and Americas Future Doctors - Higher Education Digest - January 24th, 2024
- Weekly AiThority Roundup: Biggest Machine Learning, Robotic And Automation Updates - AiThority - January 24th, 2024
- How to Develop and Deploy Machine Learning Project in Python - Analytics Insight - January 24th, 2024
- Machine learning education | TensorFlow - January 7th, 2024
- How LinkedIn Uses Machine Learning to Address Content-Related Threats and Abuse - InfoQ.com - January 7th, 2024
- What is AI and Machine Learning? - GovernmentCIO Media & Research - January 7th, 2024
- Overview: Machine Learning Specialization by Andrew Ng (Course 1) - Medium - January 7th, 2024
- Study uses new tools, machine learning to investigate major cause of blindness in older adults - Medical Xpress - January 7th, 2024
- Leveraging AI and Machine Learning on AWS | by Be | Jan, 2024 - Medium - January 7th, 2024
- The Future at the Intersection of AI, Machine Learning, and Data Science - Medriva - January 7th, 2024
- Navigating the AI Landscape: From Machine Learning Foundations to Multimodal Advancements - Medium - January 7th, 2024
- Brake Noise And Machine Learning (3 of 4) - The BRAKE Report - January 7th, 2024
- 'Local' machine learning promises to cut the cost of AI development in 2024 - ITPro - January 7th, 2024
- Voice Recognition with Machine Learning on Arduino Nano 33 BLE Sense - Medium - January 7th, 2024
- This Paper from MIT and Microsoft Introduces LASER: A Novel Machine Learning Approach that can Simultaneously Enhance an LLMs Task Performance and... - January 7th, 2024
- How to Choose the Right Advanced Certification Program in AI & Machine Learning - TechGraph - January 7th, 2024
- What Is Machine Learning? | A Beginner's Guide - Scribbr - November 17th, 2023
- AI vs. Machine Learning vs. Deep Learning vs. Neural Networks ... - IBM - January 30th, 2023
- The Latest Google Research Shows how a Machine Learning ML Model that Provides a Weak Hint can Significantly Improve the Performance of an Algorithm... - January 30th, 2023
- What Is Machine Learning and Why Is It Important? - January 22nd, 2023
- Achieving Next-Level Value From AI By Focusing On The Operational Side Of Machine Learning - Forbes - January 22nd, 2023
- UCLA Researcher Develops a Python Library Called ClimateLearn for Accessing State-of-the-Art Climate Data and Machine Learning Models in a... - January 22nd, 2023
- Alto Neuroscience Presents New Data Leveraging EEG and Machine Learning to Predict Individual Response to Antidepressants at the 61st Annual Meeting... - December 12th, 2022
- Apple has released a Set of Optimizations that allow the Stable Diffusion AI Image Generator to be used on Apple Silicon, making use of Core ML,... - December 12th, 2022
- Genomic Testing Cooperative to Present Data at the American Society of Hematology Meeting on New Applications of its Proprietary Tests that Combine... - December 12th, 2022
- Astronomers at Caltech Have Used a Machine Learning Algorithm to Classify 1,000 Supernovae Completely Autonomously - MarkTechPost - December 4th, 2022
- Deep Learning | NVIDIA Developer - November 25th, 2022
- Check Out This Tool That Uses Machine Learning To Animate 3D Models In Real-Time And Will Soon Be Compatible With Unreal Engine - MarkTechPost - November 17th, 2022
- The NFT World is Evolving, and That's No Secret. Machine Learning and Algorithmic Tools ... - Latest Tweet - LatestLY - October 23rd, 2022
- Its Not Just About Accuracy - Five More things to Consider for a Machine Learning Model - AZoM - October 15th, 2022
- Machine learning operations offer agility, spur innovation - MIT Technology Review - October 15th, 2022
- Machine learning to predict the development of recurrent urinary tract infection related to single uropathogen, Escherichia coli | Scientific Reports... - October 15th, 2022
- The more data, the more deep learning capacity - Innovation Origins - October 15th, 2022
- Outlook on the Machine Learning in Life Sciences Global Market to 2027 - Featuring Alteryx, Anaconda, Canon Medical Systems and Imagen Technologies... - October 15th, 2022
- Forensic Discovery Taps Reveal-Brainspace to Bolster its Analytics, AI and Machine Learning Capabilities - Business Wire - October 15th, 2022
- Long-term exposure to particulate matter was associated with increased dementia risk using both traditional approaches and novel machine learning... - October 15th, 2022
- Machine Learning | Google Developers - October 7th, 2022
- Machine Learning in Oracle Database | Oracle - October 7th, 2022
- Learning on the edge | MIT News | Massachusetts Institute of Technology - MIT News - October 7th, 2022
- Study: Few randomized clinical trials have been conducted for healthcare machine learning tools - Mobihealth News - October 7th, 2022
- The Worldwide Industry for Machine Learning in the Life Sciences is Expected to Reach $20.7 Billion by 2027 - ResearchAndMarkets.com - Business Wire - October 7th, 2022
- Dominos MLops release focuses on GPUs and deep learning, offers multicloud preview - VentureBeat - October 7th, 2022
- MLOps Company Iterative Sees Steady Growth in First Half of 2022 - Business Wire - October 7th, 2022
- Machine learning tool could help people in rough situations make sure their water is good to drink - ZME Science - October 7th, 2022
- Developing Machine-Learning Apps on the Raspberry Pi Pico - Design News - October 7th, 2022
- Arctoris welcomes on board globally recognized experts in Machine Learning, Chemical Computation, and Alzheimer's Disease - Business Wire - October 7th, 2022
- Machine vision breakthrough: This device can see 'millions of colors' - Northeastern University - October 7th, 2022
- RBI plans to extensively use artificial intelligence, machine learning to improve regulatory supervision - ETCIO - October 7th, 2022
- Artificial intelligence may improve suicide prevention in the future - EurekAlert - October 7th, 2022
- Google turns to machine learning to advance translation of text out in the real world - TechCrunch - September 29th, 2022
- Machine learning has predicted the winners of the Worlds - CyclingTips - September 29th, 2022
- Peking University released the first open-source dataset for machine learning applications in fast chip design - EurekAlert - September 29th, 2022
- Predicting the effects of winter water warming in artificial lakes on zooplankton and its environment using combined machine learning models |... - September 29th, 2022