Machine Learning on the Edge, Hold the Code

(Dmitriy Rybin/Shutterstock)

Many companies are scrambling to find machine learning engineers who can build smart applications that run on edge devices, like mobile phones. One company thats attacking the problem in a broad way is Qeexo, which sells an AutoML platform for building and deploying ML applications to microcontrollers without writing a line of code.

Qeexo emerged from Carnegie Mellon University in 2012, just at the dawn of the big data age. According to Sang Won Lee, the companys co-founder and CEO, the original plan called for Qeexo to be a machine learning application company.

The company landed a big fish, the Chinese mobile phone manufacturer Huawei, right out the gate. Huawei liked the ML-based finger-gesture application that Qeexo (pronounced Key-tzo) developed, and the company wanted Qeexo to ensure that it could run across all of its phone lines. That was a good news-bad news situation, Lee says.

Our first commercial implementation with Huawei kept the whole company in China for two months, to finish one model with one hardware variant, Lee tells Datanami. We came back and it was difficult to keep the morale high for our ML engineers because nobody wanted to constantly go abroad to do this type of repetitive implementation.

Qeexos AutoML solution handles many aspects of ML model development and deployment for customers

It quickly dawned on Lee that, with more ML models and more hardware types, the amount of manual work would quickly get out of hand. That led him to the idea of developing an automated machine learning, or AutoML, platform that could automatically generate ML models based on the data presented to it, automatically flash it to a group of pre-selected microcontrollers.

Lee and his team of developers, which is led by CTO and co-founder Chris Harrison (who is an assistant professor at Carnegie Mellon University), developed the offering nearly five years ago, and the company has been using it ever since for its own ML services engagements.

Huawei continues to utilize Qeexos AutoML solution to generate ML applications for its handsets. In 2018, we completed 57 projects for Hauwei, and most of the projects were completed by our field engineers just using the AutoML platform, without the help of ML engineers in the US, Lee says.

Sang Won Lee is the co-founder and CEO of Qeexo

In October 2019, Qeexo released its AutoML offering as a stand-alone software offering. The product automates many steps in the ML process, from building models from collected data, comparing performance of those models, and then deploying the finished model to a microcontroller all without requiring the user to write any code.

The offering has built-in support for the most popular ML algorithms, including random forest, gradient boosted machine, and linear regression, among others. Users can also select deep learning models, like convolutional neural networks, but many microcontrollers lack the memory to handle those libraries, Lee says.

Qeexos AutoML solution automatically handles many of the engineering tasks that would otherwise require the skills of a highly trained ML engineer, including feature selection and hyperparameter optimization. These feature are built into the Qeexo offering, which also sports a built-in C compiler and generates binary code that can be deployed to microcontrollers, such as those from Renasas Electronics.

Lee says ML engineers might be able to get a little more efficiency by developing their own ML libraries, but that it wont be worth the effort for many users. There are always more improvements that you can get with ML experts digging into it and doing the research, he says. But this is giving you the convenience of being able to build a commercially viable solution without having to write a single line of code.

Today Qeexo announced its new AWS solution. Instead of training a model on a laptop, customers can use now AWS resources to train their model. It also announced more ML algorithms, including deep learning algorithms and traditional algorithms. The visualization that Qeexo provides have also been enhanced to give the user the ability to better spot outliers and trends in data. Support for microphone data has been supported. And it also added support for the Renesas RA Family of Cortex-M MCUs, which are geared toward low-power IoT edge devices.

Having Huawei as a client certainly gives Qeexo some experience with scalability under its belt. But the Mountain View, California-based company is bullish on the potential for a new class of application developers to get started using its software to imbue everyday devices with the intelligence of data.

What we really want to tell the market is that even or those microcontrollers that are already out and that have very limited memory resource and processing power, you can still have a commercially viable ML solution running on it, if you use the right tool, Lee says. You dont want to neglect all the sensor data thats connected to the microcontroller. We can provide a tool that you can use to build intelligence that can be embedded into those tools.