Youre at the wheel of your car but youre exhausted. Your shoulders start to sag, your neck begins to droop, your eyelids slide down. As your head pitches forward, you swerve off the road and speed through a field, crashing into a tree.
But what if your cars monitoring system recognised the tell-tale signs of drowsiness and prompted you to pull off the road and park instead? The European Commission has legislated that from this year, new vehicles be fitted with systems to catch distracted and sleepy drivers to help avert accidents. Now a number of startups are training artificial intelligence systems to recognise the giveaways in our facial expressions and body language.
These companies are taking a novel approach for the field of AI. Instead of filming thousands of real-life drivers falling asleep and feeding that information into a deep-learning model to learn the signs of drowsiness, theyre creating millions of fake human avatars to re-enact the sleepy signals.
Big data defines the field of AI for a reason. To train deep learning algorithms accurately, the models need to have a multitude of data points. That creates problems for a task such as recognising a person falling asleep at the wheel, which would be difficult and time-consuming to film happening in thousands of cars. Instead, companies have begun building virtual datasets.
Synthesis AI and Datagen are two companies using full-body 3D scans, including detailed face scans, and motion data captured by sensors placed all over the body, to gather raw data from real people. This data is fed through algorithms that tweak various dimensions many times over to create millions of 3D representations of humans, resembling characters in a video game, engaging in different behaviours across a variety of simulations.
In the case of someone falling asleep at the wheel, they might film a human performer falling asleep and combine it with motion capture, 3D animations and other techniques used to create video games and animated movies, to build the desired simulation. You can map [the target behaviour] across thousands of different body types, different angles, different lighting, and add variability into the movement as well, says Yashar Behzadi, CEO of Synthesis AI.
Using synthetic data cuts out a lot of the messiness of the more traditional way to train deep learning algorithms. Typically, companies would have to amass a vast collection of real-life footage and low-paid workers would painstakingly label each of the clips. These would be fed into the model, which would learn how to recognise the behaviours.
The big sell for the synthetic data approach is that its quicker and cheaper by a wide margin. But these companies also claim it can help tackle the bias that creates a huge headache for AI developers. Its well documented that some AI facial recognition software is poor at recognising and correctly identifying particular demographic groups. This tends to be because these groups are underrepresented in the training data, meaning the software is more likely to misidentify these people.
Niharika Jain, a software engineer and expert in gender and racial bias in generative machine learning, highlights the notorious example of Nikon Coolpixs blink detection feature, which, because the training data included a majority of white faces, disproportionately judged Asian faces to be blinking. A good driver-monitoring system must avoid misidentifying members of a certain demographic as asleep more often than others, she says.
The typical response to this problem is to gather more data from the underrepresented groups in real-life settings. But companies such as Datagen say this is no longer necessary. The company can simply create more faces from the underrepresented groups, meaning theyll make up a bigger proportion of the final dataset. Real 3D face scan data from thousands of people is whipped up into millions of AI composites. Theres no bias baked into the data; you have full control of the age, gender and ethnicity of the people that youre generating, says Gil Elbaz, co-founder of Datagen. The creepy faces that emerge dont look like real people, but the company claims that theyre similar enough to teach AI systems how to respond to real people in similar scenarios.
There is, however, some debate over whether synthetic data can really eliminate bias. Bernease Herman, a data scientist at the University of Washington eScience Institute, says that although synthetic data can improve the robustness of facial recognition models on underrepresented groups, she does not believe that synthetic data alone can close the gap between the performance on those groups and others. Although the companies sometimes publish academic papers showcasing how their algorithms work, the algorithms themselves are proprietary, so researchers cannot independently evaluate them.
In areas such as virtual reality, as well as robotics, where 3D mapping is important, synthetic data companies argue it could actually be preferable to train AI on simulations, especially as 3D modelling, visual effects and gaming technologies improve. Its only a matter of time until you can create these virtual worlds and train your systems completely in a simulation, says Behzadi.
This kind of thinking is gaining ground in the autonomous vehicle industry, where synthetic data is becoming instrumental in teaching self-driving vehicles AI how to navigate the road. The traditional approach filming hours of driving footage and feeding this into a deep learning model was enough to get cars relatively good at navigating roads. But the issue vexing the industry is how to get cars to reliably handle what are known as edge cases events that are rare enough that they dont appear much in millions of hours of training data. For example, a child or dog running into the road, complicated roadworks or even some traffic cones placed in an unexpected position, which was enough to stump a driverless Waymo vehicle in Arizona in 2021.
With synthetic data, companies can create endless variations of scenarios in virtual worlds that rarely happen in the real world. Instead of waiting millions more miles to accumulate more examples, they can artificially generate as many examples as they need of the edge case for training and testing, says Phil Koopman, associate professor in electrical and computer engineering at Carnegie Mellon University.
AV companies such as Waymo, Cruise and Wayve are increasingly relying on real-life data combined with simulated driving in virtual worlds. Waymo has created a simulated world using AI and sensor data collected from its self-driving vehicles, complete with artificial raindrops and solar glare. It uses this to train vehicles on normal driving situations, as well as the trickier edge cases. In 2021, Waymo told the Verge that it had simulated 15bn miles of driving, versus a mere 20m miles of real driving.
An added benefit to testing autonomous vehicles out in virtual worlds first is minimising the chance of very real accidents. A large reason self-driving is at the forefront of a lot of the synthetic data stuff is fault tolerance, says Herman. A self-driving car making a mistake 1% of the time, or even 0.01% of the time, is probably too much.
In 2017, Volvos self-driving technology, which had been taught how to respond to large North American animals such as deer, was baffled when encountering kangaroos for the first time in Australia. If a simulator doesnt know about kangaroos, no amount of simulation will create one until it is seen in testing and designers figure out how to add it, says Koopman. For Aaron Roth, professor of computer and cognitive science at the University of Pennsylvania, the challenge will be to create synthetic data that is indistinguishable from real data. He thinks it is plausible that were at that point for face data, as computers can now generate photorealistic images of faces. But for a lot of other things, which may or may not include kangaroos I dont think that were there yet.
More:
Is fake data the real deal when training algorithms? - The Guardian
- What is Artificial Intelligence (AI)? - Definition from ... [Last Updated On: June 12th, 2016] [Originally Added On: June 12th, 2016]
- Artificial Intelligence | Neuro AI [Last Updated On: June 12th, 2016] [Originally Added On: June 12th, 2016]
- Association for the Advancement of Artificial Intelligence [Last Updated On: June 13th, 2016] [Originally Added On: June 13th, 2016]
- A.I. Artificial Intelligence - Wikipedia, the free ... [Last Updated On: June 17th, 2016] [Originally Added On: June 17th, 2016]
- Artificial Intelligence - The New York Times [Last Updated On: June 17th, 2016] [Originally Added On: June 17th, 2016]
- Intro to Artificial Intelligence Course and Training ... [Last Updated On: June 28th, 2016] [Originally Added On: June 28th, 2016]
- Artificial Intelligence | Neuro AI [Last Updated On: July 1st, 2016] [Originally Added On: July 1st, 2016]
- What is Artificial Intelligence (AI)? Webopedia Definition [Last Updated On: July 1st, 2016] [Originally Added On: July 1st, 2016]
- Intro to Artificial Intelligence Course and Training Online ... [Last Updated On: July 5th, 2016] [Originally Added On: July 5th, 2016]
- Artificial Intelligence News -- ScienceDaily [Last Updated On: September 16th, 2016] [Originally Added On: September 16th, 2016]
- Artificial intelligence positioned to be a game-changer - CBS ... [Last Updated On: October 13th, 2016] [Originally Added On: October 13th, 2016]
- Artificial Intelligence: A Modern Approach - amazon.com [Last Updated On: October 31st, 2016] [Originally Added On: October 31st, 2016]
- Artificial Intelligence - IndiaBIX [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- The Non-Technical Guide to Machine Learning & Artificial ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence - Graduate Schools of Science ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence in Medicine: An Introduction [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- What does artificial intelligence mean? - Definitions.net [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence Lockheed Martin [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence Course - Computer Science at CCSU [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- FREE Artificial Intelligence Essay - Example Essays [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Elon Musk's artificial intelligence group signs Microsoft ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Real FX - Slotless Racing with Artificial Intelligence [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence: What It Is and How It Really Works [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Artificial Intelligence Market Size and Forecast by 2024 [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Algorithm-Driven Design: How Artificial Intelligence Is ... [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- 9 Development in Artificial Intelligence | Funding a ... [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Artificial Intelligence Tops Humans in Poker Battle What's the Big Deal? - PokerNews.com [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Is AI a Threat to Christianity? - The Atlantic [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Allow mathematicians to pierce artificial intelligence frontiers - Livemint [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Montreal sees its future in smart sensors, artificial intelligence (with video) - Computerworld [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Silicon Valley Hedge Fund Takes On Wall Street With AI Trader - Bloomberg [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- The Observer view on artificial intelligence - The Guardian [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Artificial Intelligence Is Coming Whether You Like It Or Not - Mother Jones [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- RealDoll Creating Artificial Intelligence System, Robotic Sex Dolls ... - Breitbart News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Forget lessons, these smart skis are loaded with artificial intelligence - Mashable [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial Intelligence Correctly Predicted the Patriots' 34-28 Super ... - Digital Trends [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Why C-Levels Need To Think About eLearning And Artificial Intelligence - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial Intelligence-Driven Robots: More Brains Than Brawn - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial intelligence: How to build the business case - ZDNet [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- What 'social artificial intelligence' means for marketers - VentureBeat [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Actress Kristen Stewart's Research Paper On Artificial Intelligence: A Critical Evaluation - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Baidu cut its healthcare business to concentrate on artificial intelligence - Asia Times [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Google Android Wear 2.0 update puts artificial intelligence inside your wristwatch - The Sun [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- How criminals use Artificial Intelligence and Machine Learning - BetaNews [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- In the Labs: Connected vehicles in Ohio, artificial intelligence in Illinois and Massachusetts - Network World [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Keeping an eye on artificial intelligence - The National Business Review [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Actors, teachers, therapists think your job is safe from artificial intelligence? Think again - The Guardian [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Wells Fargo Innovation Group to Focus on Artificial Intelligence, Payments and APIs - Wall Street Journal (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- SAP aims to step up its artificial intelligence, machine learning game as S/4HANA hits public cloud - ZDNet [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Artificial Intelligence Is Coming To Police Bodycams, Raising Privacy Concerns - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Nvidia Beats Earnings Estimates As Its Artificial Intelligence Business Keeps On Booming - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Could Artificial Intelligence Ever Become A Threat To Humanity? - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Artificial intuition will supersede artificial intelligence, experts say - Network World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- The Peril of Inaction with Artificial Intelligence - Gigaom [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- TASER International Bringing Artificial Intelligence to Law Enforcement - Motley Fool [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- LG G6 teasers emphasize battery life, artificial intelligence - CNET [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Wells Fargo sets up artificial intelligence team in tech push - Reuters [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Ford spending $1 billion on self-driving artificial intelligence - CNET [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Artificial Intelligence in Business Process Automation - Nanalyze [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- An artificial intelligence gamble that paid off - Minneapolis Star Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford to Invest $1 Billion in Artificial Intelligence Start-Up - New York Times [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Wells Fargo Pushes Into Artificial Intelligence - Fortune [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Artificial intelligence predictions surpass reality - UT The Daily Texan [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Creating artificial intelligence-driven technology products is almost like unleashing the Frankenstein's monster - Economic Times (blog) [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Inside Intel Corporation's Artificial Intelligence Strategy - Motley Fool [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- The artificial intelligence revolutionising healthcare - Irish Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Ford Announces Investment in Artificial Intelligence Company Argo AI - Motor Trend [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Ford Invests $1-Billion in Artificial Intelligence - AutoGuide.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Salesforce adds some artificial intelligence to customer service products - TechCrunch [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- No hype, just fact: Artificial intelligence in simple business terms - ZDNet [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence and The Confusion of Our Age - Patheos (blog) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- How Artificial Intelligence Startups Struck Gold - Entrepreneur [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Terrifyingly, Google's Artificial Intelligence acts aggressive when cornered - Chron.com [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- This Startup Has Developed A New Artificial Intelligence That Can (Sometimes) Beat Google - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- RPI artificial intelligence expert looks at Westworld - Albany Times Union [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Google's DeepMind artificial intelligence becomes 'highly aggressive' when stressed. Skynet, anyone? - Mirror.co.uk [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence Enters The Classroom - News One [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- John Pisarek Talks Artificial Intelligence - Customer Think [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Can Artificial Intelligence Predict Earthquakes? - Scientific American [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence Is Becoming A Major Disruptive Force In Banks' Finance Departments - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]