How to know when AI is the right solution – ARNnet

Artificial intelligence (AI) adoption is on the rise. According to a recent McKinsey survey, 55 per cent of companies use artificial intelligence in at least one function, and 27 per cent attribute at least 5 per cent of earnings before interest and taxes to AI, much of that in the form of cost savings.

As AI will dramatically transform nearly every industry it touches, its no surprise that vendors and enterprises are looking for opportunities to deploy AI everywhere they can. But not every project can benefit from AI and attempting to apply AI inappropriately can not only cost time and money but also sour employees, customers, and corporate leaders on future AI projects.

The key factors for determining whether a project is suitable for AI are business value, availability of training data, and cultural readiness for change. Heres a look at how to ensure those criteria are in line for your proposed AI project before your foray into artificial intelligence becomes a sunk cost.

Data scientists in particular gravitate toward an AI-first approach, says Zack Fragoso, data science and AI manager at pizza chain Dominos, which has more than 18,000 locations in over 90 countries around the world. But you cant apply AI everywhere.

Despite being a very traditional line of business, Dominos has been embracing change especially during the pandemic. Customers now have 13 digital ways to order pizzas, and the company generated more than 70 per cent of sales through digital ordering channels in 2020. That has opened up a lot of opportunity for making good on the promise of AI.

The key for Dominos in applying AI, Fragoso says, has been taking a simple approach. At the end of the day, the simple solution runs faster, performs better, and we can explain it to our business partners, he says. Explainability is a big part of it the more people understand the tools and methods we use, the easier it is to gain adoption.

The approach itself is simple: If theres a business problem that needs solving, Dominos looks at the simplest, most traditional solution, and then, if we go up from there, there needs to be a value-add in the performance of the model, Fragoso says.

For example, predicting how long it takes to cook a pizza and put it in a box is simple. We pull that right from our operations research. You can plug in the oven times, he says. But there are some problems that can only be solved with AI, he adds, such as those requiring image recognition or natural language processing.

For example, last year, Dominos ran a loyalty program that rewarded customers for eating pizza any pizza, from any pizza maker. We built a pizza classifier using millions of pictures of different kinds of pizza and put it into an app, Fragoso says.

That project offered two types of business value. First, it enhanced the customer experience, he says. Second, it created a collection of pizza images that the company then used to detect pizza quality and temperature. It was a really great full-circle AI project, he says.

A more practical AI project Dominos undertook was a predictor aimed at improving the accuracy of its pizza tracker, as customers want to know when exactly to come to the store to pick up their food, or when to expect their delivery to arrive, Fragoso says. Adding machine learning to the traditional if-then coding of Dominos pizza tracker resulted in a 100 per cent increase in accuracy, he says.

In building the model, Dominos stuck with its simplest-first principle. The first iteration was a simple regression model, he says. That got us close. Then a decision tree model, where we could look at more facets. Then we actually moved to a neural net because we could capture some of the same variables as in the decision tree but the neural net produces the answer faster. We want our customer experience on the website to be really fast.

There is a place for machine learning, says Sanjay Srivastava, chief digital officer at Genpact, particularly when a company is looking to build processes that are continually improving based on experience. But sometimes all thats needed is a simple correlation, which can be obtained from basic statistical modeling.

Ten-year-old practices around random forests and other statistical tool kits can get you the answer much faster and much cheaper than building a whole MLOps team around it, Srivastava says. You have to know when to fall back to existing techniques that are much simpler and much more effective.

One common area in which AI is often pitched a solution but is usually overkill is in chatbots, he says: In some scenarios, it makes sense. But in 90 per cent of scenarios you know the questions that are going to be asked because you can look at the questions that have been asked in the last three years and you know the answer to every question. Turns out, 90 per cent of chatbots can get away with simple question-and-answer pairs.

Any finite set of data can be fitted to a curve. For example, you can take previous years winning lottery numbers, and come up with a model that would have predicted them all perfectly. But the model will still be no better at predicting future winnings because the underlying mechanism is completely random.

The COVID-19 pandemic has been a prime example of how this happens in real life. There was no way to predict where lockdowns were going to lead to factory shutdowns, for example. As a result, companies saw a decline in the revenue gains they saw in many areas, according to McKinseys state of AI survey.

For example, 73 per cent of respondents saw revenue increases in strategy and corporate finance last year, while only 67 per cent did so this year. The difference was even more stark in supply chain management. Last year, 72 per cent saw revenue increases in this area but only 54 per cent did this year.

The fundamental characteristic of AI or machine learning is that youre using history to inform, says Donncha Carroll, partner in the revenue growth practice at Axiom Consulting Partners. You are wedded, chained, handcuffed by history. AI is good in circumstances where history is likely to repeat itself and youre okay with history repeating itself.

For example, he says, some of his clients have tried to use AI to predict future revenue. But often, revenue is influenced by factors that cant be predicted, that cant be controlled, and that the company doesnt have any data for. And if some of those factors have an outside impact on results, it can throw off the entire model.

Then it makes no sense to choose AI, he says. Are you going to invest hundreds of thousands of dollars in a solution that can be immediately made irrelevant by a change in one variable?

AI can still have a role here, he says, in helping to model various scenarios, or in surfacing insights that might not be otherwise apparent. Your likelihood of success goes up if your focus is more narrow.

AI will also fall short if the very presence of the AI changes the behavior of the system. For example, if AI is used to filter out hateful speech, people quickly learn what patterns the AI looks for and word things so that they get through the filters.

The best minds in the world have been trying to solve these problems and they have not been successful, Carroll says.

Kearney partner Bharath Thota once worked with a US$30-billion-plus global consumer products and goods conglomerate. The CFO leadership team wanted better visibility into the conglomerates financial metrics so they could see whether their growth was going up and down. The existing process was that they got PDFs of reports 30 days after the reporting period closed.

The data science team applied AI to forecast what the numbers would look like. They had good intent, says Thota. They wanted to provide the leadership with a futuristic view.

The mistake they made was in the financial data they were feeding into the algorithm. The financial analysts feeding in that data had to make a lot of assumptions, and so the data set wound up containing lots of individual biases.

The leadership was excited, says Thota. They had something forward-facing, not rearview-facing. But when the quarter ended, and they looked back at those predictions, they were completely off.

The entire project took months, says Thota. They had to figure out how to build this thing, do the architecture, research AI platforms, get everything to work together.

When a project like that fails, people lose interest and confidence in AI, he says. For this particular company, the solution was simply to build the CFO leadership team a financial dashboard that gave them the metrics they needed, when they needed them.

Eventually, Thota says, some AI was used as well, in the form of natural language generation, to automatically provide key insights into the data to the executives in plain-English terms.

It was a visibility problem, he says. And there was a simple solution to provide that visibility.

Read more on the next page...

Error: Please check your email address.

See more here:

How to know when AI is the right solution - ARNnet