Games, Teams, and Moonshots: Google Cloud’s Will Grannis – MIT Sloan – MIT Sloan

Topics Artificial Intelligence and Business Strategy

The Artificial Intelligence and Business Strategy initiative explores the growing use of artificial intelligence in the business landscape. The exploration looks specifically at how AI is affecting the development and execution of strategy in organizations.

Get updates by email

Please enter a valid email address

Thank you for signing up

Privacy Policy

Will Grannis discovered his love for technology playing Tron and Oregon Trail as a child. After attending West Point and The Wharton School at the University of Pennsylvania, he translated his passion for game theory into an aptitude for solving problems for companies, a central component of his role as founder and leader of the Office of the CTO at Google Cloud. Will leads a team of customer-facing technology leaders who, while tasked with bringing machine learning solutions to market, approach their projects with a user-first mindset, ensuring that they first identify the problem to be solved.

Will Grannis is the founder and leader of Google Clouds CTO Office, a team of senior engineers whose mission is to foster collaborative innovation between Google and its largest customers. Prior to joining Google in 2015, Grannis spent the last two decades as an entrepreneur, enterprise technology executive, and investor, building and scaling technical platforms that today power commerce, transportation, and the public sector. Hes been a developer, product manager, CTO, SVP of Engineering, and CEO, building a wide variety of platforms and teams along the way.

Your reviews are essential to the success of Me, Myself, and AI. For a limited time, were offering a free download of MIT SMRs best articles on artificial intelligence to listeners who review the show. Send a screenshot of your review to smrfeedback@mit.edu to receive the download.

In Season 2, Episode 2, of Me, Myself, and AI, Will makes it clear that great ideas dont only come from the obvious subject-area experts in the room; diverse perspectives, coupled with a codified approach to innovation, lead to the best ideas. The collaboration principles and processes Google Cloud relies on can be applied at other organizations across industries.

Read more about our show and follow along with the series at https://sloanreview.mit.edu/aipodcast.

Subscribe to Me, Myself, and AI on Apple Podcasts, Spotify, or Google Podcasts.

Shervin Khodabandeh: Can you get to the moon without first getting to your own roof? This will be the topic of our conversation with Will Grannis, Google Cloud CTO.

Sam Ransbotham: Welcome to Me, Myself, and AI, a podcast on artificial intelligence in business. Each episode, we introduce you to someone innovating with AI. Im Sam Ransbotham, professor of information systems at Boston College. Im also the guest editor for the AI and Business Strategy Big Ideas program at MIT Sloan Management Review.

Shervin Khodabandeh: And Im Shervin Khodabandeh, senior partner with BCG, and I colead BCGs AI practice in North America. Together, MIT SMR and BCG have been researching AI for five years, interviewing hundreds of practitioners and surveying thousands of companies on what it takes to build and to deploy and scale AI capabilities and really transform the way organizations operate.

Sam Ransbotham: Were talking with Will Grannis today; hes the founder and leader of the Office of the CTO at Google Cloud. Thank you for joining us today, Will.

Will Grannis: Great to be here. Thanks for having me.

Sam Ransbotham: So its quite a difference between being at Google Cloud and your background. Can you tell us a little bit about how you ended up where you are?

Will Grannis: Call it maybe a mix of formal education and informal education. Formally, Arizona public school system and then, later on, West Point math and engineering undergrad. And then, later on, UPenn University of Pennsylvania, Wharton for my MBA. Now, maybe the more interesting part is the informal education, and this started in the third grade, and back then, I think it was gaming that originally spiked my curiosity in technology, and so this was Pong, Oregon Trail in television, Nintendo all the gaming platforms. I was just fascinated that you could turn a disk on a handset and you could see Tron move around on a screen; that was like the coolest thing ever.

And so todays manifestation Khan Academy, edX, Codecademy, platforms like that you have this entire online catalog of knowledge, thanks to my current employer, Google. And just as an example, this week Im porting some machine learning code to a microcontroller and brushing up on my C thanks to these what I call informal education platforms. So [its] a journey that started with formal education but was really accelerated by others, by curiosity, and by these informal platforms where I could go explore the things I was really interested in.

Sam Ransbotham: I think, particularly with artificial intelligence, were so focused about games and whether or not the machines beat a human at this game or that game, when there seems to be such difference between games and business scenarios. So how can we make that connection? How can we move from what we can learn from games to what businesses can learn from artificial intelligence?

Will Grannis: Gaming is exciting and it is interesting, but lets take a foundational element of games: understanding the environment that youre in and defining the problem you want to solve whats the objective function, if you will. That is exactly the same question that every manufacturer, every retailer, every financial services organization asks themselves when theyre first starting to apply machine learning. And so in games, the objective functions tend to be a little bit more fun it could be an adversarial game, where youre trying to win and beat others, but those underpinnings of how to win in a game actually are very, very relevant to how you design machine learning in the real world to maximize any other type of objective function that you have. So for example, in retail, if youre trying to decrease the friction of a consumers online experience, you actually have some objectives that youre trying to optimize, and thinking about it like a game is actually a useful construct at the beginning of problem definition: What is it that we really want to achieve? And Ill tell you that, being around AI machine learning now for a couple of decades when it was cool, when it wasnt cool I can tell you that the problem definition and really getting a rich sense of the problem youre trying to solve is absolutely the No. 1 most important criterion for being successful with AI and machine learning.

Shervin Khodabandeh: I think thats quite insightful, Will, and its probably a very good segue to my question. That is, it feels like in almost any sector, what we are seeing is that there are winners and losers in terms of getting impact from AI. There are a lot less winners than there are losers, and Im sure that many CEOs are looking at this wondering what is going on, and I deeply believe that a lot of it is what you said, which is it absolutely has to start with the problem definition and getting the perspective of business users and process owners and line managers into that problem definition, which should be critical. And since were talking about this, it would be interesting to get your views on what are some of the success factors from where youre sitting and where youre observing to get maximum impact from AI.

Will Grannis: Well, I cant speak to exactly why every company is successful or unsuccessful with AI, but I can give you a couple of principles that we try to apply and that I try to apply generally. I think today we hear and we see a lot about AI and the magic that it creates. And I think sometimes it does a disservice to people who are trying to implement it in production. Ill give you an example: Where did we start with AI at Google? Well, it was in a place where we already had really well-constructed data pipelines, where we had already exhausted the heuristics that we were using to determine performance, and instead we looked at machine learning as one option to improve our lift on advertising, for example.

And it was only because we already had all the foundational work done we understood how to curate, extract, transform, [and] load data; how to share it; how to think about what that data might yield in terms of outcomes; how to construct experiments, [the] design of experiments; and utilize that data effectively and efficiently that we were able to test the frontier of machine learning within our organization. And maybe, to your question, maybe one of the biggest opportunities for most organizations today, maybe it will be machine learning, but maybe today its actually in how they leverage data how they share, how they collaborate around data, how they enrich it, how they make it easy to share with groups that have high sophistication levels, like data scientists, but also analysts and business intelligence professionals who are trying to answer a difficult question in a short period of time for the head of a line of business. And unless you have that level of data sophistication, machine learning will probably be out of reach for the foreseeable future.

Shervin Khodabandeh: Yeah, Will, one other place I thought you might go is building on what you were saying earlier about the analog between gaming and business, all around problem definition how its important to get the problem definition right. And what resonated with me when you were saying that was, probably a lot of companies just dont know how to make that connection and dont know where to get started, which is actually, What is the actual problem that were trying to solve with AI? And many are focusing on, What are all the cool things AI can do, and whats all the data and technology we need? rather than actually starting with the problem definition and working their way backwards from the problem definition to the data and then how can AI help them solve that problem.

Will Grannis: Its really a mindset. Ill share a little inside scoop: At Google, we have an internal document that our engineers have written to help each other out with getting started on machine learning. And the No. 1 because theres a list of like 72 factors, things you need to do to be successful in machine learning and No. 1 is you dont need machine learning. And the reason why its stated so strongly is actually to get the mindset of uncovering the richness of the problem, and the nuances of that problem actually create all of the downstream to your point all of the downstream implementation decisions. So if you want to reduce friction in online checkout, that is a different problem than trying to optimize really great recommendations within someones e-commerce experience online for retail. Those are two very different problems, and you might approach them very differently; they might have completely different data sets, they might have completely different outcomes on your business. And so one of the things that weve done here at Google over time is weve tried to take our internal shorthand for innovation, [our] approach to innovation and creativity, and weve tried to codify it so that we can be consistent in how we execute projects, especially the ones that venture into the murkiness of the future.

And this framework, it really has three principles. And the first one, as you might expect, is to focus on the user, which is really a way of saying, Lets get after the problem the pain that they care the most about. The second step is to think 10x because we know [that] if its going to be worth the investment of all of these cross-functional teams time and to create the data pipelines, and to curate them, and to test for potential bias within these pipelines and within data sets, to build models and to test those models, thats a significant investment of time and expertise and attention, and so we want to make sure were solving for a problem that also has the scale that will be worth it and really advances whatever were trying to do not in a small way, but in a really big way. And then the third one is rapidly prototyping, and you cant get to the rapid prototyping unless youve thought through the problem, youve constructed your environment so that you can conduct these experiments rapidly. And sometimes well proxy outcomes just to see if wed care about them at all without running them at full production. So that framework, that focusing on the user, thinking 10x, and then rapid prototyping, is an approach that we use across Google, regardless of product domain.

Shervin Khodabandeh: Thats really insightful, especially the think 10x piece, which I think is really, really helpful. I really like that.

Sam Ransbotham: Youre lobbying, I think, for I would call it a very strong exploration mindset toward your approach to artificial intelligence, versus more of an incremental or Lets do what we have, better. Is that right for everybody? Do you think thats idiosyncratic to Google? Almost everyone listening today is not going to be working at Google. Is that something that you think works in all kinds of places? That may be beyond what you can speak to, but how well do you think that that works across all organizations?

Will Grannis: Well, I think theres a difference between a mindset and then the way that these principles manifest themselves. Machine learning, just in its nature, is exploration, right? Its approximations, and youre looking through the math, and youre looking for the places where youre pretty confident that things have changed significantly for the better or for the worse so that you can do your feature engineering and you can understand the impact of choices that youre making. And in a lot of ways, the mathematical exploration is an analog to the human exploration, in that we try to encourage people by the way, just because we have a great idea doesnt mean it gets funded at Google. Yes, we are a very large company, yes were doing pretty well, but most of our big breakthroughs have not come from some top-down-mandated gigantic project that everybody said was going to be successful.

Gmail was built by people who were told very early on that it would never succeed. And we find that this is a very common path and before Google, Ive been an entrepreneur a couple of times, my own company and somebody elses, and Ive worked in other large companies that had world-class engineering teams as well. And I can tell you this is a pattern, which is, just giving people just enough freedom to think about what the future could look like. We have a way of describing 10x at Google you may have heard, called moonshots. Well, our internal engineering team has also coined the term roof shots, because the moonshots are often accomplished by a series of these roof shots, and if people dont believe in the end state, the big transformation, theyre usually much less likely to journey across those roof shots and to keep going when things get hard. And we dont flood people with resources and help at the beginning because its this is hard for me to say as a senior executive leading technology innovation, but quite often, I dont have perfect knowledge of what will be the most impactful project that teams are working on. My job is to create an environment where people feel empowered, encouraged, and excited to try and [I] try to demotivate them as little as possible, because theyll find their way to the roof shot, and then the next one, and then the next one, and then pretty soon youre three years in, and I couldnt stop a project if I wanted to; its going to happen because of that spirit, that [Star Trek:] Voyager spirit.

Shervin Khodabandeh: Tell us a bit about your role at Google Cloud.

Will Grannis: I think I have the best job in the industry, which is I get to lead a collective of CTOs who have come from every industry and every geography and every place in the stack, from hardware engineering all the way up to SaaS, quantum security, and I get to lead this incredible team. And our mission is to create this bridge between our customers our top customers, and our top partners of Google, who are trying to do incredible things with technology and the people who are building these foundational platforms at Google, and to try to harmonize them. Because with the evolution of Google now, especially with our cloud business we have become a partner to many of the worlds top organizations.

And so, for example, if Major League Baseball wants to create a new immersive experience for you at home through a digital device or, eventually when we get back to it, into the stadiums, its not just us creating technology, surfacing it to them, them telling us what they like about it, and then sending it back, and then we spin it; its actually collaborative innovation. So we have these approaches to machine learning that we think could be pretty interesting: We have technologies in AR/VR [augmented reality and virtual reality], we have content delivery networks, we have all of these different platforms that we have at Google. And in this exploratory mode, we get together with these large customers and they help guide not only the features, but they help us think about what were going to build next. And then they layer on top of these foundational platforms the experience that they want as Major League Baseball [for] us as baseball fans. And that intertwined, collaborative technology development is at the heart, and that collaborative innovation thats at the heart of what we do here in the CTO group.

Shervin Khodabandeh: Thats a great example. Can you say a bit more about how you set strategy for projects like that?

Will Grannis: Im very, very bullish about having the CTO and the CIO at the top table in an organization, because the CIO often is involved in the technology that a company uses for itself, for its own innovation. And Ive often found that the tools and the collaboration and the culture that you have internally manifests itself in the technology that you build for others. And so a CIOs perspective on how to collaborate the tools, how people are working together, how they could be working together is just as important as the CTOs view into what technology could be most impactful, most disruptive coming from the outside in, but you also want them sitting next to the CMO. You want them sitting next to the chief revenue officer, you want them with the CEO and the CFO. And the reason is because it creates a tension, right? I would never advocate that all of my ideas are great. Some of them are, but some of them [havent] panned out. And its really important that that unfiltered tension is created at the point at which corporate strategy is delivered. In fact, this is one of the things I learned a lot from working for a couple of CEOs, both outside of Google and here, is that its a shared responsibility: [Its] the responsibility of the CTO to put themselves in the room, to add that value, and its the responsibility of the CEO to pull it through the organization when the mode of operation may not be that way today.

Shervin Khodabandeh: Thats very true. And it corroborates our work, Sam, to a large extent that its not just about building the layers of tech; its about process change, its about strategy alignment, and also its about ultimately what humans have to do differently, and to work with AI collaboratively. Its also about how managers and midmanagers and the folks that are using AI to be more productive, to be more precise, to be more innovative, more imaginative in their day-to-day work. Can you comment a bit on that, in terms of how it could have changed the roles of individual employees lets say, in different roles, whether its in marketing or in pricing or customer servicing? Any thoughts or ideas on that?

Will Grannis: We had an exercise like this with a large retail customer, and it turned out that someone from outside of the organization the physical security and monitoring organization it turns out that one of the most disruptive and interesting and impactful framings of that problem came from someone who was in a product team, totally unrelated to this area, that just got invited to this workshop as a representative of their org. So we cant have everybody in every brainstorming session, despite the technology [that] allows us to put a lot of people in one place at one time, but choosing who is in those moments is absolutely critical. Just going to default roles or going to default responsibilities is one way to just keep the same information coming back again and again and again.

Sam Ransbotham: Thats certainly something were thinking about at a humanities-based university, that blend and that role of people. Its interesting to me that in all your examples, you talked about joining people, and people from cross-functional teams, [but] youve never mentioned a machine as one of these roles or a player. Is that too far-fetched? How are these combinations of humans going to add the combination of machine in here? Weve got a lot of learning from machines, and I think certainly at a task level, at what point does it get elevated to a more strategic level? Is that too far away?

Will Grannis: No, I dont think so, but [its] certainly in its early days. One of the ways you can see this manifest is [in] natural language processing, for example. I remember one project we had, we were training a chatbot, and it turned out we used raw logs all privacy assured and everything but we used these logs that a customer had provided because they wanted to see if we could build a better model. And it turns out that the chat agent wasnt exactly speaking the way wed want another human being to speak to us. And why? Because people get pretty upset when theyre talking to customer support, and the language that they use isnt necessarily language I think we would use with each other on this podcast. And so we do think that machines will be able to offer some interesting response inputs, generalized inputs at some point, but I can tell you right now, you want to be really careful about letting loose a natural language-enabled partner that is a machine inside of your creativity and innovation session, because you may not hear things that you like.

Sam Ransbotham: Well, it seems like theres a role here, too that I dont know, these machines. Theres going to be bias in these things. This is inevitable. And in some sense, Im often happy to see biased decisions coming out of these AI and ML systems, because then its at least surfaced. Weve got a lot of that unconsciously going on in our world right now, and if one of the things that were learning is that the machines are pointing out how ugly were talking to chatbots or how poorly were making other decisions, that may be a Step 1 to improving overall.

Will Grannis: Yeah. The responsible AI push, its never over; its one of those things. Ensuring those responsible and ethical practices requires a focus across the entire activity chain. And two areas that weve seen as really impactful are when you can focus on principles as an organization. So, what are the principles through which you will take your projects and shine the light on them and examine them and think about the ramifications? Because you cant a priori define all of the potential outputs that machine learning and AI may generate.

And thats where I refer to it as a journey, and Im not sure that there is a final destination. I think its one that is a constant and, in the theme of a lot of what we talked about today, its iterative. You think about how you want to approach it: You have principles, you have governance, and then you see what happens, and then you make the adjustments along the way. But not having that foundation means youre dealing with every single instance as its own unique instance, and that becomes untenable at scale, even small scale. This isnt just a Google-scale thing this is, any company that wants to distinguish itself with AI at any type of scale is going to bump into that.

Sam Ransbotham: Will, we really appreciate you taking the time to talk with us today. Its been fabulous. Weve learned so much.

Shervin Khodabandeh: Really, really an insightful and candid conversation. Really appreciate it.

Will Grannis: Oh, absolutely. My pleasure. Thanks for having me.

Shervin Khodabandeh: Sam, I thought that was a really good conversation. Weve been talking with Will Grannis, founder and leader of the Office of the CTO at Google Cloud.

Sam Ransbotham: Well, I think we may have lost some listeners saying that you dont need ML as item one on his checklist, but I think he had 71 other items on his checklist that do involve machine learning.

Shervin Khodabandeh: But I thought he was making a really important point: Dont get hung up on the technology and the feature functionality, and think about the business problem and the impact and shoot really, really big for the impact. And then also, dont think you have to achieve the moonshot in one jump, and that you could get there in progressive jumps, but you always have to keep your eye on the moon, which I think is really, really insightful.

Sam Ransbotham: Thats a great way of putting it, because I do think we got focused on thinking about the 10x, and we maybe paid less attention to his No. 1, which was the user focus and the problem.

Shervin Khodabandeh: The other thing I thought that is an important point is collaboration. I think its really an overused term, because in every organization, every team would say, Yes, yes, were completely collaborative; everybodys collaborating; theyre keeping each other informed. But I think the true meaning of what Will was talking about is beyond that. Theres multiple meanings to collaboration. You could say, As long as Im keeping people informed or sending them documents, then Im collaborating. But what he said is, Theres not a single person on my team that can succeed on his or her own, and thats a different kind of collaboration; it actually means youre so interlinked with the rest of your team that your own outcome and output depends on everybody elses work, so you cant succeed without them and they cant succeed without you. Its really beyond collaboration. Its like the team is an amalgam of all the people and theyre all embedded in each other as just one substance. Whats the chemical term for that?

Sam Ransbotham: Yeah, see, I knew you were going to make a chemical reference there. There you go: amalgam.

Shervin Khodabandeh: Amalgam or amalgam? I should know this as a chemical engineer.

Sam Ransbotham: Exactly. Were not going to be tested on this part of the program.

Shervin Khodabandeh: I hope my Caltech colleagues arent listening to this.

Sam Ransbotham: Yeah, actually, the collaboration thing. Its easy to espouse collaboration. If you think about it, nobody we interview is going to say, All right, you know, I really think people should not collaborate. I mean, just, no ones going to [say] that, but whats different about what he said is they have process around it. And they had, it sounded like, structure and incentives so that people were incentivized to align well.

Shervin Khodabandeh: I like the gaming analog the objective function in the game, whether its adversarial or youre trying to beat a course or unleash some hidden prize somewhere; that there is some kind of an optimization or simulation or approximation or correlation going on in these games, and so the analog of that to a business problem resting so heavily on the very definition of the objective function.

Sam Ransbotham: Yeah, I thought the twist that he said on games was important, because he did pull out immediately that we can think about these as games, but what have we learned from games? Weve learned from games that we need an objective, we need a structure, we need to define the problem. And he tied that really well into the transition from what we think of as super well-defined games of perfect information to unstructured. It still needs that problem definition. I thought that was a good switch.

Shervin Khodabandeh: Thats right.

Sam Ransbotham: Will brought out the importance of having good data for ML to work. He also highlighted how Google Cloud collaborates both internally and with external customers. Next time well talk with Amit Shah, president of 1-800-Flowers, about the unique collaboration challenges that it uses AI to address through its platform. Please join us next time.

Allison Ryder: Thanks for listening to Me, Myself, and AI. If youre enjoying the show, take a minute to write us a review. If you send us a screenshot, well send you a collection of MIT SMRs best articles on artificial intelligence, free for a limited time. Send your review screenshot to smrfeedback@mit.edu.

Sam Ransbotham (@ransbotham) is a professor in the information systems department at the Carroll School of Management at Boston College, as well as guest editor for MIT Sloan Management Reviews Artificial Intelligence and Business Strategy Big Ideas initiative. Shervin Khodabandeh is a senior partner and managing director at BCG and the coleader of BCG GAMMA (BCGs AI practice) in North America. He can be contacted at shervin@bcg.com.

Me, Myself, and AI is a collaborative podcast from MIT Sloan Management Review and Boston Consulting Group and is hosted by Sam Ransbotham and Shervin Khodabandeh. Our engineer is David Lishansky, and the coordinating producers are Allison Ryder and Sophie Rdinger.

Read more:

Games, Teams, and Moonshots: Google Cloud's Will Grannis - MIT Sloan - MIT Sloan