(A Lesson from IIT is a weekly column by an IIT faculty member on learning, science and technology on campus and beyond. The column will appear every Friday.)
Sutanu Chakraborty
The quest for building machines that think and act like us has propelled significant advances in Artificial Intelligence (AI). While we now have systems that do restricted tasks very well, the vision of Artificial General Intelligence (AGI), where machines can seamlessly learn and do anything that a human does, continues to elude us. But ChatGPT is around and it seems magical, right? Does it have AGI? Not quite.
For the uninitiated, ChatGPT is powered by technology that belongs to the family of Large Language Models (LLMs). A language model can tell us that a cat is sitting on the mat is better English than a cat is sitting in the mat. If given the last few words in a sentence, a language model can also predict which word is most likely to come next. You can think of a language model as a black box with a lot of numbers, called parameters. These parameters implicitly capture diverse aspects of language such as grammar, word usage and even world knowledge (I like noodles with sauce is more likely than I like noodles with pizza, for instance).
Any sentence that you type in at the ChatGPT prompt is converted into a set of numbers that interact with the parameters of the language model to finally yield another set of numbers, which are rendered as output text. Large Language Models have on the order billions of parameters that are learnt from really large volumes of data. An example is all of the textual content that can be scraped from the entire web.
As part of training ChatGPT, it was also ensured that the system learns from human feedback. As a consequence, it got rewards for doing its job very well and was punished otherwise. Consequently, the end result is impressive: this new tribe of AI technologies is undoubtedly disruptive in more ways than we could have imagined. ChatGPT excels at many jobs humans traditionally take pride in writing poems, code, online web content and so on. Do many of us then end up losing our jobs? Are such fears well founded?
First things first, LLMs, at their very core, are not as smart as they appear to be. Consider the case of two kindergarten kids arguing on whether the movie Titanic is romantic or tragic. Neither of them has experienced either tragedy or romance. The debate is literally a war of words, purely based on what they heard their parents talk about. As they grow up, they realise that both of those things were right after all Titanic is tragic and romantic at the same time. In a way not very different from the kindergarten kids, LLMs spits out words. However, the meanings of those are not grounded in experiences.
We must, therefore, not lose sight of the fact that LLMs lack a robust theory of the world. We should not be surprised if a six-year old beats ChatGPT in tasks that demand common-sense reasoning and basic logical inferencing. To quote the noted linguist Noam Chomsky, LLMs are incapable of distinguishing the possible from the impossible. Consequently, they have the propensity to fabricate things and generate factually incorrect or biased responses that are not meant for serious professional consumption.
In the context of software jobs, LLM models can write functions or boilerplate code given a well-defined goal, but may not be able to factor vaguely-specified high level business goals into components that need to be designed. They may also not be able to analyse how these components should interact, prescribe how best to leverage competencies of the existing workforce to get the whole job executed in a given timeframe, and suggest ways of recovering from aberrations in case plans do not get executed as expected.
Edsger Dijkstra, a stalwart in the field of computing, had famously observed that computer science should be called computing science for the same reason why surgery is not called knife science. In the context of programming, ChatGPTcan help us code faster and thereby get our tools ready, but we cannot effectively use them unless we have a good grasp of the pathology of the problem we have set out to solve.
The post-LLM age will trigger the shift from a tool-centric approach to a problem-centric one. Stuart Russell, a leading AI expert, observes that despite all advances, AI systems need to be explicitly provided with an objective. As humans, not only are we aware of all we need to do to get a job done, we carry strong normative assessments of all that should not be done.
We need people to figure out what to do. Machines can help us with the how as long as people are at the wheels. And in this new age, those with a good mix of wisdom to make best use of the technological resources at hand and strong interpersonal skills will be well sought after.
History is testimony to the fact that technological innovation initially displaces workers but creates fresh avenues for employment in the long run. A recent study by economist David Autor and others reveal that more than half of workers today are employed in occupations that did not exist in 1940.Amidst growing concerns of layoffs in major software industries in the near future, Geoffrey Hinton, one of the pioneers of the deep learning revolution that led to the creation of LLMs, opines that we could alternately retain the same workforce, and target achieving a lot more, by leveraging the leap in productivity.
Over time, we are likely to see a flurry of new jobs that do not exist today. In my childhood, I would fancy winning quiz competitions by memorising facts. With Google around, such faculties are no longer held in high esteem. The yardstick of competence has evolved today, students are assessed on the basis of their critical thinking, creativity and argumentative skills instead. As technology evolves, we will have to adapt to newer ways of re-evaluating ourselves.
In this age of fierce competition, it is important to remind ourselves that each of us is uniquely gifted. Career choices need to be made carefully so that they align with ones natural instincts and are not merely driven by societal pressures. This will make sure we enjoy the job we do at the very least, this can surely set us apart from ChatGPT and its future incarnations.
A story goes that Albert Einsteins chauffeur who had heard Einstein lecturing so many times over that he felt confident he could do the job of Einstein. The legendary physicist offered the chauffeur an opportunity to lecture, put on the chauffeurs attire and occupied one of the rear benches. The chauffeur did a fabulous job and skillfully answered a few questions as well. However, when a rather esoteric question on anti-matter that seemingly digressed away from the main theme came up, the chauffeur replied, Sir, this is so simple, Ill let my chauffeur seated at the back answer it on my behalf.
Like the chauffeur, LLMs are exposed to content very much a product of human thought but cannot substitute an expert who has first-hand experience of the process by which such content came into being. On the other hand, a single human beings range of expertise is miniscule compared to the wide expanse of content that fuels ChatGPT. The future is about exploring interesting ways in which machines can complement and augment our abilities, not substitute them. The new generation will adapt a lot faster to this change, since they would not carry the baggage of how things were done in the past this seamless coevolution of humans with technology, would be, for them, the norm.
We must embrace the new age with the readiness not only to do things differently but also to do different things.
(The writer is a professor at the department of Computer Science and Engineering at IIT Madras. He is part of the Artificial Intelligence and Databases (AIDB) Lab.)
See the original post here:
- What is Artificial Intelligence (AI)? - Definition from ... [Last Updated On: June 12th, 2016] [Originally Added On: June 12th, 2016]
- Artificial Intelligence | Neuro AI [Last Updated On: June 12th, 2016] [Originally Added On: June 12th, 2016]
- Association for the Advancement of Artificial Intelligence [Last Updated On: June 13th, 2016] [Originally Added On: June 13th, 2016]
- A.I. Artificial Intelligence - Wikipedia, the free ... [Last Updated On: June 17th, 2016] [Originally Added On: June 17th, 2016]
- Artificial Intelligence - The New York Times [Last Updated On: June 17th, 2016] [Originally Added On: June 17th, 2016]
- Intro to Artificial Intelligence Course and Training ... [Last Updated On: June 28th, 2016] [Originally Added On: June 28th, 2016]
- Artificial Intelligence | Neuro AI [Last Updated On: July 1st, 2016] [Originally Added On: July 1st, 2016]
- What is Artificial Intelligence (AI)? Webopedia Definition [Last Updated On: July 1st, 2016] [Originally Added On: July 1st, 2016]
- Intro to Artificial Intelligence Course and Training Online ... [Last Updated On: July 5th, 2016] [Originally Added On: July 5th, 2016]
- Artificial Intelligence News -- ScienceDaily [Last Updated On: September 16th, 2016] [Originally Added On: September 16th, 2016]
- Artificial intelligence positioned to be a game-changer - CBS ... [Last Updated On: October 13th, 2016] [Originally Added On: October 13th, 2016]
- Artificial Intelligence: A Modern Approach - amazon.com [Last Updated On: October 31st, 2016] [Originally Added On: October 31st, 2016]
- Artificial Intelligence - IndiaBIX [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- The Non-Technical Guide to Machine Learning & Artificial ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence - Graduate Schools of Science ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence in Medicine: An Introduction [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- What does artificial intelligence mean? - Definitions.net [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence Lockheed Martin [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence Course - Computer Science at CCSU [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- FREE Artificial Intelligence Essay - Example Essays [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Elon Musk's artificial intelligence group signs Microsoft ... [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Real FX - Slotless Racing with Artificial Intelligence [Last Updated On: November 23rd, 2016] [Originally Added On: November 23rd, 2016]
- Artificial Intelligence: What It Is and How It Really Works [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Artificial Intelligence Market Size and Forecast by 2024 [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Algorithm-Driven Design: How Artificial Intelligence Is ... [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- 9 Development in Artificial Intelligence | Funding a ... [Last Updated On: January 4th, 2017] [Originally Added On: January 4th, 2017]
- Artificial Intelligence Tops Humans in Poker Battle What's the Big Deal? - PokerNews.com [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Is AI a Threat to Christianity? - The Atlantic [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Allow mathematicians to pierce artificial intelligence frontiers - Livemint [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Montreal sees its future in smart sensors, artificial intelligence (with video) - Computerworld [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Silicon Valley Hedge Fund Takes On Wall Street With AI Trader - Bloomberg [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- The Observer view on artificial intelligence - The Guardian [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Artificial Intelligence Is Coming Whether You Like It Or Not - Mother Jones [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- RealDoll Creating Artificial Intelligence System, Robotic Sex Dolls ... - Breitbart News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Forget lessons, these smart skis are loaded with artificial intelligence - Mashable [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial Intelligence Correctly Predicted the Patriots' 34-28 Super ... - Digital Trends [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Why C-Levels Need To Think About eLearning And Artificial Intelligence - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial Intelligence-Driven Robots: More Brains Than Brawn - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Artificial intelligence: How to build the business case - ZDNet [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- What 'social artificial intelligence' means for marketers - VentureBeat [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Actress Kristen Stewart's Research Paper On Artificial Intelligence: A Critical Evaluation - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Baidu cut its healthcare business to concentrate on artificial intelligence - Asia Times [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Google Android Wear 2.0 update puts artificial intelligence inside your wristwatch - The Sun [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- How criminals use Artificial Intelligence and Machine Learning - BetaNews [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- In the Labs: Connected vehicles in Ohio, artificial intelligence in Illinois and Massachusetts - Network World [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Keeping an eye on artificial intelligence - The National Business Review [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Actors, teachers, therapists think your job is safe from artificial intelligence? Think again - The Guardian [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Wells Fargo Innovation Group to Focus on Artificial Intelligence, Payments and APIs - Wall Street Journal (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- SAP aims to step up its artificial intelligence, machine learning game as S/4HANA hits public cloud - ZDNet [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Artificial Intelligence Is Coming To Police Bodycams, Raising Privacy Concerns - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Nvidia Beats Earnings Estimates As Its Artificial Intelligence Business Keeps On Booming - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Could Artificial Intelligence Ever Become A Threat To Humanity? - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Artificial intuition will supersede artificial intelligence, experts say - Network World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- The Peril of Inaction with Artificial Intelligence - Gigaom [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- TASER International Bringing Artificial Intelligence to Law Enforcement - Motley Fool [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- LG G6 teasers emphasize battery life, artificial intelligence - CNET [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Wells Fargo sets up artificial intelligence team in tech push - Reuters [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Ford spending $1 billion on self-driving artificial intelligence - CNET [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Artificial Intelligence in Business Process Automation - Nanalyze [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- An artificial intelligence gamble that paid off - Minneapolis Star Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford to Invest $1 Billion in Artificial Intelligence Start-Up - New York Times [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Wells Fargo Pushes Into Artificial Intelligence - Fortune [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Artificial intelligence predictions surpass reality - UT The Daily Texan [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Creating artificial intelligence-driven technology products is almost like unleashing the Frankenstein's monster - Economic Times (blog) [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Inside Intel Corporation's Artificial Intelligence Strategy - Motley Fool [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- The artificial intelligence revolutionising healthcare - Irish Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Ford Announces Investment in Artificial Intelligence Company Argo AI - Motor Trend [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Ford Invests $1-Billion in Artificial Intelligence - AutoGuide.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Salesforce adds some artificial intelligence to customer service products - TechCrunch [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- No hype, just fact: Artificial intelligence in simple business terms - ZDNet [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence and The Confusion of Our Age - Patheos (blog) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- How Artificial Intelligence Startups Struck Gold - Entrepreneur [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Terrifyingly, Google's Artificial Intelligence acts aggressive when cornered - Chron.com [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- This Startup Has Developed A New Artificial Intelligence That Can (Sometimes) Beat Google - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- RPI artificial intelligence expert looks at Westworld - Albany Times Union [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Google's DeepMind artificial intelligence becomes 'highly aggressive' when stressed. Skynet, anyone? - Mirror.co.uk [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence Enters The Classroom - News One [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- John Pisarek Talks Artificial Intelligence - Customer Think [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Can Artificial Intelligence Predict Earthquakes? - Scientific American [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Artificial Intelligence Is Becoming A Major Disruptive Force In Banks' Finance Departments - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]