Artificial intelligence is entering our lives in many ways on our smartphones, in our homes, in our cars. These systems can help people make appointments, drive and even diagnose illnesses. But as AI systems continue to serve important and collaborative roles in peoples lives, a natural question is: Can I trust them? How do I know they will do what I expect?
Explainable AI (XAI) is a branch of A.I. research that examines how artificial agents can be made more transparent and trustworthy to their human users. Trustworthiness is essential if robots and people are to work together. XAI seeks to develop A.I. systems that human beings find trustworthy while also performing well to fulfill designed tasks.
At the Center for Vision, Cognition, Learning, and Autonomy at UCLA, we and our colleagues are interested in what factors make machines more trustworthy, and how well different learning algorithms enable trust. Our lab uses a type of knowledge representation a model of the world that an A.I. uses to interpret its surroundings and make decisions that can be more easily understood by humans. This naturally aids in explanation and transparency, thereby improving trust of human users.
In our latest research, we experimented with different ways a robot could explain its actions to a human observer. Interestingly, the forms of explanation that fostered the most human trust did not correspond to the learning algorithms that produced the best task performance. This suggests performance and explanation are not inherently dependent upon each other optimizing for one alone may not lead to the best outcome for the other. This divergence calls for robot designs that takes into account both good task performance and trustworthy explanations.
In undertaking this study, our group was interested in two things. How does a robot best learn to perform a particular task? Then, how do people respond to the robots explanation of its actions?
We taught a robot to learn from human demonstrations how to open a medicine bottle with a safety lock. A person wore a tactile glove that recorded the poses and forces of the human hand as it opened the bottle. That information helped the robot learn what the human did in two ways: symbolic and haptic. Symbolic refers to meaningful representations of your actions: for example, the word grasp. Haptic refers to the feelings associated with your bodys postures and motions: for example, the sensation of your fingers closing together.
First, the robot learned a symbolic model that encodes the sequence of steps needed to complete the task of opening the bottle. Second, the robot learned a haptic model that allows the robot to imagine itself in the role of the human demonstrator and predict what action a person would take when encountering particular poses and forces.
It turns out the robot was able to achieve its best performance when combining the symbolic and haptic components. The robot did better using knowledge of the steps for performing the task and real-time sensing from its gripper than using either alone.
Now that the robot knows what to do, how can it explain its behavior to a person? And how well does that explanation foster human trust?
To explain its actions, the robot can draw on its internal decision process as well as its behavior. The symbolic model provides step-by-step descriptions of the robots actions, and the haptic model provides a sense of what the robot gripper is feeling.
In our experiment, we added an additional explanation for humans: a text write-up that provided a summary after the robot has finished attempting to open the medicine bottle. We wanted to see if summary descriptions would be as effective as the step-by-step symbolic explanation to gain human trust.
We asked 150 human participants, divided into four groups, to observe the robot attempting to open the medicine bottle. The robot then gave each group a different explanation of the task: symbolic, step-by-step, haptic arm positions and motions, text summary, or symbolic and haptic together. A baseline group observed only a video of the robot attempting to open the bottle, without providing any additional explanations.
We found that providing both the symbolic and haptic explanations fostered the most trust, with the symbolic component contributing the most. Interestingly, the explanation in the form of a text summary didnt foster more trust than simply watching the robot perform the task, indicating that humans prefer robots to give step-by-step explanations of what theyre doing.
The most interesting outcome of this research is that what makes robots perform well is not the same as what makes people see them as trustworthy. The robot needed both the symbolic and haptic components to do the best job. But it was the symbolic explanation that made people trust the robot most.
This divergence highlights important goals for future A.I. and robotics research: to focus on pursuing both task performance and explainability. Only focusing on task performance may not lead to a robot that explains itself well. Our lab uses a hybrid model to provide both high performance and trustworthy explanations.
Performance and explanation do not naturally complement each other, so both goals need to be a priority from the start when building A.I. systems. This work represents an important step in systematically studying how human-machine relationships develop, but much more needs to be done. A challenging step for future research will be to move from I trust the robot to do X to I trust the robot.
For robots to earn a place in peoples daily lives, humans need to trust their robotic counterparts. Understanding how robots can provide explanations that foster human trust is an important step toward enabling humans and robots to work together.
Mark Edmonds is a Ph.D. candidate in computer science and Yixin Zhu is a postdoctoral scholar in computer science, both at the University of California, Los Angeles.
See the original post:
A New Study Finds People Prefer Robots That Explain Themselves - Smithsonian.com
- Robotics Academy [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- KUKA Robotics | KUKA AG [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- Robotics - The Great Courses [Last Updated On: December 22nd, 2016] [Originally Added On: December 22nd, 2016]
- Robotics - reddit [Last Updated On: January 11th, 2017] [Originally Added On: January 11th, 2017]
- Chatham Robotics Goes Undefeated and Moves On to State Championship - TAPinto.net [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Meridian robotics team gears up for Idaho FRC Regional - KBOI-TV [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Local robotics students headed to World Championship tournament - KOLO [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Report: Nearshoring favors robotics, will require heavy capital investment - Supply Chain Dive [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts largest robotics competition in history of event - Greenville Daily News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- First Tech Challenge: High schools battle in robotics competition - The Journal News | LoHud.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Robotics Team Takes Home Trophy at Lego Competition - Patch.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- OHS robotics club dazzles McKinley students - Southernminn.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Toyota Industries Acquires Warehouse Robotics Developer - Wall Street Journal [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- South High wins Volvo's robotics tournament - Herald-Mail Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts robotics competition - Sentinel-Standard [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- CMS robotics program soars - SW News Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Update On The Megatrend of Robotics - CTOvision (blog) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- 33C3: Edible Soft Robotics - Hackaday [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Shopping robots on the march in Ocado - BBC News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Keller students Starstruck on robotics - Fort Worth Star Telegram [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Our obsession with robots keeps getting creepier - New York Post [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Rethink Robotics makes its workplace bots easier to train and redeploy - TechCrunch [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Donation will cover costs for Sequim robotic competition - Peninsula Daily News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Derby Middle School robotics club competes at high school competition - The Derby Informer [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Raspberry Pi-powered arm: This kit aims to make robotics simple enough for kids - TechRepublic [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- WPI Robotics Team Has a Mission with Mars | News | WPI - WPI News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - ScienceBlog.com (blog) [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rethink's Robots Get Massive Software Upgrade, Rodney Brooks So Excited - IEEE Spectrum [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Robotics: A robot that flies like a bat : Nature : Nature Research - Nature.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Robotics teams at CCS stay busy at tournaments - Imperial Republican [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rethink Robotics rethinks its software | ZDNet - ZDNet [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Hartland robotics teams take on the FIRST Tech challenge at state competition - LC Sussex Sun [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Home-schooled students studying robotics - Valencia County News Bulletin [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Agility Robotics Introduces Cassie, a Dynamic and Talented Robot Delivery Ostrich - IEEE Spectrum [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Memphis robotics team headed to Super-Regionals - New Baltimore Voice Newspapers [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Patriot Robotics Alliance upsets Brentwood Academy Alliances - Clarksville Now [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Raptor legs & human hips: Giant leap for walking robots - RT [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- How drones and robotics may shape the future of conflict under President Trump - PRI [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Robotics teams wins at state meet - The Citizen.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Ford Bets $1B on Startup Founded by Waymo, Uber Vets - ABC News [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- South Beach robotics squad advances to super regionals - The Daily World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Personal robotics the next technological revolution: Dr Vivian Balakrishnan - Channel NewsAsia [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- This bipedal robot could deliver your packages one day - The Verge - The Verge [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Robotics event offers lesson in teamwork - Lewiston Morning Tribune (subscription) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Essex County Freeholders Honor Livingston Robotics Club Teams - TAPinto.net [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- College Town: WPI Robotics team aims for $1M NASA prize - Worcester Telegram [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Alice Shaw robotics team building invention to save wolves | Local ... - Lompoc Record [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford invests $1B in robotics startup in driverless car quest - CBS News [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Freshman Caldwell team takes first place in Regional Robotics Tournament - Idaho Press-Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- What went seriously wrong with Lily Robotics - VentureBeat [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Face off: Marion students compete in robotics competition - The Exponent Telegram (press release) (registration) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Robotics Competition slated for Monday - San Angelo Standard Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cornerstone Prep robotics team brings home trophy in first year - MDJOnline.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Center Grove robotics team headed to state competition - Daily Journal [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Hundreds piled into a Fort Mill gym. They cheered. They competed. They drove robots. - The Herald [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- My Turn: Arts education paved the way for girls' robotics win - AZCentral.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Young Alberta engineers face off in robotics showdown - CBC.ca [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cougar robotics team advances to Super-Regionals - Times Bulletin - Times Bulletin [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- South Carroll Robotics teams compete at Maryland State Robotics Competition - Carroll County Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cave Spring High School's Robotics Club wins in the First Tech ... - Roanoke Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- FIRST Robotics Competition - Wikipedia [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Designing robots to look more like ostriches can solve a key problem for our future biped overlords - Quartz [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- More than 1000 high school students expected to Battlefield HS robotics tournament - PotomacLocal.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Event to look at Scotland's pivotal role in robotics - The Scotsman [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Kennett Coders to compete in NH State Robotics Championships on Saturday - Conway Daily Sun [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Are there enough robots? - Robotics Tomorrow (press release) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Girl Scouts of Southern Illinois robotics team makes state tournament - Alton Telegraph [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Intuition Robotics raised $6 million for its ElliQ elder care assistant robot - TechCrunch [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Richmond robotics team gears up for districts - New Baltimore Voice Newspapers [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Microsoft lets you crash drones and robots in its new real world simulator - The Verge [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Makeblock's Lego-like 'Neuron' teaches kids robotics and code - Engadget [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- West Ridge robotics team maneuvers into national championship - Austin American-Statesman [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Immokalee High team set for robotics state championships Friday - Naples Daily News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- What has Robotics got in store for our future? - RTE.ie [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Uber Is Becoming a Robotics Company, CEO Says - Yahoo News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler's new kits help kids craft their own robots - Engadget - Engadget [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Magnetic Control Could Help Robots Navigate Inside Your Body - IEEE Spectrum [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Boston's new hub, MassRobotics, is like a WeWork for robotics startups - TechCrunch [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler announces a robotics kit, Star Trek and Powerpuff Girls ... - TechCrunch [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Chart: Are Robots Replacing High-Cost Workers? - Seeking Alpha [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]