Luis Sentis will lead a session, A Developers Primer for Coding Human Behavior in Bots, at SXSW on Sunday, March 12, 2017.
Human-centered robotics hold a special place in the robotics field because they both mimic human sensing and cognitive behavior, and are designed to assist humans for safety and productivity. To explore human-centered robotics is to explore human beings and how we sense the world, analyze complex and often conflicting information, and act upon our findings, modifying perception, understanding, and action as new information is available.
Such machines could be of great practical benefit to humans on long space flights to Mars, for instance, or as human proxies in hazardous environments such as a chemical spill or even ordinary circumstances like education or elder care.
Obviously, creating human-centered robots poses many challenges in conception, design, and the hardware and software that support them. My own work in this burgeoning field focuses on designing high-performance series elastic actuators for robotic movements, embedded control systems, motion planning for dynamic locomotion, and real-time optimal control for human-centered robots.
Once we have a platform for human-centered robotics, and once we can create the hardware and software and the logic to drive them, we can turn to its real-world applications, which are many.
Most readers probably have only a passing acquaintance with human-centered robotics, so allow me to use this brief blog to introduce a few ideas about this topic and its challenges.
Humanoid and Human-Centered
Since perhaps the 1950s, television and the movies have often portrayed humanoid robotsrobots that take roughly human formentertaining us with how closely they mimic humans or by how far they fall short. Sometimes, in a dramatic plot turn, a humanoid robot becomes malevolent or uncontrollable by humans.
I prefer the term human-centered robot, because it most closely describes my field of endeavor: How to create a robot that is focused on assisting a human being; sometimes guided by a human, but also learning on its own what action or behavior would be most helpful to that human.
In my view, we do not yet have sufficient evidence to say that humanoid robots are most effective when interacting with humans. They may well be, but we do not have definitive data on the question.
However, it appears anecdotally true that humanoid robots fire the human imagination and that has its benefits. In addition to their portrayal in popular media, I have found that humanoid robots draw the most, well, human interest. Soon after creating one we named Dreamer in 2013, in the Human Centered Robotics Lab (HCRL) at the Cockrell School of Engineering at the University of Texas at Austin, we generally received more attention from curious students, engineers, investors andwouldnt you know itmovie producers. (Dreamer eventually had a bit part in Transformers 4 in 2014.) If humanoid robots help draw attention and interest to human-centered robotics, so be it.
Applications and Productivity
The more important aspect of this field is how to create human-centered robotics that sense their surroundings and either respond to human directions or intuit what actions would best serve their human counterpart.
Ive mentioned the possible robotic applications of space travel, perhaps as a companion to astronauts on a space walk, as a human proxy in hazardous environments or as a caregiver to an elderly person. In each case, the notion of productivity is different.
If you think of productivity for robotics generally in a manufacturing setting, it can be measured in terms of hours of work performed and profits earned. But in a long space journey to Mars, productivity will be measured instead in terms of the astronauts enhanced safety and ability to accomplish difficult tasks. In a hazmat spill, productivity might be measured in terms of human lives saved. In elder care, how well did a robot perform in changing bandages or applying ointment to a sore, preserving the persons health?
Robot Knows Best
Another quest in human-centered robotics is to create the ability of a robot to not just predict human behavior, but to perform what I call intervention. Whatever its level of complexity, can we build a robot with logic that assesses a situation for optimal actions, whether directed by a human or not? This translates to a robots ability to say to itself, Well, the human is operating the system in such a way. We could do better if computationally I have a hypothesis about what would be best for the human and intervene with that particular behavior.
This ability requires pairing social cognitive theories with mathematics. And I have found that advances are possible for what I call self-efficacy, which is basically the self-confidence to achieve a certain behavior.
At this point, self-efficacy can be achieved in very simple scenarios. One potential application is to use a human-centered robot to motivate students to solve problems by sensing and reacting to students level of engagement, then producing an interaction that motivates the student and enhances learning. I hope to demonstrate this and give attendees a chance to code such behavior in a human-centered robot at SXSW.
Touch and Whole Body Sensing
One major way in which humans interact is through touch. We place a hand on a shoulder or grasp someones forearm to gain their attention. Robotsparticularly humanoid ones with mobilityare likely to be large and quick, so touch becomes an important element in the safety of their human counterparts. We do not want a robot that runs into an astronaut on a space walk or pins someone to a wall. Thus, we are developing what I call whole body sensing. Though some in this field are pursuing something known as sensory skin, at the HCRL we have taken a more economical approach to minimize the amount of electronics needed.
We use a distributed sensor array on the robots surface, but they number in the dozens, not the thousands employed in sensory skin. Instead, we combine different sensing modalities internal to the robot, such as accelerometers, which aid stabilization, and vibration sensors that enable the machine to triangulate information on whats happening in the immediate environment. This enables the robot to respond to human touch, but within the context of other information it is receiving from its environment. We call this whole-body contact awareness, a combination of internal and external sensing and awareness.
Spin-offs
I hope this mere glimpse into the world of human-centered robotics piques your curiosity. It may serve to attract those who wish to work in the field. But the general public should also understand that advances in this field will eventually make their way into human-centered robotics in our homes, our businesses, manufacturing, agriculture, smart cities, the Internet of Things, you name it. Well have systems somedaywe already do, with limited abilitiesto sense human behaviors and intervene to produce optimal conditions based on an understanding of whats best for the people involved in a particular situation.
Today, we have smart thermostats that learn our preferences for heating and cooling our homes. Tomorrow, we may have human-centered robotic systems that optimize our cities.
Luis Sentis is an Assistant Professor in the Department of Aerospace Engineering at the University of Texas (UT) at Austin. He also leads UT Austins Human Centered Robotics Laboratory and is co-founder of Apptronik Systems Inc., a contractor for NASA's Johnson Space Center.
See more here:
The Future of Human-Centered Robotics - Electronic Design
- Robotics Academy [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- KUKA Robotics | KUKA AG [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- Robotics - The Great Courses [Last Updated On: December 22nd, 2016] [Originally Added On: December 22nd, 2016]
- Robotics - reddit [Last Updated On: January 11th, 2017] [Originally Added On: January 11th, 2017]
- Chatham Robotics Goes Undefeated and Moves On to State Championship - TAPinto.net [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Meridian robotics team gears up for Idaho FRC Regional - KBOI-TV [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Local robotics students headed to World Championship tournament - KOLO [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Report: Nearshoring favors robotics, will require heavy capital investment - Supply Chain Dive [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts largest robotics competition in history of event - Greenville Daily News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- First Tech Challenge: High schools battle in robotics competition - The Journal News | LoHud.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Robotics Team Takes Home Trophy at Lego Competition - Patch.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- OHS robotics club dazzles McKinley students - Southernminn.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Toyota Industries Acquires Warehouse Robotics Developer - Wall Street Journal [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- South High wins Volvo's robotics tournament - Herald-Mail Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts robotics competition - Sentinel-Standard [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- CMS robotics program soars - SW News Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Update On The Megatrend of Robotics - CTOvision (blog) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- 33C3: Edible Soft Robotics - Hackaday [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Shopping robots on the march in Ocado - BBC News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Keller students Starstruck on robotics - Fort Worth Star Telegram [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Our obsession with robots keeps getting creepier - New York Post [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Rethink Robotics makes its workplace bots easier to train and redeploy - TechCrunch [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Donation will cover costs for Sequim robotic competition - Peninsula Daily News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Derby Middle School robotics club competes at high school competition - The Derby Informer [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Raspberry Pi-powered arm: This kit aims to make robotics simple enough for kids - TechRepublic [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- WPI Robotics Team Has a Mission with Mars | News | WPI - WPI News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - ScienceBlog.com (blog) [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rethink's Robots Get Massive Software Upgrade, Rodney Brooks So Excited - IEEE Spectrum [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Robotics: A robot that flies like a bat : Nature : Nature Research - Nature.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Robotics teams at CCS stay busy at tournaments - Imperial Republican [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rethink Robotics rethinks its software | ZDNet - ZDNet [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Hartland robotics teams take on the FIRST Tech challenge at state competition - LC Sussex Sun [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Home-schooled students studying robotics - Valencia County News Bulletin [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Agility Robotics Introduces Cassie, a Dynamic and Talented Robot Delivery Ostrich - IEEE Spectrum [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Memphis robotics team headed to Super-Regionals - New Baltimore Voice Newspapers [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Patriot Robotics Alliance upsets Brentwood Academy Alliances - Clarksville Now [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Raptor legs & human hips: Giant leap for walking robots - RT [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- How drones and robotics may shape the future of conflict under President Trump - PRI [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Robotics teams wins at state meet - The Citizen.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Ford Bets $1B on Startup Founded by Waymo, Uber Vets - ABC News [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- South Beach robotics squad advances to super regionals - The Daily World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Personal robotics the next technological revolution: Dr Vivian Balakrishnan - Channel NewsAsia [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- This bipedal robot could deliver your packages one day - The Verge - The Verge [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Robotics event offers lesson in teamwork - Lewiston Morning Tribune (subscription) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Essex County Freeholders Honor Livingston Robotics Club Teams - TAPinto.net [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- College Town: WPI Robotics team aims for $1M NASA prize - Worcester Telegram [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Alice Shaw robotics team building invention to save wolves | Local ... - Lompoc Record [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford invests $1B in robotics startup in driverless car quest - CBS News [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Freshman Caldwell team takes first place in Regional Robotics Tournament - Idaho Press-Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- What went seriously wrong with Lily Robotics - VentureBeat [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Face off: Marion students compete in robotics competition - The Exponent Telegram (press release) (registration) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Robotics Competition slated for Monday - San Angelo Standard Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cornerstone Prep robotics team brings home trophy in first year - MDJOnline.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Center Grove robotics team headed to state competition - Daily Journal [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Hundreds piled into a Fort Mill gym. They cheered. They competed. They drove robots. - The Herald [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- My Turn: Arts education paved the way for girls' robotics win - AZCentral.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Young Alberta engineers face off in robotics showdown - CBC.ca [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cougar robotics team advances to Super-Regionals - Times Bulletin - Times Bulletin [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- South Carroll Robotics teams compete at Maryland State Robotics Competition - Carroll County Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cave Spring High School's Robotics Club wins in the First Tech ... - Roanoke Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- FIRST Robotics Competition - Wikipedia [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Designing robots to look more like ostriches can solve a key problem for our future biped overlords - Quartz [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- More than 1000 high school students expected to Battlefield HS robotics tournament - PotomacLocal.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Event to look at Scotland's pivotal role in robotics - The Scotsman [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Kennett Coders to compete in NH State Robotics Championships on Saturday - Conway Daily Sun [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Are there enough robots? - Robotics Tomorrow (press release) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Girl Scouts of Southern Illinois robotics team makes state tournament - Alton Telegraph [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Intuition Robotics raised $6 million for its ElliQ elder care assistant robot - TechCrunch [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Richmond robotics team gears up for districts - New Baltimore Voice Newspapers [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Microsoft lets you crash drones and robots in its new real world simulator - The Verge [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Makeblock's Lego-like 'Neuron' teaches kids robotics and code - Engadget [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- West Ridge robotics team maneuvers into national championship - Austin American-Statesman [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Immokalee High team set for robotics state championships Friday - Naples Daily News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- What has Robotics got in store for our future? - RTE.ie [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Uber Is Becoming a Robotics Company, CEO Says - Yahoo News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler's new kits help kids craft their own robots - Engadget - Engadget [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Magnetic Control Could Help Robots Navigate Inside Your Body - IEEE Spectrum [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Boston's new hub, MassRobotics, is like a WeWork for robotics startups - TechCrunch [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler announces a robotics kit, Star Trek and Powerpuff Girls ... - TechCrunch [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Chart: Are Robots Replacing High-Cost Workers? - Seeking Alpha [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]