As robots evolve, societys collective imagination forever ponders what else robots can do, with recent fascinations coming to life as self-driving cars or robots that can walk and interact with objects as humans do.
These sophisticated systems are powered by advances in deep learning that triggered breakthroughs in robotic perception, so that robots today have greater potential for better decision-making and improved functioning in real-world environments. But tomorrows roboticists need to understand how to combine deep learning with dynamics, controls, and long-term planning. To keep this momentum in robotic manipulation going forward, engineers today must learn to hover above the whole field, connecting an increasingly diverse set of ideas with an interdisciplinary focus needed to design increasingly complex robotic systems.
Last fall, MIT's Department of Electrical Engineering and Computer Science launched a new course, 6.800 (Robotic Manipulation) to help engineering students broadly survey the latest advancements in robotics while troubleshooting real industry problems. Its a unique course that can provide an inroad into robotics for students with no robotics experience at all, designed by Russ Tedrake, the Toyota Professor of Electrical Engineering and Computer Science, Aeronautics and Astronautics, and Mechanical Engineering at MIT. Tedrake developed the course after robotic manipulation became the new focus of his own research at the Toyota Research Institute and MITs Robot Locomotion Group, and it became apparent to him that developing a pedagogical framework would be important because the field is so diverse and changing so rapidly.
It was time for there to be a single place where you could really get a view of all the pieces, Tedrake says.
His students learn fundamental algorithmic approaches to build robot systems capable of autonomously manipulating objects in unstructured environments. Exploring topics like perception, planning, dynamics, and control, students solve problem sets to guide themselves through developing a software stack, typically using the permissively licensed open-source software Drake which is why industry leaders watch Tedrakes lectures, too. Not focused on quizzes and final exams, the course culminates instead with a final project where students can explore any problem in robotic manipulation that fascinates them.
Undergraduate engineering student David von Wrangel is currently in the course. His background is in rocketry and propulsion, and he only just became interested in robotics through a recent mobile robotics internship at Tesla. Learning what it took to make a robot move around, soon his next question became: how can a robot be made to pick something up? Thats when a colleague at his internship told him about MITs Robotic Manipulation course.
I was super excited, because that was exactly what I was missing: now that you can manipulate your robot, you just need to figure out how to use manipulation to move other things, von Wrangel says.
Tedrakes course notes provide students like von Wrangel with a window to peer across the professors own mental landscape of the field. Students say they are unlike any course notes theyve ever seen providing a constantly updated roadmap of what it would take to advance robotics as a field.
Teaching assistants (TAs), like PhD student H.J. Terry Suh last fall, develop problem sets that offer students opportunities to apply less familiar concepts and see for themselves how various disciplines connect.
That potential to gain a new point of view in robotics is precisely what drew graduate student Anubhav Guha to the course. His research focuses on applications of controls, and he took the course to examine open-ended problems in robotics that directly related to his research. I kind of wanted to explore the field a bit and get a feel for the technical problems, Guha says.
Tedrake says theres rampant industry interest in engineers skilled in manipulation, and that demand helped motivate him to launch the course. Manipulation is just kind of exploding in the field, Tedrake says, adding that recently, it's less of a niche area, everybody's got an eye on making robots do things with their hands. Right now, the big companies are investing.
They arent the only ones invested in the future for robots. Because there was so much student interest in the course, Tedrake decided to open Robotic Manipulation enrollment up to both undergraduate and graduate students.
For PhD student Daniel Yang, who took the course when it was first offered last fall, his interest in robotic manipulation increased while working in industry and seeing the limited environments in which robots currently operate. As part of the MIT/Woods Hole Oceanographic Institution (WHOI) Joint Program, Yang collaborates with oceanographers, helping to build autonomous robotic systems capable of diving into the water to collect scientific data.
Broadly, I'm interested in getting robots out in the real world, Yang says.
For Yangs course final project, he was inspired to explore the inner workings of a throwing robot like Googles TossingBot. Collaborating with a partner to build their own ball-throwing robot in a simulator, they were able to clearly document effects that threw the robot off its tossing game, because the course simulator allowed them to freeze and reexamine every interaction while troubleshooting. For one example, they realized that the accuracy of their robots throwing arm was limited because the exact physics of how the ball interacted with the robots gripper were still unknown.
You may think picking something up with your fingers is quite simple, Yang says. But when you try to translate that into simulation, theres just so much added complexity.
Suh says that Guhas final project was among the most ambitious. Guha created an entire simulated manipulator system that pieces together a puzzle using a camera system that detects the correct image placement and orientation for each puzzle piece.
Some other projects kind of focused on one aspect of the manipulation pipeline, like grasping or perception, Guha says. And they really went in deep into that. And I wanted to explore all of the different components that are required to make a fully functioning system.
Tedrake says that whether students decide to focus on one aspect of the manipulation pipeline or tackle an entire system, solving problems at any level equates to a great success in this fast-growing field thats hungry for solutions.
Even if it's an algorithm that I know well, but I see what they struggled with, or how they made work, it sharpens my understanding of the algorithm, Tedrake says.
Tedrake takes many of the solutions found in his class directly into the lab, pushing forward his own research and gaining new research ideas each week. And sometimes he brings the students with him. Thats what happened with von Wrangel, whose enthusiasm for the course led Tedrake to recruit him to help refine algorithms for Tedrakes Robot Locomotion Group.
Yang and Suh agree with Tedrake that the future of robotic manipulation is coming fast and the Robotic Manipulation course will help train engineers to steady the field as it advances.
I think the last few years, there's been so many advances in all these different fields, but there hasn't been anything that ties them together into one specific problem space, Yang says.
Suh thinks people will start seeing more advancements in everyday life, and as that happens the Robotic Manipulation course will be there as a resource. His vision of the future sees robots everywhere.
It's going to be sort of manipulation in the wild, where we'll have robots go inside arbitrary places, like people's homes or kitchens, and carry out very delicate manipulation tasks that we would usually expect humans to do, Suh says.
For von Wrangel, the future of robotic manipulation will help us go well beyond the seeming luxury of self-driving cars and robot task-rabbits. I'm very much into space exploration and humans becoming multi-climate and multiplanetary species, von Wrangel says. And I believe that robots could help us build our future on Mars.
In its second year, Robotic Manipulation keeps inspiring bigger and bolder ideas from students, who ply TAs like Suh with sometimes esoteric questions in the middle of the night, always seeking guidance to better simulate systems. Tedrake says the ideas for final projects this year have already been more ambitious than last year. Each project, tweaking each algorithm little by little or imagining entire systems from a unique point of view, will serve a role in driving innovation in the field.
Some years, with student projects, it's more like, I want to try this paper and just make it a little bit better, Tedrake says. And this year, it's like, I want a robot thats going to tie my shoes.
View post:
Manipulating the future | MIT News | Massachusetts Institute of Technology - MIT News
- Robotics Academy [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- KUKA Robotics | KUKA AG [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- Robotics - The Great Courses [Last Updated On: December 22nd, 2016] [Originally Added On: December 22nd, 2016]
- Robotics - reddit [Last Updated On: January 11th, 2017] [Originally Added On: January 11th, 2017]
- Chatham Robotics Goes Undefeated and Moves On to State Championship - TAPinto.net [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Meridian robotics team gears up for Idaho FRC Regional - KBOI-TV [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Local robotics students headed to World Championship tournament - KOLO [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Report: Nearshoring favors robotics, will require heavy capital investment - Supply Chain Dive [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts largest robotics competition in history of event - Greenville Daily News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- First Tech Challenge: High schools battle in robotics competition - The Journal News | LoHud.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Robotics Team Takes Home Trophy at Lego Competition - Patch.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- OHS robotics club dazzles McKinley students - Southernminn.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Toyota Industries Acquires Warehouse Robotics Developer - Wall Street Journal [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- South High wins Volvo's robotics tournament - Herald-Mail Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Belding hosts robotics competition - Sentinel-Standard [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- CMS robotics program soars - SW News Media [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Update On The Megatrend of Robotics - CTOvision (blog) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- 33C3: Edible Soft Robotics - Hackaday [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Shopping robots on the march in Ocado - BBC News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Keller students Starstruck on robotics - Fort Worth Star Telegram [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Our obsession with robots keeps getting creepier - New York Post [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Rethink Robotics makes its workplace bots easier to train and redeploy - TechCrunch [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Donation will cover costs for Sequim robotic competition - Peninsula Daily News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Derby Middle School robotics club competes at high school competition - The Derby Informer [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Raspberry Pi-powered arm: This kit aims to make robotics simple enough for kids - TechRepublic [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- WPI Robotics Team Has a Mission with Mars | News | WPI - WPI News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - ScienceBlog.com (blog) [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Rethink's Robots Get Massive Software Upgrade, Rodney Brooks So Excited - IEEE Spectrum [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Robotics: A robot that flies like a bat : Nature : Nature Research - Nature.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Robotics teams at CCS stay busy at tournaments - Imperial Republican [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rethink Robotics rethinks its software | ZDNet - ZDNet [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Hartland robotics teams take on the FIRST Tech challenge at state competition - LC Sussex Sun [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Home-schooled students studying robotics - Valencia County News Bulletin [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Agility Robotics Introduces Cassie, a Dynamic and Talented Robot Delivery Ostrich - IEEE Spectrum [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Memphis robotics team headed to Super-Regionals - New Baltimore Voice Newspapers [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Patriot Robotics Alliance upsets Brentwood Academy Alliances - Clarksville Now [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Raptor legs & human hips: Giant leap for walking robots - RT [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- How drones and robotics may shape the future of conflict under President Trump - PRI [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Robotics teams wins at state meet - The Citizen.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Ford Bets $1B on Startup Founded by Waymo, Uber Vets - ABC News [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- South Beach robotics squad advances to super regionals - The Daily World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Personal robotics the next technological revolution: Dr Vivian Balakrishnan - Channel NewsAsia [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- This bipedal robot could deliver your packages one day - The Verge - The Verge [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Robotics event offers lesson in teamwork - Lewiston Morning Tribune (subscription) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Essex County Freeholders Honor Livingston Robotics Club Teams - TAPinto.net [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- College Town: WPI Robotics team aims for $1M NASA prize - Worcester Telegram [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Alice Shaw robotics team building invention to save wolves | Local ... - Lompoc Record [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford invests $1B in robotics startup in driverless car quest - CBS News [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Freshman Caldwell team takes first place in Regional Robotics Tournament - Idaho Press-Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- What went seriously wrong with Lily Robotics - VentureBeat [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Face off: Marion students compete in robotics competition - The Exponent Telegram (press release) (registration) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Robotics Competition slated for Monday - San Angelo Standard Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cornerstone Prep robotics team brings home trophy in first year - MDJOnline.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Center Grove robotics team headed to state competition - Daily Journal [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Hundreds piled into a Fort Mill gym. They cheered. They competed. They drove robots. - The Herald [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- My Turn: Arts education paved the way for girls' robotics win - AZCentral.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Young Alberta engineers face off in robotics showdown - CBC.ca [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cougar robotics team advances to Super-Regionals - Times Bulletin - Times Bulletin [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- South Carroll Robotics teams compete at Maryland State Robotics Competition - Carroll County Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Cave Spring High School's Robotics Club wins in the First Tech ... - Roanoke Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- FIRST Robotics Competition - Wikipedia [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Designing robots to look more like ostriches can solve a key problem for our future biped overlords - Quartz [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- More than 1000 high school students expected to Battlefield HS robotics tournament - PotomacLocal.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Event to look at Scotland's pivotal role in robotics - The Scotsman [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Kennett Coders to compete in NH State Robotics Championships on Saturday - Conway Daily Sun [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Are there enough robots? - Robotics Tomorrow (press release) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Girl Scouts of Southern Illinois robotics team makes state tournament - Alton Telegraph [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Intuition Robotics raised $6 million for its ElliQ elder care assistant robot - TechCrunch [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Richmond robotics team gears up for districts - New Baltimore Voice Newspapers [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Microsoft lets you crash drones and robots in its new real world simulator - The Verge [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Makeblock's Lego-like 'Neuron' teaches kids robotics and code - Engadget [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- West Ridge robotics team maneuvers into national championship - Austin American-Statesman [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Immokalee High team set for robotics state championships Friday - Naples Daily News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- What has Robotics got in store for our future? - RTE.ie [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Uber Is Becoming a Robotics Company, CEO Says - Yahoo News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler's new kits help kids craft their own robots - Engadget - Engadget [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Magnetic Control Could Help Robots Navigate Inside Your Body - IEEE Spectrum [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Boston's new hub, MassRobotics, is like a WeWork for robotics startups - TechCrunch [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- 3Doodler announces a robotics kit, Star Trek and Powerpuff Girls ... - TechCrunch [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Chart: Are Robots Replacing High-Cost Workers? - Seeking Alpha [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]