Photo: Evan Ackerman/IEEE Spectrum NASA's Astrobee is a new generation of free-flying robots designed to help astronauts on board the International Space Station.

Since 2006, NASA has had a trio of small, free-flying robots on board the International Space Station. Called SPHERES (Synchronized Position Hold Engage and Reorient Experimental Satellites), these robots have spent about 600 hours participating in an enormous variety of experiments, including autonomous formation flying, navigation and mapping, and running programs written by middle school students in team competitions. But beyond serving as a scientific platform, SPHERES werent designed to do anything especially practical in terms of assisting the astronauts or flight controllers, and its time for a new generation of robotic free fliers thats fancier, more versatile, and will be a big help for the humans on the ISS.

This is Astrobee.

Last fall, IEEE Spectrum visited NASA Ames Research Center in Mountain View, Calif., to have a look at the latest Astrobee prototype and meet the team behind the robot.

Astrobee is a cube about 32centimeters on a side. Each corner and most of two sides are covered in a soft bumper material, with a propulsion system embedded in it. The central part of the robot contains sensors, control systems, a touchscreen, and several payload bays for adding hardware, including an arm designed to grab onto ISS handrails.

While the robot is designed to fly freely on board the ISS, for testing on the ground, Astrobee is mounted on top of a sled that uses a jet of CO2 to create a low-friction air bearing above a perfectly flat (and very enormous) block of granite. This allows the researchers to simulate microgravity in two dimensions to test the robots propulsion and navigation systems, but once its up in space, the entire robot will consist of just the cube thats defined by the blue bumpers, without all of the stuff underneath it.

From the beginning, Astrobee was intended to be much more than a successor to SPHERES: Its a completely new platform, designed from scratch to operate autonomously and safely on board the ISS. One of the biggest improvements is the propulsion system. While SPHERES require constant astronaut supervision (because theyre slightly flammable, among other reasons) and rely on disposable alkaline battery packs and tanks of CO2 propellant to function, Astrobee has an electrically-powered propulsion system, and it can recharge itself on a dock. NASA says Astrobee will be able to make its way around the ISS either under direct remote control from the ground or completely by itself. With modular bays designed to accept customized hardware, the robot can perform a variety of tasks, in some cases taking over boring housekeeping jobs from human astronauts.

Astrobee is fundamentally different than SPHERES in that its designed from the ground up to operate exclusively inside the ISS. Were an IVA [intra vehicular activity] free flier, so were flying around on the inside of the International Space Station with the crew, Trey Smith, lead systems engineer for the Astrobee Project at NASAs Intelligent Robotics Group tells us. In contrast, SPHERES was designed around a CO2 propulsion system that could theoretically operate not only inside but also outside of the station in the vacuum of spacethough that would have required some upgrades tothe SPHERES platform.

Since Astrobee can rely on having an atmosphere around it, it can move itself by pushing air in specific directions, the way most things that fly here on Earth do. There are all kinds of ways of making this work, but operating safely in microgravity comes with an intimidating number of unique challenges, which led to Astrobees fairly complicatedand absolutely fascinatingpropulsion design.

On two faces of Astrobee, behind a protective screen, theres an impeller: A big fan that sucks in air. The impellers, which counter-rotate with each other to minimize gyroscopic forces, are constantly generating a pressurized pocket of air inside of the robot, which is directed out of steerable nozzles on each face. If all of the nozzles are closed, Astrobee doesnt move, and opening them individually or in combination generates thrust, which moves the robot in the opposite direction.

There are twelve nozzles, and theyre carefully arranged so that all of them are off-center, Smith explains. If you ever have one thruster that goes crazy, youre going to wind up flying around in circles, not accelerating across the space station. But if you use a pair of thrusters, then you get a balance. There are different pairs that give you pure translation or pure rotation in each of the cartesian axes in both plus and minus directions, and that shows you that you can get any kind of directional thrust you want.

NASA is understandably somewhat nervous about the idea of a robot that can generate its own thrust and move autonomously around the ISS. Off-center thrusters are just one way that Astrobee is designed to be safe: All of its moving parts are internal, meaning that an astronaut can safely grab it anywhere, and each corner is rounded and cushioned in soft foam, minimizing potential damage if it runs into anything.

Were flying anywhere on station, says Smith. If we run into something, we could run into practically anything. The ISS windows turn out to be a very big issue: Astrobee is kind of like a big fluffy bowling ball, in terms of the mass, and were having to be very conservative about the amount of force we could potentially apply if we have a collision. The typical window on the ISS has four layers of glass: two of them are the pressure panes, and then on the inside and on the outside are what arecalled the scratch and debris panes respectively. What were trying to prove is that theres no way we could break the scratch pane.

Astrobee has to be hardware safe on a fundamental level. In other words, if all of the software goes haywire in the worst way possible, the robot must not be able to cause critical damage to the station. To fully address the safety concerns of an out-of-control robot, the Astrobee team has had to imagine an absolute worst case scenario, and its this: A software glitch causes the robot to accelerate as fast as it can, along the entirety of the longest straight line distance on the ISS (about 20 meters), directly into one of the stations windows. At that point, the robot would be moving at about 2 meters per second, much faster than its software-limited top speed of 0.75 m/s. Its possible that we could break the scratch pane, but we wouldnt be able to do worse than that. No critical damage, Smith says.

Between the propulsion modules on each side of Astrobee theres plenty of room for all the sensors and computing hardware the robot needs to operate autonomously, with enough left over to host a diverse array of payloads. The top and bottom thirds of the robot are payload bays (two in front and two in back), each with mechanical, data, and power connections. The top payload bay in the front is currently taken over with Astrobees own navigation sensors, but having open payload bays was a priority for Astrobee, according to Smith. The way we do the payloads really came out of our experience with SPHERES: At first, SPHERES were mostly for testing formation-flying software, but then people realized you could attach payloads, and they went crazy with it, he says.So we invested a lot more effort in thinking out how to do that with Astrobee.

Astrobees computing system has three layers of processors inside: one low level, one mid level, and one high level. The mid and high level processors are identical, except that the mid level is running Linux and taking care of most of the robots core functionality, while the high-level processor is running Android and is dedicated to the payload. This keeps the science payload nice and isolated, while also making Astrobee relatively easy to program, since you can just write Android apps that interface with Astrobee through a broad API.

Astrobees sensor suite consists of a primary navigation camera with a 116 field of view, along with an HD autofocusing camera that can stream video from the ISS down to the ground in real time. Theres also a CamBoard Pico Flexx time-of-flight flash IR 3D sensor that can detect obstacles out to about 4 meters (although its not mounted in the prototype we saw), and an optical-flow detector mounted on Astrobees top face that detects velocity and will cut off the motors if the robot starts moving too fast.

Two more cameras looks behind the robot to assist with obstacle avoidance, docking, and perching (more on that in a bit). Powering everything (including the propulsion system) are lithium-ion batteries, which can be quite dangerous, but fortunately for the Astrobee team, they werent the first group to use lithium-ion on station, so there are already accepted safety procedures in place that they can follow. The robot should be good for a few hours of flight time before it has to recharge.

One of the things that makes Astrobee unique and valuable is that itll be able to navigate autonomously around the U.S. module of the ISS, as well as in the ESAand JAXA modules (not the Russian segment). Astrobee has one major thing going for it in this regard: The ISS is a highly structured environment. Its a compact, well defined, and predictable area, and unless something goes horribly wrong, things like darkness or rain arent a factor. With this in mind, the robot will be using a relatively simple (in principle, at least) system to localize itself, matching features that a single monocular camera sees with a map of the interior of the ISS, as Smith explains: We have a prior map, so with a single frame of video, we should be able to see the landmarks from our prior map, recognize them, and say, okay, were here on the station.

A problem thats unique to a space robot is navigating around humans where there is no established up or down. With our current maps we pretend that theres gravity, so the top of the robot always points overhead, and you can kind of imagine were driving around like a car, says Smith. As it turns out, the ISS does have a ceiling (called the overhead) as well as a deck that the astronauts tend to use, defined at least in part by which way the lighting is oriented. Astrobee will likely try to maintain a fixed distance from the ceiling as it navigates, to keep from being accidentally stepped on or kicked. Initially, Astrobee will be able to detect obstacles (like astronauts) and stop, but not replan around them, andNASA plans to gradually improve Astrobees autonomous navigation capabilities over time.

Of course, all of Astrobees autonomy is optional, and being able to teleoperate it from the ground is an important feature, both in terms of allowing controllers to direct the robot when necessary and making sure that a humancan take over if Astrobees autonomy somehow fails. This kind of adjustable autonomy makes the robot much more efficient and versatile, since controllers can issue commands at any level, although its expected that a human (somewhere) will always have supervisory control. And if all else goes wrong, the crew can always step in and manhandle the robot back to its dock.

When its not flying around the ISS being very busy and important, Astrobee will have a cozy home on a customized dock. The dock is connected to the station for power and basic telemetry, and includes some fiducials to make it easy for Astrobee to see.There are two berths on each dock, and Astrobee can dock by itself, using its rear-facing camera to back up onto the dock. Once its close enough, magnets will engage to hold it there, and the dock has to be instructed to retract the magnets before the robot can fly off again.

Whenever Astrobee isnt actively traveling somewhere, itll need to keep itself from floating away, and to do that, it has an adorable little 3D-printed perching arm that was designed by NASA Ames systems engineer In Won Park. The arm spends most of its time retracted into Astrobees upper rear payload bay, but itll unfold itself on demand. Using the rear camera, the arm can locate and grab onto the same standardized handrails that astronauts use to get around and hold themselves in place. By using the perching arm to keep Astrobee stationary rather than running the impellers, the robots battery life can be extended by up to 80 percent. Once perched, the arms motors can be used to pan and tilt the body of the robot, which is exactly what youd need for a remote video camera.

The gripper on the arm is a collaboration between NASA Ames and Columbia Universitys ROAM Lab, under the direction of Matei Ciocarlie, who developed theVelo gripper at Willow Garage. The gripper is mechanically compliant, and calibrated to be able to hold Astrobee securely, but not so securely that an astronaut cant pull the robot free if they need to, since the arm is programmed to power down once it detects a force above a certain threshold. This is also a safety feature: If the robot is secured to a rail and someone runs into it by accident, itll just let go and float away.

While the primary purpose of the arm is perching, there are some other use cases that NASA is considering. An interesting one is to add a little bit of handrail to a spare payload bay in one Astrobee, and then grab onto it with the arm of another Astrobee. The gripper is also interchangeable, so other researchers could develop custom grippers to do a variety of different tasks (including manipulation), and then test them out on an Astrobee in space.

The key to making a robot valuable is to design and program it such that it provides a positive return on the amount of time invested into it. Astrobee needs to be able to operate independently of the astronauts to be usefulthis can be fully autonomous operation, or teleoperation from the ground, but the goal is to avoid it being more of a hassle to use the robots than it is to just use a human instead. If Astrobee can reliably do its own thing without getting in the way of the astronauts, ideally with zero crew involvement, there are all kinds of tasks it could take over from them.

The Astrobee team has identified several things that the astronauts spend time doing that Astrobee could do just as well. One is taking video of crew activities, says Smith: The state of the art right now is that the crew themselves set up a camcorder, and wed like it if the flight controllers [on Earth] can position a camcorder so the crew dont have to. With its built-in camera and perching arm, Astrobee would provide a stable view that flight controllers could move around however they wanted, while the astronauts just keep on doing whatever theyre doing.

The crew also spends time doing a lot of really boring stuff like taking sound readings all over the space station, or doing inventory with RFID, or checking CO2 levels. These dull, repetitive housekeeping projects are, to be blunt, a waste of astronauts time, even as theyre mandatory for the long term safety of the ISS. If Astrobee can take over, that gives the humans more time to do the things that humans are good at, like science, or observing the behavior of a can of mixed nuts.

While the prototype Astrobee that we saw at NASA Ames was pretty cool-looking just in terms of hardware, the version of the robot that starts work on the ISS will be much more visually interesting. Astrobees final look is the project of Yun-kyung Kim, an HRI researcher at NASA Ames. Itll be covered in colorful, graphical skins made of nomex fabric, which researchers can design themselves, or the designs could be outsourced, providing a fun way for kids to get involved with space robots. Besides looking cool, part of the reason for these skins will be to help give the robot an easily identifiable front and back, which is not necessarily obvious when youre looking at a cube in an environment with arbitrary directionality. Knowing where the front of Astrobee is will be important for the astronauts, since thats the way the robot will be travelling.

The plan is also to outfit Astrobee with an array of LEDs around the impeller intakes, which can be used to visually communicate simple information. Things like turn signals, or an indication of what task the robot is performing, or whether its being teleoperated or in autonomous mode. The robot does have a touch screen, but the LEDs are intended to be much simpler and more immediate. Astrobee has speakers as well, and Kim is working on ways of using sound to help Astrobee communicate to the astronauts (or alert them) without being too noisy or annoying.

NASA expects to have Astrobee on orbit at some point in the 2018 fiscal year, which covers October 2017 through September 2018. Theyll be sending three of them to the ISS, although only two robots can fit onto the dock at once: The third will be packed away in a space closet somewhere, but the crew will be able to pull it out to participate in some triple Astrobee experiments. Itll probably take a little while to get these robots up and runningbesides installing the dock, the astronauts will have to help out with making a map of the station so that the robots will be able to navigate autonomously. Crew time is always at a premium, but the hope is that once Astrobee is good to go, itll be able to free up some of that time in return by helping out around the station.

Astrobee will also be taking the place of SPHERES, and as a part of that transition, the idea is that NASAs Guest Scientist Program will eventually provide a way for scientists around the world to run experiments on the robots, in both hardware and software. In the past, SPHERES participation has been limited since it demands constant astronaut supervision along with extra time for setting up the robots and then stowing everything again, but the increased autonomy of Astrobee should result in more opportunities for collaboration and research.

NASAs plans for its space robots have been ambitious to an extent that they havent always been able to live up to their potential. Usually, this is because too much participation is required from the human crew. Astrobee is promising because it was designed specifically for autonomous operation, and to be assistive for the human crew. Robonaut was supposed to do the same thing, but it still hasnt, because its been too difficult and time intensive for the crew to get it to work. If Astrobee can make it over that first hurdle, to the point where it achieves a useful level of autonomy, it has the potential to show the entire Earth exactly how valuable a little space robot can be.

[ NASA Astrobee ]

IEEE Spectrum's award-winning robotics blog, featuring news, articles, and videos on robots, humanoids, drones, automation, artificial intelligence, and more. Contact us:e.guizzo@ieee.org

Sign up for the Automaton newsletter and get biweekly updates about robotics, automation, and AI, all delivered directly to your inbox.

NASA shares this video update on SPHERES and Robonaut 2 aboard the ISS3Feb2012

Inside the International Space Station, robots are slowly but surely taking over from humans 15Oct2014

Practicing on a taskboard may not be exciting, but Robonaut will have to master it before he can get a real job on the International Space Station16Feb2012

It took special orders from President Obama, but Robonaut is now unpacked, armed, and almost operational17Mar2011

A new video from NASA shows Robonaut's legs in action 10Dec2013

Top teams will compete in a simulated Mars mission 8Feb

The competition starts with teams operating a robot in a simulated Martian dust storm 17Aug2016

Teleoperation and in-situ materials are how robots will prepare the moon and Mars for our arrival 25Jan2016

Among the challenges: competing with Facebook and Google, and figuring out how to integrate commercial technology into space programs 7Dec2015

The U.S. space agency plans to use tiny satellites and GPS signals to more accurately predict hurricane strength 27Oct2015

An MIT engineer and historian argues that self-driving cars and other robotic systems should still keep humans in the loop 23Oct2015

Robotic teleoperation means we can explore places where it's too difficult to send fragile, needy humans 17Sep2015

This is what happens when we skip a week of Video Friday 11Sep2015

JPL's tumbling robotic hedgehog can jump, spin, and roll in microgravity to explore asteroids and comets 10Sep2015

A robot powered by turbulence might be the best way to explore gas giants 23Jul2015

Refueling and repairing satellites in orbit could drastically lower costs, and NASA is working to make it happen 22Jul2015

The first spacecraft of the asteroid-mining venture Planetary Resources will test technologies for future space missions 20Jul2015

Robots using mirrors to reflect sunlight at other robots could enable exploration of craters and caves 13Jul2015

A satellite with a net will locate and capture a cubesat in an operational test of an orbital space junk removal system 9Jul2015

NASA wants pick up where the DARPA Robotics Challenge left offand then go to Mars 24Jun2015

See original here:

How NASA's Astrobee Robot Is Bringing Useful Autonomy to the ISS - IEEE Spectrum