For people who have suffered neurotrauma such as a stroke, everyday tasks can be extremely challenging because of decreased coordination and strength in one or both upper limbs. These problems have spurred the development of robotic devices to help enhance their abilities. However, the rigid nature of these assistive devices can be problematic, especially for more complex tasks like playing a musical instrument.
A first-of-its-kind robotic glove is lending a "hand" and providing hope to piano players who have suffered a disabling stroke. Developed by researchers from Florida Atlantic University's College of Engineering and Computer Science, the soft robotic hand exoskeleton uses artificial intelligence to improve hand dexterity.
Combining flexible tactile sensors, soft actuators and AI, this robotic glove is the first to "feel" the difference between correct and incorrect versions of the same song and to combine these features into a single hand exoskeleton.
"Playing the piano requires complex and highly skilled movements, and relearning tasks involves the restoration and retraining of specific movements or skills," said Erik Engeberg, Ph.D., senior author, a professor in FAU's Department of Ocean and Mechanical Engineering within the College of Engineering and Computer Science, and a member of the FAU Center for Complex Systems and Brain Sciences and the FAU Stiles-Nicholson Brain Institute. "Our robotic glove is composed of soft, flexible materials and sensors that provide gentle support and assistance to individuals to relearn and regain their motor abilities."
Researchers integrated special sensor arrays into each fingertip of the robotic glove. Unlike prior exoskeletons, this new technology provides precise force and guidance in recovering the fine finger movements required for piano playing. By monitoring and responding to users' movements, the robotic glove offers real-time feedback and adjustments, making it easier for them to grasp the correct movement techniques.
To demonstrate the robotic glove's capabilities, researchers programmed it to feel the difference between correct and incorrect versions of the well-known tune, "Mary Had a Little Lamb," played on the piano. To introduce variations in the performance, they created a pool of 12 different types of errors that could occur at the beginning or end of a note, or due to timing errors that were either premature or delayed, and that persisted for 0.1, 0.2 or 0.3 seconds. Ten different song variations consisted of three groups of three variations each, plus the correct song played with no errors.
To classify the song variations, Random Forest (RF), K-Nearest Neighbor (KNN) and Artificial Neural Network (ANN) algorithms were trained with data from the tactile sensors in the fingertips. Feeling the differences between correct and incorrect versions of the song was done with the robotic glove independently and while worn by a person. The accuracy of these algorithms was compared to classify the correct and incorrect song variations with and without the human subject.
Results of the study, published in the journal Frontiers in Robotics and AI, demonstrated that the ANN algorithm had the highest classification accuracy of 97.13 percent with the human subject and 94.60 percent without the human subject. The algorithm successfully determined the percentage error of a certain song as well as identified key presses that were out of time. These findings highlight the potential of the smart robotic glove to aid individuals who are disabled to relearn dexterous tasks like playing musical instruments.
Researchers designed the robotic glove using 3D printed polyvinyl acid stents and hydrogel casting to integrate five actuators into a single wearable device that conforms to the user's hand. The fabrication process is new, and the form factor could be customized to the unique anatomy of individual patients with the use of 3D scanning technology or CT scans.
"Our design is significantly simpler than most designs as all the actuators and sensors are combined into a single molding process," said Engeberg. "Importantly, although this study's application was for playing a song, the approach could be applied to myriad tasks of daily life and the device could facilitate intricate rehabilitation programs customized for each patient."
Clinicians could use the data to develop personalized action plans to pinpoint patient weaknesses, which may present themselves as sections of the song that are consistently played erroneously and can be used to determine which motor functions require improvement. As patients progress, more challenging songs could be prescribed by the rehabilitation team in a game-like progression to provide a customizable path to improvement.
"The technology developed by professor Engeberg and the research team is truly a gamechanger for individuals with neuromuscular disorders and reduced limb functionality," said Stella Batalama, Ph.D., dean of the FAU College of Engineering and Computer Science. "Although other soft robotic actuators have been used to play the piano; our robotic glove is the only one that has demonstrated the capability to 'feel' the difference between correct and incorrect versions of the same song."
Study co-authors are Maohua Lin, first author and a Ph.D. student; Rudy Paul, a graduate student; and Moaed Abd, Ph.D., a recent graduate; all from the FAU College of Engineering and Computer Science; James Jones, Boise State University; Darryl Dieujuste, a graduate research assistant, FAU College of Engineering and Computer Science; and Harvey Chim, M.D., a professor in the Division of Plastic and Reconstructive Surgery at the University of Florida.
This research was supported by the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health (NIH), the National Institute of Aging of the NIH and the National Science Foundation. This research was supported in part by a seed grant from the FAU College of Engineering and Computer Science and the FAU Institute for Sensing and Embedded Network Systems Engineering (I-SENSE).
Read more:
Robotic glove that 'feels' lends a 'hand' to relearn playing piano after ... - Science Daily
- Robotics - Gizmag [Last Updated On: June 12th, 2016] [Originally Added On: June 12th, 2016]
- Download Microsoft Robotics Developer Studio 4 from ... [Last Updated On: June 16th, 2016] [Originally Added On: June 16th, 2016]
- Robotics News & Articles - IEEE Spectrum [Last Updated On: June 19th, 2016] [Originally Added On: June 19th, 2016]
- Robotics - Wikipedia, the free encyclopedia [Last Updated On: June 19th, 2016] [Originally Added On: June 19th, 2016]
- Robotics News & Articles - IEEE Spectrum [Last Updated On: June 19th, 2016] [Originally Added On: June 19th, 2016]
- RIA - Robotics Online - Industrial Robot Automation [Last Updated On: June 19th, 2016] [Originally Added On: June 19th, 2016]
- Three Laws of Robotics - Wikipedia, the free encyclopedia [Last Updated On: June 25th, 2016] [Originally Added On: June 25th, 2016]
- Robotics [Last Updated On: July 18th, 2016] [Originally Added On: July 18th, 2016]
- Houston Robotics [Last Updated On: August 12th, 2016] [Originally Added On: August 12th, 2016]
- Home - Illinois Tech Robotics [Last Updated On: August 27th, 2016] [Originally Added On: August 27th, 2016]
- Robotics - Wikibooks, open books for an open world [Last Updated On: September 8th, 2016] [Originally Added On: September 8th, 2016]
- JPL Robotics: Home Page [Last Updated On: September 8th, 2016] [Originally Added On: September 8th, 2016]
- ABB Robotics [Last Updated On: September 10th, 2016] [Originally Added On: September 10th, 2016]
- Softbank Robotics | Humanoid robotics & programmable robots [Last Updated On: September 29th, 2016] [Originally Added On: September 29th, 2016]
- Robotics - Wikipedia [Last Updated On: October 20th, 2016] [Originally Added On: October 20th, 2016]
- STEM Robotics 101 NXT | STEMRobotics [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Industrial Electronics and Robotics Technician [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Future of Robotics|Robots of the Future|Robot Links [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Industrial Robotics Training | School of Technology [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Robotics | An Open Access Journal from MDPI [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Robotics Technician & Automation Training - Online Course in ... [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Rich Hooper, PhD, PE: Robotics Engineer [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Robotics Toolbox - PeterCorke.com [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- ROBOTC | Robotics Academy [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- How have robots changed manufacturing? | HowStuffWorks [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Professional Development | Robotics Academy [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- Robotics Academy [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- KUKA Robotics | KUKA AG [Last Updated On: December 14th, 2016] [Originally Added On: December 14th, 2016]
- Robotics Engineer - Science Buddies [Last Updated On: December 24th, 2016] [Originally Added On: December 24th, 2016]
- Robotics - reddit [Last Updated On: January 10th, 2017] [Originally Added On: January 10th, 2017]
- Preorder Snap Flying Camera | Vantage Robotics [Last Updated On: January 25th, 2017] [Originally Added On: January 25th, 2017]
- Robotics - The Great Courses [Last Updated On: January 25th, 2017] [Originally Added On: January 25th, 2017]
- Belding hosts largest robotics competition in history of event - Greenville Daily News [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Robohub Digest 01/17: New year, new perspectives and forecasts for the year ahead in AI, machine learning and ... - Robohub [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Robotics-focused ETFs see big gains, Trump could hasten trend - MarketWatch [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Robotics competition events help teens express creativity - Monroe Evening News [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- First Tech Challenge: High schools battle in robotics competition - The Journal News | LoHud.com [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Gemini school robotics team wins in 'FIRST' competition - Chicago Tribune [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- TMRIES to impart robotics education - The Hindu - The Hindu [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Meridian robotics team gears up for Idaho FRC Regional - KBOI-TV [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- South High wins Volvo's robotics tournament - Herald-Mail Media [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Local robotics students headed to World Championship tournament - KOLO [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Oxford Hills robotics club to compete in North American championship - Lewiston Sun Journal [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Panther engineering and robotics team paves pathways to innovation - Clay County Free Press.com (subscription) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Shopping robots on the march in Ocado - BBC News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- OHS robotics club dazzles McKinley students - Southernminn.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Toyota Industries Acquires Warehouse Robotics Developer - WSJ - Wall Street Journal [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - Arizona State University [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Mount Paran Christian School Robotics Team has engineered their way to State Competition - MDJOnline.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- 33C3: Edible Soft Robotics - Hackaday [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Keller students Starstruck on robotics - Fort Worth Star Telegram [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- WPI Robotics Team Has a Mission with Mars | News | WPI - WPI News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Rethink's Robots Get Massive Software Upgrade, Rodney Brooks So Excited - IEEE Spectrum [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Front Porch: Vision Charter robotics teams perform well at state - Idaho Press-Tribune [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Raspberry Pi-powered arm: This kit aims to make robotics simple ... - TechRepublic [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Roam Robotics' lightweight, inexpensive exoskeleton for the masses - New Atlas [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - ScienceBlog.com (blog) [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rethink Robotics rethinks its software | ZDNet - ZDNet [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Home-schooled students studying robotics - Valencia County News Bulletin [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Botetourt 4-H Phoenix Robotics team sets sights on success - Roanoke Times [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Hartland robotics teams take on the FIRST Tech challenge at state competition - Lake Country Now [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- iFuture Robotics cuts manpower needs of warehouses with its mobile robots - YourStory.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Crescent Valley robotics focused on developing freshmen - Corvallis Gazette Times [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- CyPhy, Mitsubishi, and Soft Robotics Join Robo Madness on March 28 - Xconomy [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Agility Robotics Introduces Cassie, a Dynamic and Talented Robot ... - IEEE Spectrum [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- FIRST Robotics Competition - Wikipedia [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Raptor legs & human hips: Giant leap for walking robots - RT [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Patriot Robotics Alliance upsets Brentwood Academy Alliances - Clarksville Now [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- South Beach robotics squad advances to super regionals - The Daily World [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- How drones and robotics may shape the future of conflict under President Trump - PRI [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Personal robotics the next technological revolution: Dr Vivian Balakrishnan - Channel NewsAsia [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Ford Bets $1B on Startup Founded by Waymo, Uber Vets - ABC News [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Woodall robotics team competes in Broken Arrow - Muskogee Daily Phoenix [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Students Compete in LEGO Robotics Design Contest in Brooklyn - NY1 [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Essex County Freeholders Honor Livingston Robotics Club Teams - TAPinto.net [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Robotics event offers lesson in teamwork - Lewiston Morning Tribune (subscription) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Face off: Marion students compete in robotics competition - The Exponent Telegram (press release) (registration) [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Freshman Caldwell team takes first place in Regional Robotics Tournament - Idaho Press-Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Ford Motor bets $1 billion on robotics startup - Toledo Blade [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Alice Shaw robotics team building invention to save wolves | Local ... - Lompoc Record [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]