A team of researchers at Carnegie Mellon University and other institutions have released an early version of an app that they claim can determine whether you might have COVID-19, just by analyzing your voice.
“I’ve seen a lot of competition for the cheapest, fastest diagnosis you can have,” said Benjamin Striner, a Carnegie Mellon graduate student who worked on the project, in an interview with Futurism. “And there are some pretty good ones that are actually really cheap and pretty accurate, but nothing’s ever going to be as cheap and as easy as speaking into a phone.”
That’s a provocative claim in the face of the global coronavirus outbreak, and particularly the widespread shortages of testing kits. But Striner believes that the team’s algorithm, even though it’s still highly experimental, could be a valuable tool in tracking the spread of the virus, especially as the team continues to refine its accuracy by collecting more data.
You can use the COVID Voice Detector now to analyze your own voice for signs of infection, though it comes with a hefty disclaimer that it’s “not a diagnostic system,” not approved by the FDA or CDC, and shouldn’t be used as a substitute for a medical test or examination.
The researchers behind the project emphasize that the app is a work in progress.
“What we are attempting to do is to develop a voice-based solution, which, based on preliminary experiments and prior expertise, we believe is possible. The app’s results are preliminary and untested,” said Bhiksha Raj, a professor at Carnegie Mellon who also worked on the project. “The score the app currently shows is an indicator of how much the signatures in your voice match those of other COVID patients whose voices we have tested. This is not medical advice. The primary objective of our effort/website at this point of time is to collect large numbers of voice recordings that we could use to refine the algorithm into something we — and the medical community — are confident about.”
“If the app is to be put out as a public service, it, and our results, will have to be verified by medical professionals, and attested by an agency such as the CDC,” Raj added. “Until that happens, its still very much an experimental and untrustworthy system. I urge people not to make healthcare decisions based on the scores we give you. You could be endangering yourself and those around you.”
And at the end of the day, it’s unlikely the app will ever be as accurate as a laboratory test.
“In terms of diagnostics, of course, it’s never going to be as as accurate as taking a swab and putting it on some agar and waiting for it to grow,” said Striner, who has been working around the clock to prepare the app for release. “But in terms of very easily monitoring a ton of people daily, weekly, whatever, monitoring on a very large scale, it gives you a way to handle and track health outbreaks.”
If you have a smartphone or a computer with a microphone, using the app is simple. Users are prompted to cough several times and record a number of vowel sounds, as well as reciting the alphabet. Then it provides a score, expressed as a download-style progress bar, representing how likely the algorithm believes it is that the user has COVID-19.
Also working on the project is Rita Singh, a professor of computer science at Carnegie Mellon who for years has been creating algorithms that identify micro-signatures in the human voice that she believes reveal psychological, physiological, and even medical data about an individual subject.
“The cough of a COVID patient is very distinctive,” Singh said. “It affects the lungs so badly that breathing patterns and several other vital parameters are affected, and those are likely to have very strong signatures in voice.”
A challenge for Singh and Striner’s team of ten Carnegie Mellon researchers — who have all been working on the app from home, the campus is shut down due to the pandemic — has been gathering enough audio from confirmed COVID-19 patients, in order to train the algorithm.
To gather that data, the team reached out to colleagues around the world. Those colleagues didn’t just help them gather audio from COVID-19 patients, but also patients with other viruses, so that they could teach the algorithm to spot the differences. They even pored over news videos to find interviews with patients, and add those to the dataset as well.
“You have samples of people that are healthy, you have samples of people that might just have the flu,” Striner said. “And you have all those different recordings of all the different types of coughs, like what are all the coughs that are out there? And then that allows you to kind of spot the differences.”
It’s difficult to quantify the current version of the app’s accuracy, and both Striner and Singh reiterated that its output shouldn’t be treated as medical advice.
“Its accuracy cannot be tested currently because we don’t have the verified test instances we need,” Singh said, adding that the more people who use the app — healthy or otherwise — the more data they will have to better train the algorithm. “If it comes from a healthy person, we then have examples of what ‘healthy’ sounds like. If it comes from a person who has some known respiratory condition, we then know what that condition sounds like. The system will use all that data as counterexamples, and for disambiguating COVID signatures from those of other confusing conditions.”
Ashwin Vasan, a professor at Columbia University Medical Center who was not involved in the Carnegie Mellon research, expressed reservations about releasing the app during a moment of global health crisis.
“Despite what could be a well-intentioned attempt by a bunch of engineers to help during this crisis, this is not exactly the messaging we want to be out there,” he cautioned. “That somehow there is a nifty new tool we can use to diagnose coronavirus, in absence of the things we really need much more of, actual test kits, serologic testing, PPE for frontline healthcare workers, and ventilators for critically ill patients.”
“Let’s keep the focus on that, especially when our leaders in Washington seem unable to meet those most basic needs,” he added. “Anything else is just a distraction.”
For their part, the Carnegie Mellon team says they’re grappling with the public health implications of the app. Striner said that they’ve consulted with colleagues in the medical research community, and that they carefully considered how to fine-tune the app’s sensitivity.
“We would probably side more towards having some false positives then false negatives, if that make sense,” Striner said. “If you give someone a false negative on COVID, then they walk around and get a bunch of people sick, versus a couple extra false positives, maybe some people get tests they don’t need.”
Editor’s note March 31: This story has been updated with additional remarks from Dr. Bhiksha Raj.
The post New App Attempts to Detect Signs of COVID-19 Using Voice Analysis appeared first on Futurism.
Originally posted here:
New App Attempts to Detect Signs of COVID-19 Using Voice Analysis
- Futurist Serata featuring artist Luca Buvoli at Brown (Nov. 20) [Last Updated On: November 7th, 2009] [Originally Added On: November 7th, 2009]
- FUTUR1SM00GGI [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- ‘Futurism on Film’ Series this month in NYC [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Schedule of Futurist Events in NYC (PERFORMA 09: Nov 1-22) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- ‘Futurismo/Futurizm: The Futurist Avant-Garde in Italy and Russia’ (Nov. 13 + 14) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- ‘Beyond Futurism: F.T. Marinetti, Writer’ conference at Columbia (Nov. 12+13) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Futurism and Cars at the Museo Nicolis [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- MoMA Film Series Marks Centenary of Futurism with Films [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- ‘Bergson+Futurism. Speed in thought’ - Madrid (Nov. 5) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- ‘The Future in Five Senses: Echoes of Italian Futurism in New York Architecture and Design’ Nov. 16th NYC [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- New World-Wide Climate Treaty in 2010 More Likely [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Tar Sands CCS Myth Shattered [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Smart Grid and Smart Meters Get Big Grants [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Pollution Makes Methane Even More Dangerous [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Climate Change Bill Hearing Video [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- New Satellite to Monitor Water and Plant Growth [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Spiritual Battle Awaits the Deniers and Skeptics [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Effects of Climate Change are Observed World-Wide [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Get Yer Global Warming Science Here [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- TckTckTck Wake up Call — Delay Kills [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Canada’s Awful Gold Rush [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Climate Change Talks Spark Global Backlash by Businesses [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- World May Need Extra Year for Climate Treaty [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Senator Boxer Moves Climate Bill Despite Republican Obstructionism [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Lights out for incandescent lights? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Sutures from Bacteria [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Remote-Controlled Pigeons [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Apple Announces iPhone Release Date [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- UK Government Envisions a Grim Future [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Top Ten Emerging Technologies for the Environment [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- DIY Mobile Networks [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Stem-Cell Treatment Cures Type 1 Diabetes [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Is Tesla Getting the Electric Car Right? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Future of TV News [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Bruce Sterling on Earth-Friendly Pervasive Computing [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- First Step Toward Organ Regeneration in Humans [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- IBM's "Five in Five" [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Outsourced Journalism [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Is True Global Democracy the Next Great Political Movement? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The Risks of Autonomous Robots [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Microsoft Introduces "Tabletop" PC [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Britain Piloting First Biofueled Train [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Self-Healing Plastic [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Bird Population Falls Over Past 40 Years [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The iPhone Revolution? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The End of "Cheap Food"? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How to Stop -- Or Live With -- Global Warming [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- MIT Demonstrates "Wireless Electricity" [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Unintended Consequences of Biofuels [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Time to Focus on the Big Picture in Copenhagen [Last Updated On: December 12th, 2009] [Originally Added On: December 12th, 2009]
- Protests in Copenhagen [Last Updated On: December 12th, 2009] [Originally Added On: December 12th, 2009]
- Mario Guido Dal Monte exhibit [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Futurism News Bulletin, xvi [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Viva il Futurismo! (video trailer) [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- 3 exhibits in Gorizia! [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Forthcoming: ‘Antidiets of the Avant-garde’ by Cecilia Novero [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Pubblicità e propaganda. Ceramica e grafica futuriste at the Wolfsoniana [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Balla’s home scheduled to open in 2010 [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Futurismo a Savona [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- ‘Zang Sud Sud’, Cosenza [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Conference in Rome (Dec. 10) [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Climate Hackergate: A Well-Orchestrated Campaign of Harassment [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- The Sad Story of Cap and Trade [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- How to Waste Trillions on Capturing Carbon [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Smack the Email Hack Attack [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- EPA About to Declare CO2 a Public Danger [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Copenhagen Summit Starts with Virtually There Media [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Climate Scientist Gets Blunt on Trading Scheme [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- One Climate Change Editorial in 56 Newspapers, 45 Countries [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- This Decade Will be Hottest Ever on Record [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Divide and Conquer [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Leave the Coal in the Hole! [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- COP15: Two Agreements Coming [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Climate and Copenhagen News December 10 [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Sea Level Already Rising on Atlantic Coast [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- ‘Umbria Veloce’ in Perugia [Last Updated On: December 14th, 2009] [Originally Added On: December 14th, 2009]
- An Instable CO2-Filled Ocean [Last Updated On: December 14th, 2009] [Originally Added On: December 14th, 2009]
- ‘Futurismi a Ravenna’ opens Dec. 19 [Last Updated On: December 15th, 2009] [Originally Added On: December 15th, 2009]
- ‘Futurism and the Technological Imagination’ – 30% discount until Jan. 15 [Last Updated On: December 15th, 2009] [Originally Added On: December 15th, 2009]
- Protecting Our Lungs at Copenhagen [Last Updated On: December 15th, 2009] [Originally Added On: December 15th, 2009]