Layer 8 is written by Michael Cooney, an online news editor with Network World.
IBM this week said its speech recognition system set an industry record of 5.5% word error rate, a percentage that lets a computer understand human conversation almost as well as the average person does.
According to IBM human parity was considered a 5.9% word error rate but IBM who partnered with Appen, a speech and technology service provider, reassessed the industry benchmark and determined that human parity is lower than what anyone has yet achieved: 5.1%.
+More on Network World: Gartner: Artificial intelligence, algorithms and smart software at the heart of big network changes+
Reaching human parity meaning an error rate on par with that of two humans speaking has long been the ultimate industry goal. Others in the industry are chasing this milestone alongside us, and some have recently claimed reaching 5.9% as equivalent to human paritybut were not popping the champagne yet. As part of our process in reaching todays milestone, we determined human parity is actually lower than what anyone has yet achieved at 5.1%, wrote George Saon principal research scientist with IBM in a blog post on the subject.
That reassessment however might ruffle some feathers as in October Microsoft Artificial Intelligence and Research group said its speech recognition system had attained human parity and made fewer errors than a human professional transcriptionist.
The error rate of professional transcriptionists is 5.9% for the Switchboard portion of the data, in which newly acquainted pairs of people discuss an assigned topic, and 11.3% for the CallHome portion where friends and family members have open-ended conversations. In both cases, our automated system establishes a new state-of-the-art, and edges past the human benchmark. This marks the first time that human parity has been reported for conversational speech, the researchers wrote in their paper. Switchboard is a standard set of conversational speech and text used in speech recognition tests.
The 5.9% error rate is about equal to that of people who were asked to transcribe the same conversation, and its the lowest ever recorded against the industry standard Switchboard speech recognition task, Microsoft wrote on its web site.
IBMs Saon wrote: We also realized finding a standard measurement for human parity across the industry is more complex than it seems. Beyond SWITCHBOARD, another industry corpus, known as CallHome, offers a different set of linguistic data that can be tested, which is created from more colloquial conversations between family members on topics that are not pre-fixed. Conversations from CallHome data are more challenging for machines to transcribe than those from SWITCHBOARD, making breakthroughs harder to achieve. (On this corpus we achieved a 10.3 percent word error rate another industry record but again, with Appens help, measured human performance in the same situation to be 6.8 percent).
Also from the IBM blog, Julia Hirschberg, a professor and Chair at the Department of Computer Science at Columbia University, commented on the challenge of speech recognition:
The ability to recognize speech as well as humans do is a continuing challenge, since human speech, especially during spontaneous conversation, is extremely complex.Its also difficult to define human performance, since humans also vary in their ability to understand the speech of others. When we compare automatic recognition to human performance its extremely important to take both these things into account: the performance of the recognizer and the way human performance on the same speech is estimated, she shared.
Speech recognition breakthroughs come after decades of research in speech recognition, beginning in the early 1970s with DARPA, Microsoft wrote. Over time, most major technology companies and many research organizations have developed speech recognition technologies including BBN, Google, Microsoft, Hewlett Packard and IBM.
Check out these other hot stories:
Juniper product development chief resigns, company resets engineering makeup
Cisco Talos warns of new Cryptolocker ransomware campaigns
Extreme grabs Avayas networking business for $100M
Cisco reinforces HyperFlex hyperconvergence system with power, management features
U.S. Marshals warn against dual phone scams
Avaya wants out of S.F. stadium suite, not too impressed with 49ers either
Cisco warns of NetFlow appliance vulnerability
Cisco Jasper grows Internet of Things reach, breadth
Cisco tries to squash Smart Install security abuse
Space X to zoom two citizen astronauts to the moon
Verizon and Cisco team to bring 5G network pilot program to the masses
IBM, Vermont Electric spawn intelligent energy software company
11 low-tech, decidedly cool cars
Read more:
IBM technology moves even closer to human speech recognition parity - Network World
- Technology Synonyms, Technology Antonyms | Thesaurus.com [Last Updated On: January 7th, 2017] [Originally Added On: January 7th, 2017]
- Information technology - Wikipedia [Last Updated On: January 7th, 2017] [Originally Added On: January 7th, 2017]
- Technology and Electronics Reviews - USATODAY.com [Last Updated On: January 7th, 2017] [Originally Added On: January 7th, 2017]
- Technology Forum - reddit.com [Last Updated On: January 7th, 2017] [Originally Added On: January 7th, 2017]
- Technology: Industries: PwC [Last Updated On: January 22nd, 2017] [Originally Added On: January 22nd, 2017]
- National Education Technology Plan - Office of Educational ... [Last Updated On: January 22nd, 2017] [Originally Added On: January 22nd, 2017]
- Technology News - The New York Times [Last Updated On: January 24th, 2017] [Originally Added On: January 24th, 2017]
- Computer Business Review - Computer Business Review [Last Updated On: January 24th, 2017] [Originally Added On: January 24th, 2017]
- Technology - Pogue's Posts Blog - The New York Times [Last Updated On: February 2nd, 2017] [Originally Added On: February 2nd, 2017]
- What the Tech: Neuro-Bio Monitor Technology - KFDX [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Globalization failed too many people. Here's the technology that could help it work for everyone - Quartz [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Bill Nye forecasts next 50 years, says we're at a technological crossroad - Digital Trends [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Interview with Matt Nix about his new Fox show APB. - Slate - Slate Magazine [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- In This Year's Super Bowl Of Technology, Intel Led The Way With A Sky Full Of Drones - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Learning From Last Year: Technology Funding Outlooks For 2017 - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Ossia hires new CEO to help commercialize its wireless charging technology - GeekWire [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Microsoft's AI group debuts customizable speech-to-text technology, rapidly expanding 'cognitive services' for ... - GeekWire [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- A flare for self-destruction: How technology is the means, not the cause, of our demise - National Post [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Broadcaster dangles new technology for Winter Olympics - Reuters [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- These Four Black Women Inventors Reimagined the Technology of the Home - Smithsonian [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- How 3D and Self-Design Will Change Technology - Huffington Post [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Factory Boss Says Fishing Technology Could Improve Controversial US Border Wall - Voice of America [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Republicans Aim to Kill Election Technology Standards Agency - Gizmodo [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Solutions replace technology as the focus at ISE 2017 - Installation International [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Five Rules That Define The Technology Innovator - Forbes [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Three Ways That Digital Technology Can Help Chemical Producers - Forbes [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Cinematographers Deploy Innovative Technology to Create Better Images - Variety [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- How Technology Transforms Dreamers Into Economic Powerhouses - Forbes [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Coming technology will likely destroy millions of jobs. Is Trump ready? - Washington Post [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Mysterious $5 Billion Biotech Moderna Hit With Legal Setback Related To Key Technology - Forbes [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Berlinale: Jury Talks Up Art But Politics and Technology Enter Discussion - Variety [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Opinion: Harry Boxer's stocks to watch: biotechnology and technology - MarketWatch [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Nasdaq plans venture arm to invest in financial technology: sources - Reuters [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- A modern-day Rosie the Riveter campaign: Women in technology - The Hill (blog) [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- A growing concern: Technology and transportation - Florida Today [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Top 10 Mobility Technologies Market by Technology & Geography - Global Forecast to 2022 - Yahoo Finance [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Volvo melds technology and luxury in the XC90 T8 hybrid - Engadget [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- CEFC warns against risky investment in 'clean coal' technology - The Guardian [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Scientist calls for industrial scale-up of greenhouse gas-eating microbe technology in UK - Phys.Org [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Software company introduces game-changing technology for Michigan Realtors - HousingWire [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- New laser technology enables more sensitive gravitational-wave detectors - Phys.Org [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Why Quotient Technology Inc. Stock Surged 21% Higher on Friday - Fox Business [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- How Technology Is Improving Influencer Marketing (And Can Help Improve Your Brand) - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Hands-on: EVGA's sensor-laden iCX technology revolutionizes ... - PCWorld [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- New Ground Technology uses digital graphics on turf - Golf Channel [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Facing State System review, Cal U to emphasize science and technology - Pittsburgh Post-Gazette [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- International Game Technology: A Lottery Bet That's Paying Off - Barron's [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Our seas have become a plastic graveyard - but can technology turn the tide? - Telegraph.co.uk [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Technology identifying fastest checkout lanes comes to metro - KCCI Des Moines [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- This Technology Could Be a Game-Changer for the Marijuana Industry - Fox Business [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Editorial: Higher education and technology are job creators, so why is the governor cutting their funding? - STLtoday.com [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- BLAEDC: Entrepreneurs find a technology-friendly home in the Brainerd lakes area - Brainerd Dispatch [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Small cell technology is large endeavor for state - Crain's Cleveland Business [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Eye tracking technology will change these 4 domains - The Next Web [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- The technology fixing Britain's parking problem - The Independent [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Tim Cook: Augmented Reality is as big of a technology as the smartphone - BGR [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- How technology is encouraging society to be stupid - The Next Web [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- IBM Adds Voice Help to Cybercrime-Fighting Watson-Powered Weaponry - Campus Technology [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Market Higher As 4 Key Steel, Technology Stocks Top Buy Points - Investor's Business Daily [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- A look at North Korea's missile launches and technology - ABC News [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- The CFO Imperative: Next-Gen Technology Drives Cost Optimization - Knowledge@Wharton [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Technology puts 'touch' into long-distance relationships - Phys.Org [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- A New Angel Investing Platform Connects Deep Technology And Science Startups With Capital - Forbes [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Formula 1 now capable of 'internet' broadcasts with new technology - autosport.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- How dangerous is technology? - OUPblog (blog) [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Apple's Eddy Cue says technology companies have a responsibility to combat fake news - Recode [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Valentine's day: what's your secret technology crush? - Naked Security [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Parents and technology How much is too much? - WGBA-TV [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Is Magic Leap Lying About Its Acid Trip Technology? - Vanity Fair [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- BYU-Idaho dedicates and showcases new Science and Technology Center - LocalNews8.com [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Even Indian technology entrepreneurs think they are living in a ... - Quartz [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- 3 tips for regulating our kids' technology use - The Herald-Times (subscription) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Don Cunningham column: Technology giveth, and it taketh away - Allentown Morning Call [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Warren Buffett's Increasing Passion For Apple And Technology - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- DNA technology gives new face to decade-old cold case - The San Diego Union-Tribune [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Can Technology Really Solve China's Healthcare Crisis? - Forbes - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Emerging technology is keyword: Demand for experts in robotics & big data up 50% - Economic Times [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Five technologies that will change how we live - Financial Times [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Football League agrees to use goalline technology in Championship - The Guardian [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Telecom operators navigate three technology transformation options - TechTarget [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]