The field of machine learning and artificial intelligence is making rapid progress. Many people are starting to ask what a world with intelligent computers will look like. But what is the ratio of hype to real progress? What kinds of problems have been well solved by current machine learning techniques, which ones are close to being solved, and which ones remain exceptionally hard?
There isnt currently a good single place to find the state of the art on well-specified machine learning metrics, let alone the many problems in artificial intelligence that are still so hard that there are no good datasets and benchmarks to keep track of them yet. So we are trying to make one. Today, were launching the EFF AI Progress Measurement experiment, and encouraging machine learning researchers to give us feedback and contribute to the effort.
We have drawn data from a number of sources: blog posts that report on snapshots of progress; websites that try collate data on specific subfields of machine learning; and review articles. Where those sources didnt have coverage, weve gone to the research literature itself and gathered data.
Weve placed this information in an Jupyter / IPython Notebook, which you can read at https://eff.org/ai/metrics. The Notebook is hosted on Github, where the community can directly contribute.
What we have thus far is an experiment, and wed like to know: Is this information useful to the machine learning community? What important problems, datasets, and results are we missing?
EFFs interest in AI progress is primarily from a policy perspective. We want to know what types of AI we need to start engaging with on legal, political, and technical safety fronts. Beyond that, were also just excited to see how many things computers are learning to do over time.
Given that machine learning tools and AI techniques are increasingly part of our everyday lives, it is critical that journalists, policy makers, and technology users understand the state of the field. When improperly designed or deployed, machine learning methods can violate privacy, threaten safety, and perpetuate inequality and injustice. Stakeholders must be able to anticipate such risks and policy questions before they arise, rather than playing catch-up with the technology. To this end, its part of the responsibility of researchers, engineers, and developers in the field to help make information about their life-changing research widely available and understandable. We hope youll join us.
Visit link:
Help EFF Track the Progress of AI and Machine Learning - EFF
- Progress Lighting - Home [Last Updated On: December 22nd, 2016] [Originally Added On: December 22nd, 2016]
- Home - Progress Lighting Outlet - Authorized Progress Dealer [Last Updated On: January 13th, 2017] [Originally Added On: January 13th, 2017]
- What does progress mean? - Definitions.net [Last Updated On: January 13th, 2017] [Originally Added On: January 13th, 2017]
- Progress Fire Company Harrisburg, PA [Last Updated On: January 13th, 2017] [Originally Added On: January 13th, 2017]
- Homepage Center for American Progress [Last Updated On: January 13th, 2017] [Originally Added On: January 13th, 2017]
- Progress being made on possible grocery store co-op in Winston-Salem - myfox8.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Nioh Review-in-Progress: FromSoftware's Formula Evolved - Shacknews [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Deutsche Bundesbank Cites Progress With Blockchain-Based Settlement - CryptoCoinsNews [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- IMF: Greece's debts are still unsustainable despite progress - The Seattle Times [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Think Progress Editor Mocks Audi for Equal Pay Super Bowl Ad - Breitbart News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Progress apparent on defense - Pittsburgh Steelers - Steelers.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- IMF: Greece's Debts are Still Unsustainable, Despite Progress - Voice of America [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Can US disrupter-in-chief trigger some progress? - Jerusalem Post Israel News [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- The Cost of Progress - Slate Magazine [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Cavaliers' pitching rotation a work in progress | Cavalier Insider ... - The Daily Progress [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- High schoolers create 'zines for progress' with WolfsonianFIU - FIU News [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Cries of 'dictator' show Pope Francis is making progress - Crux: Covering all things Catholic [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Officials: City is making progress in effort to address opioid crisis - The Union Leader [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- IN OUR VIEW: Work Ready in Progress for Carter - The Independent [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- BP's Earnings Keep Showing Progress, Even if the Headline Results Don't Say So - Motley Fool [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Women's Progress in the Boardroom Took a Hit in 2016 - Inc.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Blight Elimination Progress, Uplifting - MyWabashValley [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rauner 'heartened' by progress in Springfield - Bloomington Pantagraph [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- David Johnson showed off the insane progress he's making in rehab from his knee injury - USA TODAY [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Through the looking glass: Tower view showcases progress on Amazon's unique biospheres - GeekWire [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Britney Spears Says Niece Maddie Is 'Making Progress' After ATV Accident: 'Let's All Keep Praying' - PEOPLE.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Progress on vet's Mustang to be unveiled - Indianapolis Star [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Evgeni Malkin making 'progress,' could return Saturday in Arizona - Pittsburgh Post-Gazette [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Forecasters See Slow Progress in Labor-Market Measures Favored by Trump Administration - Wall Street Journal [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- 'Paper boys' were the lifeblood of The Daily Progress - The Daily Progress [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Cliffs Natural Resources Is Showing a Lot of Progress on Its Return to Profitability - Motley Fool [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- ATA says states' telemedicine progress a mixed bag ... - FierceHealthcare [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Seltzer's Notebook | Colangelo Encouraged by Sixers' Progress - Sixers.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- The Trump administration can't entirely roll back progress on climate change here's why - Washington Post [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Colts position review: OL showed legit progress, but work remains - Indianapolis Star [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Egyptian Economy Making Slow, Tentative Progress - Voice of America [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- ATA: States show mixed progress with telemedicine | Healthcare Dive - Healthcare Dive [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Louisville City notes: McCabe making progress - The Courier-Journal [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Jeremy Lin: Progress but no timetable - NetsDaily [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Marginal progress for Turkish-backed forces in north Syria - LA Daily News [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Jimmy Cheek: UT chancellor appreciative of hard work, progress on journey - Knoxville News Sentinel [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Syria Regional Crisis 2016 Emergency Appeal - Progress Report - Reliefweb [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- CWLP officials: Bailout repayment would set back progress - The State Journal-Register [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Pistons' Johnson making halting but definite progress - The Detroit News [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Clairton works: Real progress is coming to the former steel town - Pittsburgh Post-Gazette [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- The Democrats' Strategy: Hindering Progress For Partisan Politics - Daily Caller [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- The surprising progress stoppers on the Dallas Cowboys defensive line - Cowboys Wire [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Gender Progress in Ballet - Huffington Post [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Foyt pleased with progress, regrets lack of time - Motorsport.com, Edition: Global [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Progress Made, but Threat Lingers at California's Oroville Dam - Wall Street Journal [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Adele, Beyonc, and the Grammys' Fear of Progress - The Atlantic [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- North Korea Claims Progress on Long-Range Goal With Missile Test - New York Times [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- How Travel Bans Can Impede America's Progress - Forbes - Forbes [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Jeff Sessions' appointment threatens decades of civil rights progress - The Hill (blog) [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Ionis Earns $75M Milestone from Bayer for Progress of Antisense Drug Program - Genetic Engineering & Biotechnology News (press release) [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Guilford Schools annual report shows mixed results on progress - Greensboro News & Record (blog) [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Sniper Elite 4 review in progress - PC Gamer [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- For Honor Review In Progress - GameSpot [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- China's military progress challenges Western dominance, says IISS - Deutsche Welle [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- PFW in Progress Recap 2/14: Patriots Offseason Outlook | New ... - Patriots.com [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Daily Progress, chamber establish regional business Hall of Fame - The Daily Progress [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Huntsville-based Progress Bank to acquire Birmingham's First Partners Bank - Birmingham Business Journal [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- City, UF sign partnership for progress - Gainesville Sun [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- California officials lift evacuation order for 200000 threatened by damaged dam - CBS News [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- 5G progress at Ericsson could help enterprises work worldwide - Computerworld [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Officials making 'great progress' on California dam repairs, remind residents to stay vigilant - Fox News [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Halo Wars 2 Review in Progress - IGN [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- CUGNON: Forward progress - Yale Daily News (blog) [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- F-35 Program Makes Significant, Solid Progress, Official Says - Department of Defense [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Lenovo's data center ambitions remain work in progress following Q3 results - ZDNet [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- PFW in Progress Recap 2/16: Free Agency and Potential Patriots - Patriots.com [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- S&P 500: 'Blow-off' Phase in Progress - DailyFX [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Combine invites are another sign of progress at Michigan - Big Ten ... - ESPN (blog) [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Halo Wars 2 review in progress - PC Gamer [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- 'Hero' film produced just for Charlottesville featured the mayor, The Daily Progress - The Daily Progress [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Republicans' health care overhaul still a work in progress - Press Herald [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Trump Boasts Of 'Incredible Progress' In 4 Weeks Of Presidency - NPR [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Donald Trump touts promise progress at press conference - PolitiFact [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Mild winter helping crews make significant progress on East End Connector - WRAL.com [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Committee updates Legislature on precinct consolidation progress - Chicago Tribune [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]