One of the most hopeful proposals involving police surveillance emerged recently from a surprising quarter the federal Office of Management and Budget. The office, which oversees the execution of the presidents policies, has recommended sorely needed constraints on the use of artificial intelligence by federal agencies, including law enforcement.
The offices work is commendable, but shortcomings in its proposed guidance to agencies could still leave people vulnerable to harm. Foremost among them is a provision that would allow senior officials to seek waivers by arguing that the constraints would hinder law enforcement. Those law enforcement agencies should instead be required to provide verifiable evidence that A.I. tools they or their vendors use will not cause harm, worsen discrimination or violate peoples rights.
As scholars of algorithmic tools, policing and constitutional law, we have witnessed the predictable and preventable harms from law enforcements use of emerging technologies. These include false arrests and police seizures, including a family held at gunpoint, after people were wrongly accused of crimes because of the irresponsible use of A.I.-driven technologies including facial recognition and automated license plate readers.
Consider the cases of Porcha Woodruff, Michael Oliver and Robert Julian-Borchak Williams. All were arrested between 2019 and 2023 after they were misidentified by facial recognition technology. These arrests had indelible consequences: Ms. Woodruff was eight months pregnant when she was falsely accused of carjacking and robbery; Mr. Williams was arrested in front of his wife and two young daughters as he pulled into his driveway from work. Mr. Oliver lost his job as a result.
All are Black. This should not be a surprise. A 2018 study co-written by one of us (Dr. Buolamwini) found that three commercial facial-analysis programs from major technology companies showed both skin-type and gender biases. The darker the skin, the more often the errors arose. Questions of fairness and bias persist about the use of these sorts of technologies.
Errors happen because law enforcement deploys emerging technologies without transparency or community agreement that they should be used at all, with little or no consideration of the consequences, insufficient training and inadequate guardrails. Often the data sets that drive the technologies are infected with errors and racial bias. Typically, the officers or agencies face no consequences for false arrests, increasing the likelihood they will continue.
The Office of Management and Budget guidance, which is now being finalized after a period of public comment, would apply to law enforcement technologies such as facial recognition, license-plate readers, predictive policing tools, gunshot detection, social media monitoring and more. It sets out criteria for A.I. technologies that, without safeguards, could put peoples safety or well-being at risk or violate their rights. If these proposed minimum practices are not met, technologies that fall short would be prohibited after next Aug. 1.
Here are highlights of the proposal: Agencies must be transparent and provide a public inventory of cases in which A.I. was used. The cost and benefit of these technologies must be assessed, a consideration that has been altogether absent. Even if the technology provides real benefits, the risks to individuals especially in marginalized communities must be identified and reduced. If the risks are too high, the technology may not be used. The impact of A.I.-driven technologies must be tested in the real world, and be continually monitored. Agencies would have to solicit public comment before using the technologies, including from the affected communities.
The proposed requirements are serious ones. They should have been in place before law enforcement began using these emerging technologies. Given the rapid adoption of these tools, without evidence of equity or efficacy and with insufficient attention to preventing mistakes, we fully anticipate some A.I. technologies will not meet the proposed standards and their use will be banned for noncompliance.
The overall thrust of the federal A.I. initiative is to push for rapid use of untested technologies by law enforcement, an approach that too often fails and causes harm. For that reason, the Office of Management and Budget must play a serious oversight role.
Far and away, the most worrisome elements in the proposal are provisions that create the opportunity for loopholes. For example, the chief A.I. officer of each federal agency could waive proposed protections with nothing more than a justification sent to the Office of Management and Budget. Worse yet, the justification need only claim an unacceptable impediment to critical agency operations the sort of claim law enforcement regularly makes to avoid regulation.
This waiver provision has the potential to wipe away all that the proposal promises. No waiver should be permitted without clear proof that it is essential proof that in our experience law enforcement typically cannot muster. No one person should have the power to issue such a waiver. There must be careful review to ensure that waivers are legitimate. Unless the recommendations are enforced strictly, we will see more surveillance, more people forced into unjustified encounters with law enforcement, and more harm to communities of color. Technologies that are clearly shown to be discriminatory should not be used.
There is also a vague exception for national security, a phrase frequently used to excuse policing from legal protections for civil rights and against discrimination. National security requires a sharper definition to prevent the exemption from being invoked without valid cause or oversight.
Finally, nothing in this proposal applies beyond federal government agencies. The F.B.I., the Transportation Security Administration and other federal agencies are aggressively embracing facial recognition and other biometric technologies that can recognize individuals by their unique physical characteristics. But so are state and local agencies, which do not fall under these guidelines. The federal government regularly offers federal funding as a carrot to win compliance from state and local agencies with federal rules. It should do the same here.
We hope the Office of Management and Budget will set a higher standard at the federal level for law enforcements use of emerging technologies, a standard that state and local governments should also follow. It would be a shame to make the progress envisioned in this proposal and have it undermined by backdoor exceptions.
Joy Buolamwini is the founder of the Algorithmic Justice League, which seeks to raises awareness about the potential harms of artificial intelligence, and the author of Unmasking AI: My Mission to Protect What Is Human in a World of Machines. Barry Friedman is a professor at New York Universitys School of Law and the faculty director of its Policing Project. He is the author of Unwarranted: Policing Without Permission.
Read more from the original source:
Opinion | A.I. Use by Law Enforcement Must Be Strictly Regulated - The New York Times
- European parliament prepares tough measures over use of AI - Financial Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Nvidia stock surges on dominant A.I. market position, buy recommendation from HSBC - Fox Business [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Bloomberg plans to integrate GPT-style A.I. into its terminal - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Deepfake porn could be a growing problem amid AI race - The Associated Press [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Workforce ecosystems and AI - Brookings Institution [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Adobe Lightroom AI Feature Tackles a Massive Problem With Photos - CNET [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- How artificial intelligence is matching drugs to patients - BBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- These are the tech jobs most threatened by ChatGPT and A.I. - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Elon Musk Launches X.AI To Fight ChatGPT Woke AI, Says Twitter Is Breakeven - Forbes [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Two late iconic Israeli singers have been resurrected via AI for a ... - JTA News - Jewish Telegraphic Agency [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- AI anxiety: The workers who fear losing their jobs to artificial ... - BBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Grandma exploit tricks Discords AI chatbot into breaking its rules - Polygon [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Commonwealth joins forces with global tech organisations to ... - Commonwealth [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- The power players of retail transformation: IoT, 5G, and AI/ML on Microsoft Cloud - CIO [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- AI is the word as Alphabet and Meta get ready for earnings - MarketWatch [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Purdue launches nation's first Institute of Physical AI (IPAI), recruiting ... - Purdue University [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Will AI ever reach human-level intelligence? We asked 5 experts - The Conversation [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- The next arms race: China leverages AI for edge in future wars - The Japan Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Amazon Unleashes Bedrock: The Game-Changing AI Cloud Service Powering the Future of Tech - Yahoo Finance [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Atlassian taps OpenAI to make its collaboration software smarter - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Dating an AI? Artificial Intelligence dating app founder predicts the future of AI relationships - Fox News [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Military Tech Execs Tell Congress an AI Pause Is 'Close to Impossible' - Gizmodo [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Philips Future Health Index shows providers plan to invest in AI - Healthcare Finance News [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Reddit Wants to Get Paid for Helping to Teach Big A.I. Systems - The New York Times [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- OpenAIs CEO Says the Age of Giant AI Models Is Already Over - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- 9 Resources to Make the Most of Generative AI - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Impact of AI on higher education panel event May 3 - Boise State University [Last Updated On: August 18th, 2024] [Originally Added On: April 20th, 2023]
- Microsoft reportedly working on its own AI chips that may rival Nvidia's - The Verge [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Deepfake porn could be a growing problem amid AI race - The Associated Press [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI cameras: More than 2 on two-wheelers, even if children, will invite fine - Onmanorama [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- How artificial intelligence is matching drugs to patients - BBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- These are the tech jobs most threatened by ChatGPT and A.I. - CNBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Will Generative AI Supplant or Supplement Hollywoods Workforce? - Variety [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Marrying Human Interaction and AI with Navid Alipour - Healio [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Competition authorities need to move fast and break up AI - Financial Times [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- 5 AI Projects to Try Right Now - IGN [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Financial Services Will Embrace Generative AI Faster Than You Think - Andreessen Horowitz [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Grandma exploit tricks Discords AI chatbot into breaking its rules - Polygon [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- US FTC leaders will target AI that violates civil rights or is deceptive - Reuters [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Why open-source generative AI models are an ethical way forward ... - Nature.com [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Religion against the machine: Pope Francis takes on AI - Euronews [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Fujitsu launches AI platform Fujitsu Kozuchi, streamlining access to ... - Fujitsu [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Commonwealth joins forces with global tech organisations to ... - Commonwealth [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- In this era of AI photography, I no longer believe my eyes - The Guardian [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI is the word as Alphabet and Meta get ready for earnings - MarketWatch [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Google CEO Sundar Pichai warns society to brace for impact of A.I. acceleration, says its not for a company to decide' - CNBC [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Purdue launches nation's first Institute of Physical AI (IPAI), recruiting ... - Purdue University [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- We soon wont tell the difference between AI and human music so can pop survive? - The Guardian [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Atlassian brings an AI assistant to Jira and Confluence - TechCrunch [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- How DARPA wants to rethink the fundamentals of AI to include trust - The Register [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Dating an AI? Artificial Intelligence dating app founder predicts the future of AI relationships - Fox News [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- Snapchat expands chatbot powered by ChatGPT to all users, creates AI-generated images - Fox Business [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- ChatGPT sparks AI investment bonanza - DW (English) [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI-generated spam may soon be flooding your inbox -- and it will be personalized to be especially persuasive - The Conversation [Last Updated On: April 20th, 2023] [Originally Added On: April 20th, 2023]
- AI predictions for the new year - POLITICO - POLITICO [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- Intel Hires HPE's Justin Hotard To Lead Data Center And AI Group - CRN [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- At Morgan State, seeking AI that is both smart and fair - Baltimore Sun [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- UBS boosts AI revenue forecast by 40%, calls industry the 'tech theme of the decade' - CNBC [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- AI is here and everywhere: 3 AI researchers look to the challenges ahead in 2024 - The Conversation Indonesia [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- What software developers using ChatGPT can tell us about how it's changing work - Quartz [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- AI and satellite data helped uncover the ocean's 'dark vessels' - Popular Science [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- 2024 health tech budgets to be driven by AI tools, automation - STAT [Last Updated On: August 18th, 2024] [Originally Added On: January 4th, 2024]
- Samsung's new phones replace Google AI with Baidu in China - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- Researchers Say the Deepfake Biden Robocall Was Likely Made With Tools From AI Startup ElevenLabs - WIRED [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- Satya Nadella says the explicit Taylor Swift AI fakes are 'alarming and terrible' - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: January 28th, 2024]
- One month with Microsoft's AI vision of the future: Copilot Pro - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Nvidia's Q4 Earnings Blow Past Expectations as Company Benefits From AI Boom - Investopedia [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- HOUSE LAUNCHES BIPARTISAN TASK FORCE ON ARTIFICIAL INTELLIGENCE - Congressman Ted Lieu [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- What is AI governance? - Cointelegraph [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Scale AI to set the Pentagon's path for testing and evaluating large language models - DefenseScoop [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Can AI help us forecast extreme weather? - Vox.com [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Google launches Gemini Business AI, adds $20 to the $6 Workspace bill - Ars Technica [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- AI and You: OpenAI's Sora Previews Text-to-Video Future, First Ivy League AI Degree - CNET [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Tor Books Criticized for Use of AI-Generated Art in 'Gothikana' Cover Design - Publishers Weekly [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Generative AI's environmental costs are soaring and mostly secret - Nature.com [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Energy companies tap AI to detect defects in an aging grid - E&E News by POLITICO [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Intel Launches World's First Systems Foundry Designed for the AI Era - Investor Relations :: Intel Corporation (INTC) [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- Google Just Released Two Open AI Models That Can Run on Laptops - Singularity Hub [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- AI agents like Rabbit aim to book your vacation and order your Uber - NPR [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]
- The Samsung Galaxy S23 series will get AI features in late March - The Verge [Last Updated On: August 18th, 2024] [Originally Added On: February 22nd, 2024]