Artificial intelligence makes a splash in efforts to protect Alaska’s ice seals and beluga whales – Stories – Microsoft

When Erin Moreland set out to become a research zoologist, she envisioned days spent sitting on cliffs, drawing seals and other animals to record their lives for efforts to understand their activities and protect their habitats.

Instead, Moreland found herself stuck in front of a computer screen, clicking through thousands of aerial photographs of sea ice as she scanned for signs of life in Alaskan waters. It took her team so long to sort through each survey akin to looking for lone grains of rice on vast mounds of sand that the information was outdated by the time it was published.

Theres got to be a better way to do this, she recalls thinking. Scientists should be freed up to contribute more to the study of animals and better understand what challenges they might be facing. Having to do something this time-consuming holds them back from what they could be accomplishing.

That better way is now here an idea that began, unusually enough, with the view from Morelands Seattle office window and her fortuitous summons to jury duty. She and her fellow National Oceanic and Atmospheric Administration scientists now will use artificial intelligence this spring to help monitor endangered beluga whales, threatened ice seals, polar bears and more, shaving years off the time it takes to get data into the right hands to protect the animals.

The teams are training AI tools to distinguish a seal from a rock and a whales whistle from a dredging machines squeak as they seek to understand the marine mammals behavior and help them survive amid melting ice and increasing human activity.

Morelands project combines AI technology with improved cameras on a NOAA turboprop airplane that will fly over the Beaufort Sea north of Alaska this April and May, scanning and classifying the imagery to produce a population count of ice seals and polar bears that will be ready in hours instead of months. Her colleague Manuel Castellote, a NOAA affiliate scientist, will apply a similar algorithm to the recordings hell pick up from equipment scattered across the bottom of Alaskas Cook Inlet, helping him quickly decipher how the shrinking population of endangered belugas spent its winter.

The data will be confirmed by scientists, analyzed by statisticians and then reported to people such as Jon Kurland, NOAAs assistant regional administrator for protected resources in Alaska.

Kurlands office in Juneau is charged with overseeing conservation and recovery programs for marine mammals around the state and its waters and helping guide all the federal agencies that issue permits or carry out actions that could affect those that are threatened or endangered.

Of the four types of ice seals in the Bering Sea bearded, ringed, spotted and ribbon the first two are classified as threatened, meaning they are likely to become in danger of extinction within the foreseeable future. The Cook Inlet beluga whales are already endangered, having steadily declined to a population of only 279 in last years survey, from an estimate of about a thousand 30 years ago.

Individual groups of beluga whales are isolated and dont breed with others or leave their home, so if this population goes extinct, no one else will come in; theyre gone forever, says Castellote. Other belugas wouldnt survive there because they dont know the environment. So youd lose that biodiversity forever.

Yet recommendations by Kurlands office to help mitigate the impact of human activities such as construction and transportation, in part by avoiding prime breeding and feeding periods and places, are hampered by a lack of timely data.

Theres basic information that we just dont have now, so getting it will give us a much clearer picture of the types of responses that may be needed to protect these populations, Kurland says. In both cases, for the whales and seals, this kind of data analysis is cutting-edge science, filling in gaps we dont have another way to fill.

The AI project was born years ago, when Moreland would sit at her computer in NOAAs Marine Mammal Laboratory in Seattle and look across Lake Washington toward Microsofts headquarters in Redmond, Washington. She felt sure there was a technological solution to her frustration, but she didnt know anyone with the right skills to figure it out.

She hit the jackpot one week while serving on a jury in 2018. She overheard two fellow jurors discussing AI during a break in the trial, so she began talking with them about her work. One of them connected her with Dan Morris from Microsofts AI for Earth program, who suggested they pitch the problem as a challenge that summer at the companys Hackathon, a week-long competition when software developers, programmers, engineers and others collaborate on projects. Fourteen Microsoft engineers signed up to work on the problem.

Across the wildlife conservation universe, there are tons of scientists doing boring things, reviewing images and audio, Morris says. Remote equipment lets us collect all kinds of data, but scientists have to figure out how to use that data. Spending a year annotating images is not only a bad use of their time, but the questions get answered way later than they should.

Morelands idea wasnt as simple as it may sound, though. While there are plenty of models to recognize people in images, there were none until now that could find seals, especially real-time in aerial photography. But the hundreds of thousands of examples NOAA scientists had classified in previous surveys helped technologists, who are using them to train the AI models to recognize which photographs and recordings contained mammals and which didnt.

Part of the challenge was that there were 20 terabytes of data of pictures of ice, and working on your laptop with that much data isnt practical, says Morris. We had daily handovers of hard drives between Seattle and Redmond to get this done. But the cloud makes it possible to work with all that data and train AI models, so thats how were able to do this work, with Azure.

Morelands first ice seal survey was in 2007, flying in a helicopter based on an icebreaker. Scientists collected 90,000 images and spent months scanning them but only found 200 seals. It was a tedious, imprecise process.

Ice seals live largely solitary lives, making them harder to spot than animals that live in groups. Surveys are also complicated because the aircraft have to fly high enough to keep seals from getting scared and diving, but low enough to get high-resolution photos that enable scientists to differentiate a ring seal from a spotted seal, for example. The weather in Alaska often rainy and cloudy further complicates efforts.

Subsequent surveys improved by pairing thermal and color cameras and using modified planes that had a greater range to study more area and could fly higher up to be quieter. Even so, thermal interference from dirty ice and reflections off jumbled ice made it difficult to determine what was an animal and what wasnt.

And then there was the problem of manpower to go along with all the new data. The 2016 survey produced a million pairs of thermal and color images, which a previous software system narrowed down to 316,000 hot spots that the scientists had to manually sort through and classify. It took three people six months.

Read more here:
Artificial intelligence makes a splash in efforts to protect Alaska's ice seals and beluga whales - Stories - Microsoft