Sam Altman’s Second Coming Sparks New Fears of the AI Apocalypse – WIRED

Open AIs new boss is the same as the old boss. But the companyand the artificial intelligence industrymay have been profoundly changed by the past five days of high-stakes soap opera. Sam Altman, OpenAIs CEO, cofounder, and figurehead, was removed by the board of directors on Friday. By Tuesday night, after a mass protest by the majority of the startups staff, Altman was on his way back, and most of the existing board was gone. But that board, mostly independent of OpenAIs operations, bound to a for the good of humanity mission statement, was critical to the companys uniqueness.

As Altman toured the world in 2023, warning the media and governments about the existential dangers of the technology that he himself was building, he portrayed OpenAIs unusual for-profit-within-a-nonprofit structure as a firebreak against the irresponsible development of powerful AI. Whatever Altman did with Microsofts billions, the board could keep him and other company leaders in check. If he started acting dangerously or against the interests of humanity, in the boards view, the group could eject him. The board can fire me, I think thats important, Altman told Bloomberg in June.

It turns out that they couldnt fire him, and that was bad, says Toby Ord, senior research fellow in philosophy at Oxford University, and a prominent voice among people who warn AI could pose an existential risk to humanity.

The chaotic leadership reset at OpenAI ended with the board being reshuffled to consist of establishment figures in tech and former US secretary of the treasury Larry Summers. Two directors associated with the effective altruism movement, the only women, were removed from the board. It has crystallized existing divides over how the future of AI should be governed. The outcome is seen very differently by doomers who worry that AI is going to destroy humanity; transhumanists who think the tech will hasten a utopian future; those who believe in freewheeling market capitalism; and advocates of tight regulation to contain tech giants that cannot be trusted to balance the potential harms of powerfully disruptive technology with a desire to make money.

To some extent, this was a collision course that had been set for a long time, says Ord, who is also credited with cofounding the effective altruism movement, parts of which have become obsessed with the doomier end of the AI risk spectrum. If its the case that the nonprofit governance board of OpenAI was fundamentally powerless to actually affect its behavior, then I think that exposing that it was powerless was probably a good thing.

Governance Gap

The reason that OpenAIs board decided to move against Altman remains a mystery. Its announcement that Altman was out of the CEO seat said he was not consistently candid in his communications with the board, hindering its ability to exercise its responsibilities. An internal OpenAI memo later clarified that Altmans ejection was not made in response to malfeasance. Emmett Shear, the second of two interim CEOs to run the company between Friday night and Wednesday morning, wrote after accepting the role that hed asked why Altman was removed. The board did not remove Sam over any specific disagreement on safety, he wrote. Their reasoning was completely different from that. He pledged to launch an investigation into the reasons for Altmans dismissal.

The vacuum has left space for rumors, including that Altman was devoting too much time to side projects or was too deferential to Microsoft. It has also nurtured conspiracy theories, like the idea that OpenAI had created artificial general intelligence (AGI), and the board had flipped the kill switch on the advice of chief scientist, cofounder, and board member Ilya Sutskever.

What I know with certainty is we don't have AGI, says David Shrier, professor of practice, AI, and innovation, at Imperial College Business School in London. I know with certainty there was a colossal failure of governance.

Follow this link:
Sam Altman's Second Coming Sparks New Fears of the AI Apocalypse - WIRED