The White House is coming out in favor of “open-source” artificial intelligence technology, arguing in a report Tuesday that there’s no need right now for restrictions on companies making key components of their powerful AI systems widely available. The report sought by President Joe Biden is the U.S. government’s first to delve into a tech industry debate between developers who advocate closing off the inner workings of their most advanced AI models to guard against misuse, and others who have lobbied for a more open approach they say favors innovation.
No surprise, since there’s not a lot of pressure to do any other regulation on the closed source versions. Self monitoring of a profit company always works out well…
And for any of the “AGI won’t happen, there’s no danger”…what if on the slightest chance you’re wrong? Is the maddening rush to get the next product out without any research on what we’re doing worth a mistake? Scifi is fiction, but there’s lessons there too, and we’re ignoring them all because “that can’t happen” is stronger than “let’s be sure”.
Besides, even with no AGI, humans alone can do huge damage with “bad” AI tools, that we’re not looking into either.
What sorts of scenarios involving the emergence of AGI do you think regulating the availability of LLM weights and training data (or of more closely regulating AI training, research, and development within the “closed source” shops like OpenAI) would help us avoid?
And how does that threat compare to impending damage from climate change if we don’t reduce energy consumption + reliance on fossil fuels?
When I search for “misuse of AI” I get a ton of results from people talking about exactly that.