To me, the greatest apocalypse scenario is not some AGI global extinction event but a corporation with an extensive data hoard replete with ample ML and GPU power being able to monopolize a useful service that cannot be matched by the public... that is the true, (and likely imo) AI nightmare we're heading towards.
Exactly this. We don't need protection from AI, we need protection from corporations. And they sure as hell aren't going to police themselves via internal "safety teams", especially not if it starts to affect their bottom line.
To me the biggest threat is using AI to make decisions with no human recourse. Do you want ChatGPT to be the sole judge deciding if you can get a mortgage or what interest rate it should be? Do you want ChatGPT to auto-delete your YouTube video with zero recourse or appeal process?
Can we talk about the intelligence community now? On my papers it says they should be ready to pull the plug on Azure if GPT goes off script, but are they even aware that they are expected to act?
To me, the greatest apocalypse scenario is not some AGI global extinction event but a corporation with an extensive data hoard replete with ample ML and GPU power being able to monopolize a useful service that cannot be matched by the public... that is the true, (and likely imo) AI nightmare we're heading towards.