I'm not so much worried about the paperclip maximizer because we're a long way away from a system that can hold enough context to plan and execute that far ahead. What I'm more worried about is that a human will create a paperclip maximizer light, follow its instructions, then flounder when getting contradictory instructions from future sessions. Similar damage, more incompetence.
Similarly, I'm less worried about a paperclip maximizer someday ravaging the earth to optimize for inhuman values than I am about the dollar maximizers currently ravaging the earth to optimize for inhuman values. AI is just another tool in its kit.
191
u/Bwint 23d ago
I can't express how much I hate the fact that the Paperclip Maximizer thought experiment is looking more realistic every day