cross-posted from: https://lemmy.world/post/50398452
Just when you think @ZuckyZuck is finally out of ideas - to steal.
It starts to feel like even a weak LLM like MetaAI is more creative than him.
Maybe we already have created truly artificial intelligence because he is more of an SLM: a Small Language Model?
The models are tested, among other things, on their ability to turn vulnerabilities into exploits. The OpenAI scenario was exactly this.
It is a very wise practice to test these things in isolation, especially when you’re telling it to hack.
I’m not completely sold on it being a publicity stunt, personally. The law was broken by these models, and I don’t believe these companies want to start people and politicians asking the question about who is culpable when an AI breaks the law.
Sort of. What they want is no responsibility “wow we didn’t tell it to do that explicitly!” And to convince the public and government officials that “AI is actually really dangerous, so please ban all the foreign competitors on grounds of national security (totally unrelated to our potential lack of earnings and their ability to offer 98% the product for 1% the cost).”
So still most likely publicity stunt. A reproducible one, done only by the largest domestic ones precisely because they are not worried about the question of who is culpable if a law is broken, because they didn’t tell it explicitly to do it and also they still have a couple piles of circular cash they can use on bribes, which may be their only path to keeping the grift train going. They’re in no way in danger of being held accountable here, they do worse things everyday, and their concern is making money, full stop. They will lie cheat and steal their way through circular finance deals, bribes, extortions, anticompetitive behavior, marketing stunts, propaganda, and backroom deals as much as they can to accomplish that goal. When you understand their actions through that lens, well, things like this make sense.
Isolation is a keyword in your prose that was apparently on vacation when these tests were done.
Airgap this crap.
AI leaks like this are the equivilamt of COVID escaping a Wuhan laboratory.