In a nutshell
Point 1: Safety isn't backdated on earlier models, todays Fable 5.2 will be trivial for someone in 2035 to jailbreak, but some capabilities will be just as deadly in 2035 as they are today, i.e. anything biological.
Point 2: If nukes were available on every corner to every Jill and Joe, we'd be in ruins. Reactive, legal enforcement is not sufficient.
Point 3: The fuzzy paradox where you have access to immense capabilities but minimal proactive safety mechanisms might be a sign we are living in a transitional period on AI safety.
Point 4: Infufficient progress is being made in model safety, the clock runs as the probabilities a small group of idiots do something terrible increases.
The core point:
Future improvements may not be able to undo the proliferation of dangerous capabilities already released.
Note: it doesn't need to be Fable 5.2, but an open source equivelent that appears next year.
Old Models can be dangerous too, (or they soon will be)
When I was playing about with old LLM models, it occured to me how easy they were to jail break.
That led me to an obvious conclusion, "In 5 years time, will Fable 5.2 and GPT 6.1 be equally as easy to jailbreak?"
Even if vendors do a good job, it wont be long until we have open source equivalents. So be it in 2 years or 7, they'll be cracked and 'on the streets'
So, 'How much damage could Fable 5.2 or an equivalent do?'.
Some wreckless guessing:
- One shotting a nations Air Traffic Control systems , causing hundreds of planes to crash on a single day. (Purely speculative based on fragility and age of ATC systems)
- Bio Weapons
- Dirty bombs
- Mass EV carjacking and car accidents
...etc.
Safety Mobilization is too slow and ignores proliferation
In terms of available budget, Anthropic invested 6% of it's AI R&D computeinto safety.
Which on the positive ledger, produces consistent compounding effects. Today's security and alignment are orders of magnitude more sophisticated than what we had for GPT4.
It's not exactly screaming caution, especially given heads of safety walking every other Tuesday.
Recent safety talks with the Trump Admin and the heads of tech, Dario, Musk, Zuckerberg yielded an underwhelming AI voluntary safety accord. The Center for Humane Technology have put out several shorts from experts lamenting lack of progress in other nations too on real tangible mechanisms to keep the genie in the bottle.
I've often heard things like, 'well we had nukes and we learned to control our better nature'. I think that's fair on the level of nation states, but even then every few years the world experiences collective anxiety during periods of sabre rattling.
For millions,billions of individuals, the unlikely becomes the innevitable.
So, AI alignment aside, the clock keeps ticking, the probability of malicious use is not static but increasing, yet our beurocratic nature continues to prevail.
No one's stopping the bus
In my experience, working in various big companies over the years - bringing up risks with leadership and managers, usually gets met with a form of ritualistic haggling.
It's not like the CTO is going to be like "OMG, you've found a potential critical vulnerability, STOP THE BUS!".
It's something more like, "ah yes, Frank already raised that conern, sync with the cloud team." Which turns out is nothing like that concern at all, but you've got a few pennies, and a bit of rope so you do the best you can with what you've got.
So at absolute best, yes, we get some kind of gentlemans handshake between the US, EU and China to allow inspectors in each others labs and reduce the pace of development. But at that level of granularity, it's focusing on say harmonising GPT 8 or whatever, not retrospectively locking down Hugging Face, Github etc.
So it just happens?
So far, in my mind yes. I'm not seeing any evidence of retrospective safeguarding, and if Anthropic's scaremongering is to be belived with Fable then those capabilities may already be here.
Anthropic identified a Yemen weapons cell using Claude for rocket/missile guidance assistance, caught it when the missile failed and they went back to it for trouble shooting... Open source models don't get monitored when they run locally.
Almost every other day you read about someone getting arrested, either before or after the deed and their interactions/questions to chatGPT being brought up.
It's not hard to imagine a small group of determined bad actors in 2035 taking an advanced 26 model, running them in parallel to perform something heinous.
Unlike devastation from AI-misalignment, the probability of deadly misuse by the public continually rises in the absense of prohibative restrictions.
The real question is - what could they do with today's best model if it's fully jail broken in a couple years time.
AI could be set back in ways it could never recover
If catastrophic misuse accurs, on a scale that we can recover from, that would be the wake up call for serious, rapid and possibly even harsh curtailing of AI usage in the public domain.
Much like in IT, you don't get the cyber budget you've been asking for until you make the local news.
I'd go as far to say, the counter reaction to an AI disaster could be immediate, and extremely brutal. It would be the ammo Anti-AI artists, developers, musicians have been looking for. It could be the vehicle for vast, comperhensive curtailing;
"well, whilst we're here, maybe we can protect people's livelihoods too?"
and before you know it, not only are all models locked down, but AI usage isn't just 'metered', it's restricted and even illegal for things that today we consider mundane.
By failing to regulate AI appropriately now, we might eventually provoke a crisis that results in a crackdown, limiting our AI usage that didn't need to happen.