"Black October"

Oct. 22nd, 2026 07:02 pm
jducoeur: (Default)
[personal profile] jducoeur

There’s nothing quite like seeing this month getting dubbed "Black October".

tl;dr — unsurprisingly, folks are freaking out, with some good reason, over the growing deluge of severe security bugs being discovered via #AI. The fact that #eMudhra and #PHP2Shell became publicly known within hours of each other isn’t helping.

I'm sort of taking it in stride, mostly because it's been so horribly obvious for a while that this was coming. Most of the Internet is really badly written, vulnerabilities are rife, and with LLMs getting better extremely quickly it was inevitable that the script kiddies would start to realize the potential for lulz. (Criminals as well, of course -- but I suspect a fair fraction of this is just bored idiots causing trouble for fun.)

I'm concerned, but not doomstering to the degree some are. I think some sites will get slammed to the ground, especially ones that are poorly maintained. But this week (especially PHP2Shell, I think) has been a useful wakeup call that companies can no longer treat security as an optional expense line: if you want to run a business, you have to be dealing with this stuff.

In the long run, that's probably a good thing, and will hopefully help spread the clue of how to build software in responsible ways.

(Editorial: 90% of security is knowing how not to be gratuitously insecure in the first place -- including choosing the right tools. My fondness for the #Scala #Typelevel stack isn't just because it's fun to use: it's generally well-designed as well, and that at least reduces the attack surfaces.)

But in the meantime, yeah: it's a good time to make sure you have two-factor authentication on all your really important accounts, you've got strong passwords that are different for each site, and be conscious of the fact that pretty much anything online, anywhere, is subject to being hacked.

Warning: Hot Take Ahead

Oct. 21st, 2026 07:19 pm
jducoeur: (Default)
[personal profile] jducoeur

I was just reading Anthropic's post about the way being an AI-maximalist company is affecting the workplace.

Along with that, I was recently reading The Economist talking about the way an AI boom might affect national finances: since most countries get most of their taxes from income tax, if lots of people get thrown out of work by AI, that's going to hit the tax take hard.

All of which is driving home that the standard AI-booster take on the economic effects of AI could be Just Plain Wrong.

They keep saying that AI will cause an endlessly booming economy, but that ignores the elephant in the room: the real economy depends on real people spending real money, y'know, buying stuff.

If those real people no longer have real jobs, they're not going to be buying so much.

And yes, there's the usual argument that society always adjusts to tech disruptions: in the long run, it leads to new, better jobs. But even taking that at face value, it usually ignores the fact that those changes take years, sometimes generations, to work their way through -- there's often a lot of pain along the way.

All of which is made worse by the omnipresent point that AI is wrecking the training process in many fields. The Anthropic article at the top explicitly calls out that yeah, they're hiring ever-fewer junior people, because you often need senior-level skills to use this stuff effectively. So there's a nasty risk of a seriously Lost Generation.

Of course, the AI Zillionaires make nice fluffy noises that "oh, money won't matter any more" and universal basic income and such. Suuuuure that'll work. All it takes is for the arch-capitalist class to surrender a very large fraction of their income, and we know how fond they are of doing that.

Put it all together, and this doesn't smell like a massive ongoing economic expansion. Quite the contrary: it sounds like the recipe for a Depression of truly epic scope.

Am I sure of this? Of course not: anyone who is sure about anything when it comes to our current borderline-Singularity is either overconfident or lying. I still think the likeliest outcome is that the AI Bubble pops and all of this slows down quite a bit.

But this scenario seems plausible enough to be concerning, and IMO much more plausible than the "free money for everyone!" nonsense being peddled by the hypesters.

Interesting times...

jducoeur: (Default)
[personal profile] jducoeur

Just came across Kurzgesagt's take on the Hugging Face Incident.

Very doomerist in its editorial viewpoint -- they manage to make the whole thing look even more sinister than it really was, just in their choices of visuals, and they are very explicit that they think this bullshit needs to stop.

But nicely complete and AFAIK pretty accurate: more detailed than I've generally seen in the popular news, in a catchy 15 minute video.

What working at Anthropic is like

Oct. 20th, 2026 02:38 pm
jducoeur: (Default)
[personal profile] jducoeur

Interesting little article from Anthropic, talking about how work works inside the company.

I know that some folks will dismiss this as AI marketing fluff; if so, move along. But I found it an interesting and decently honest read.

It does enthuse about rising productivity per person, but mostly talks about how much work changes in an AI-maximalist organization, not all for the better.

It mentions several times what we’ve all expected: they’re finding less use for junior employees. They admit that’s a problem, and have no solution.

They also observe (as I expected) that jobs start focusing on babysitting all those agents: even the ICs become “managers”, just not for people. And everyone starts automating that in self-defense.

It’s not an entirely happy vision, and that’s why it’s interesting. If you want fodder for dystopian science fiction, it’s a good place to start…

jducoeur: (Default)
[personal profile] jducoeur

Just watched Good Luck, Have Fun, Don't Die, and holy crap that's a fascinating movie.

It's just as much a horror movie as a science-fiction one: expect quite a lot of both scary and creepy.

And I confess, I'm not sure the story actually holds together logically, but it's a time-travel story at its heart, and that provides quite a bit of leeway.

Anyway -- not an easy movie, but a far better one than it looks like at first glance. Recommended!

jducoeur: (Default)
[personal profile] jducoeur

Fascinating post from Anthropic.

tl;dr — since they’re seriously #AI-maximalist over there, with nigh-infinite quotas, they’ve gotten to the point where they’re trying to juggle on the order of 30 thousand code changes per day.

Turns out that git turned into an enormous bottleneck for that, so they gave up and wrote a new agent-focused source control system, Scion; this gives a brief overview of the architecture.

It’s explicitly only relevant at that kind of scale, but it’s an interesting read.

But I’m horribly amused at the way the article makes it sound like server-centric source control is a radical innovation, having been through several of those before git was invented…

Page generated Oct. 25th, 2026 11:49 am
Powered by Dreamwidth Studios