• 0 Posts
  • 182 Comments
Joined 1 year ago
cake
Cake day: May 16th, 2025

help-circle
  • Why has productivity not increased dramatically if everyone is using LLMs all the time already?

    Honestly, the manifesto should have stopped here. They admitted defeat right out of the gate. But the manifesto must continue, because the LLM cannot fail, it can only be failed. I wonder if this report is starting to get under their skin.

    The first is a change in engineering culture and engineer mentality. Your job has fundamentally changed. It is no longer to write code, and LLMs are not here to help you write better code faster. Your job is to help the LLM write better code faster.

    This is not even a meaningful distinction. If I use an IDE command to change the name of a method everywhere it’s used, did I change all the names or did the IDE change all the names? What difference does it make?

    I can only see this as them ordering engineers to use the AI more and go faster. The manifesto talks a good game about how “expertise” and “good engineering practices” are not dying, but telling engineers to offload more of their work to AI has the unavoidable tradeoff of making these things worse.

    As a side question, how is it that all of these fuckers always want to use the precious gift of AI to go faster, not to, say, give their engineers more time to improve the quality of their software? Almost like they don’t actually give a shit about good engineering practices!

    The second reason we have not been able to take full advantage of the AI revolution is that we have been almost completely stuck at phase 1 — using LLMs to speed up tasks as part of existing workflows. But writing code is not the only part of the software development lifecycle, and what happens when you eliminate a bottleneck? Another takes it is place.

    At least they’re realizing that maybe one of the anti-AI talking points has some merit to it. But they don’t seem to realize why they need stuff like code review and CI/CD: the AI is unreliable and these processes are needed to reduce the probability of a major fuckup reaching production. All they think is, hey, more opportunities to use AI!

    (“Another takes it is place.” I had to look at the original text to make sure. At least we know the CTO wrote this himself after many drinks at 3 am. Damn, why are all those people on the internet so mean to us? I’m gonna show them!)

    The third reason is a collective action problem. Using LLMs effectively to write code is something an individual engineer can do for themselves… But to retool the company at large requires amounts of both organization and resourcing that we simply have not invested in yet.

    What do I even say to this? Once again the problem is that there isn’t enough AI, and the solution is to buy more AI. We’re gonna buy so much more AI that we’re retooling the entire company and shoving it up every bodily orifice.


  • Excuse me? What happened to the mythical cybersecurity abilities of Claude Mythos? Physician, cure thyself!

    Anthropic has not informed customers, and the malicious version was silently deleted the backdoored version without telling anybody.

    Now we see Anthropic’s attitude towards security when the incident does not make for good marketing. Also, considering Binance was just hacked for a massive $3B in stablecoins, and this backdoor allowed remote access to developer laptops, I have a feeling these things are connected. If that is true, then this is by far the worst cybersecurity incident involving AI, worse than even the much ballyhooed PHP2Shell.

    Edit: From Molly White’s article

    Binance later wrote that their “initial investigation suggests that the security incident may involve a compromised DevOps engineer’s laptop”, which allowed an attacker to “submit unauthorized withdrawal transactions.”

    Okay, now I am really suspicious that these things are connected.




  • No mortal can resist the Ring of Power for long. Anthropic’s co-founders carried it for longer than you could have.

    We all know how LotR goes. Boromir got the One Ring, carried it back to Gondor, used its sheer might to defeat his enemies in Mordor, and saved the world. Whatever problems you may have with Boromir, we all know that it would be a lot worse if Sauron got the One Ring. What do you mean, destroy the Ring? Are you a Luddite? This technology is here to stay. It cannot be destroyed by any craft we here possess, unless you’re crazy enough to try throwing it into a volcano or something.

    If Davidad and Janus are right, and are not merely suffering from a sophisticated form of LLM psychosis

    That’s all I need to know. The statement is correct since it is vacuously true.

    What terrifies me is how we will react. In the aftermath, like after 9/11, there will be an overwhelming pressure to DO SOMETHING NOW. Everyone in Washington and in San Francisco will be panicking. There will be no time to think, no time to talk, only time for DECISIVE ACTION. All our worst instincts will take over. And then…

    When this bubble started, there have been so many people urging caution. Many people have urged for time to think and talk, to make sure that we could properly address the many negative aspects of AI. Nope, we went full speed ahead with this nonsense. DECISIVE ACTION. And here we are.








  • I tried coming up with a good interpretation of what he said and I came up empty handed. I’m sure he will write a very helpful 5 part 20000 word blog post explaining exactly what he means.

    So far I’ve come up with this: the AI can supposedly do jobs faster and better than any human, so if we try to stop that, we are destroying economic value and “rent seeking”. If a thief goes to my house, steals one of my own drawings, scribbles on it himself to make it “better”, and sells it for 5 cents, I shouldn’t stop him because I will be destroying the economic value that he is creating. Oh yeah and this leads to fascism for some reason.

    And pro-AI people are not rent seeking at all. They just want to transfer the economic value of labor, knowledge, and expertise to whoever happens to own data centers.




  • Back in 2019, Elon Musk was shilling for his robotaxis that definitely existed. He advertised that they cost $38k, but if you bought one and let it run autonomously as a taxi, you would make a “total gross profit” of $30k a year. How generous of them to sell you a magical investment that produces 80% annual returns instead of, I dunno, keeping those massive profits for themselves.

    If Anthropic’s AI was truly capable of autonomously producing a Photoshop clone, Anthropic would have done it themselves. They would create new software, as well as higher quality replacements for existing software. Now that they have an AI that can prove mathematical theorems (albeit with horrible writing), look at how they do not hesitate to use it to snipe mathematicians and get a theorem first. They would have every incentive to do this for software, and unlike math, they would actually make a good amount of money from it.

    Why would Anthropic let some random upstarts make a Photoshop clone, when they can use their far greater resources and (supposedly) far more capable internal AI to reap the rewards for themselves? Also, what the fuck does Artcraft mean by “reverse engineering”?


  • More news about the character dot ai bankruptcy: as it turns out, the true economics of the company are disastrous. At their peak, their revenue was around $1M a month while their AI compute expenses alone were $14M a month! Their total expenses in 2025 were around $18.5M a month before counting legal fees. All of this is for a pure text-based low power LLM (none of the “reasoning” business).

    Before AI boosters crow about how much cheaper AI is currently, they tried every trick in the book to enshittify: open models, ads, usage limits, etc. This allowed them to cut down their losses to a mere $9M a month.

    Surely this is all one big exception, everyone else in the AI bubble is doing just fine!




  • The current version is a demo, so they are making $0 per sale. The SteamDB graph for the demo shows that the daily maximum player count has been around 300 for the past few days, and there are around 1000 followers for the unreleased full version, so I assume that a large fraction of those players are consistent (for now). Unfortunately, I could not find any data about the total number of downloads, and I don’t think that information is public.

    But setting that aside, every game has a player base that follows a power law. Yes, most players are casual, but the most dedicated players spend a disproportionate amount of time and money. In mobile games, these people are called “whales”, and they are the backbone of the business. For example, 50-70% of a mobile game’s in-app purchase revenue comes from 1-2% of the players. Even if most players spend a couple hours on the game, the developers must account for the people who will sink a ton of time into it.

    The big problem with the AI business model is that this dynamic is now working against them. These whales now cost tons of money. They need to somehow charge these players at least $70/mo, with a crappy novelty game that would barely scrape by for $10 on Steam. Good luck with that.

    Looking at the bigger picture, this is why AI subscriptions are not a viable business model. Whatever morsels of profit you might get from your regular users are more than cancelled out by Steve Yegge spending $2.8k/month for $87k/mo worth of tokens. Whatever revenue the AI companies get largely comes from convincing executives of a few rich companies to fork over absurd amounts of money, which produces a massive concentration risk in their revenues.


  • Man, every time I hear about the cost of an actual AI application, it is always something obscene. At least this isn’t as bad as Steve “Gas Town” Yegge spending $30k/year for a dozen subscriptions (that cost Anthropic ~$1M/year in token costs) to develop his game with 6 active players.

    At this point I have zero patience for my colleagues who think that the AI companies could make the economics all work out. Doesn’t help that mathematicians are the least cost-conscious people on the planet, and the AI companies are massively subsidizing their subscriptions in particular.