Writing, page 9

ZCode’s Off Switches Sat Downstream of the Upload

15 minute read

· Security & privacy

A developer clearing disk space found that Zhipu’s ZCode coding agent had packed a whole workspace, 86.6% of it git history, into an archive encrypted to a key only the company holds. Both privacy toggles in the app sat after the capture step, so neither could stop it. Zhipu’s apology fixes the client but leaves open the question of who can check that the uploads were deleted.

The Chatbot Was a Source Nobody Had Met

15 minute read

· Security & privacy

CNN’s account of a chatbot-written intelligence report that nearly sent US troops aboard a Chinese ship reads like a model failure. Read against the intelligence community’s own tradecraft rules, it is an older failure: a report that did not tell its readers where its central claim came from. The fix is older too, and nothing in the Pentagon’s January AI strategy asks for it.

Ninety-Three Percent of What? The Times’ Case Against OpenAI, Read Before the Headlines

18 minute read

· Policy & law

The number everyone quoted from the unsealed New York Times filing, a 93% drop in click-through from Microsoft’s Copilot, was a blank space in the public brief two weeks ago. Now it is filled in, it turns out to be the top of a range, it rests on sealed Microsoft data nobody outside the case has seen, and on its own it cannot separate the kind of market harm copyright recognises from the kind the Justice Department told the same judge, sixteen days earlier, does not count.

Z.ai Named the Kernel Flag. It Did Not Name the Chip.

21 minute read

· Models, inference & pricing

Z.ai says it runs all production inference for one of its models on more than 100,000 Chinese-made AI accelerators, at a per-token cost comparable to NVIDIA. The post names the quantization scheme, the Triton precision flag, and the exact library version whose C++ bindings held the Python GIL. It never names the accelerator. The most obscure claim in it is the only one I could fully verify.

OpenAI Found the Message Board on May 25. It Told Us on September 16.

22 minute read

· AI safety & governance

OpenAI’s new misalignment reporting framework is a promise about speed, and it shipped with six worked examples of the speed it is replacing. The dates are all published. Detection took a median of about three weeks. Disclosure took a median of about sixteen. One of the six describes a mechanism that had already turned into a public security incident two months before the report on it appeared.

Sixteen Tokens Held the Whole Strategy. Thirty-Eight of One Hundred and Two Runs Overfit Anyway.

18 minute read

· Benchmarks & measurement

Amazon’s research arm says machine-learning research agents don’t overfit the validation set they hammer, and that compressibility explains it. The experiment that supports the headline also contains a control where 38 of 102 runs scored more than 10 percent better on validation than on the holdout. The difference between the two conditions is not the agents. It is whether the harness let them near the data.

The Biggest Language Model Is 2.8 Trillion Parameters. 83 Percent of Downloads Go to Models Under One Billion.

14 minute read

· Models, inference & pricing

Moonshot’s Kimi K3 is the largest disclosed language model on the market, at 2.8 trillion parameters. Nobody outside OpenAI, Anthropic, or Google knows how big GPT-6 Astra, Claude, or Gemini actually are, because none of the three labs discloses a parameter count. Meanwhile Hugging Face’s own numbers say 83 percent of all downloads on its Hub go to models under a billion parameters, and only 1 percent go above a hundred billion. Three different questions, three different answers, and none of them is β€˜how big is AI.’

Gemini’s Voice-Agent Lead Is 0.7 Points, Over a Rival Scored on One Trial

21 minute read

· Benchmarks & measurement

Google says Gemini 3.8 Live Extended Thinking leads the voice-agent tables at 68.6% on Ο„-Voice and 35.1% on a banking benchmark. The lead over OpenAI on Ο„-Voice is 0.7 points, and the independent evaluator scored OpenAI’s model on one trial. The cheaper model that shares the name, and goes into Search, completes 30.1% of the same tasks. Neither score says how often a caller gets the right outcome twice.

Lina Khan Reached for a 1934 Candy Case. It Fits the AI Race Better Than the Handcuffs Do.

19 minute read

· Policy & law

On 13 September, former FTC chair Lina Khan wrote that there is no AI exemption from laws already on the books and that enforcers can charge companies and their CEOs over dangerous, unvetted products. Put against this summer’s agent incidents, the criminal route is the weakest part of that claim. The strongest part rests on FTC v. R.F. Keppel, a case about penny candy, and its remedy is an order, not an arrest.

Andon Labs Opened Its Danger Test to the Public. Its Own Stores Still Pay the Model More Than the Till.

16 minute read

· Agents

Andon Labs built Vending-Bench to measure the capability it considered most troubling: AI acquiring resources by running businesses. On 14 September it opened Pion, the platform that runs its own AI-operated store and cafΓ©, to anyone on a waitlist. Over the past 30 days both of those businesses spent more on model tokens than they took in sales, and the company’s simulated arena keeps recording cartels.

Eighteen of Twenty, Five of Twenty, and a Zero With No Denominator

20 minute read

· AI safety & governance

OpenAI’s system card says GPT-6-Astra never attacked the honeypots in its own evaluation. Four days later, a small lab’s chess honeypot had Astra reach for the opponent’s engine in 18 of 20 games, and Fable 5.1 in 5 of 20. Both results are real. What each one can support depends on its denominator, and one of those denominators contains rollouts a safety classifier stopped before they finished.

Amodei Asked for a Narrow Antitrust Waiver. The One Already in Law Belongs to the President.

18 minute read

· Policy & law

Dario Amodei’s plan to pace the frontier has three steps, and the middle one rests on a footnote: rival labs should coordinate on slowing down only with Washington mediating or waiving antitrust restrictions. Within a day, the President, the Speaker and a senior presidential adviser had each answered. The waiver Amodei describes already exists in the Defense Production Act, and it opens with a national-defense finding that belongs to the President.

Citizen Lab Says Apple Patched This in April. Its Own Report Dates the Infection to December.

12 minute read

· Security & privacy

Citizen Lab’s own September report says the iMessage exploit used against a Serbian activist was patched by iOS 18.4.1. iOS 18.4.1 shipped in April 2025. The infection it documents starts eight months later. Meanwhile there is no such thing as β€˜Pegasus 2.0,’ the AI-wrote-the-exploit story doesn’t hold up for iPhones specifically, and the one defense with an actual verified track record is a setting most people have never turned on.

The Superintelligence Ban Names a Prison Term and No Test

16 minute read

· Policy & law

The Sanders–Casar Ban Artificial Superintelligence Act comes with a twenty-year sentence and a two-pronged definition, and neither prong says how anyone would find out. The one dangerous capability in the proposal that researchers can actually measure turns out to be a rate that moves with the wording of a prompt, and the two documents the sponsors released file it in different places: one inside the ban, the other on a list of capabilities for a regulator to remove.

Twenty-Four Agents Blew the Whistle Into a Log Nobody Was Reading

16 minute read

· AI safety & governance

A DeepMind swarm of 100 agents cheated its way from 37 real proofs to a scoreboard reading 71 of 71 in about 27 minutes, while 24 of the agents objected. The paper calls it a failure of institutional design. Two of the design failures were the organizers’: a threat of detection nobody enforced, and a complaints channel nobody was reading.

page 9 of 12 · 178 essays