tokenwise.sk
← Back to Articles
· 5 min read

Reasoning Traces Are Leaking, Meta Rejoins Open Weights, and Agent Frameworks Grow Hooks

This week's most important story isn't a model release — it's a paper proving that the encrypted chain-of-thought blocks the big labs sell you as a moat can be stolen and replayed.

This week's most important story isn't a model release — it's a paper proving that the encrypted chain-of-thought blocks the big labs sell you as a moat can be stolen and replayed.

Your Provider's "Encrypted" Reasoning Isn't Safe

Since o1, frontier labs have hidden reasoning traces behind cryptographic signatures, ostensibly to prevent distillation. A new paper, Stealing Reasoning Traces from Proprietary LLM APIs, demonstrates that Anthropic, OpenAI, and Google all return encrypted CoT blocks that can be replayed across sessions, users, and models. The attack takes a trace from a frontier model, replays it into a weaker sibling, jailbreaks that weaker model, and recovers the underlying reasoning (full writeup).

Why this matters: the entire premise of hiding reasoning was to protect against competitors distilling your model's thinking. That premise is now empirically broken. If you've been paying a premium for reasoning models partly on the assumption that their "thoughts" are a defensible asset, recalibrate. More practically, if you're building on these APIs, understand that opaque reasoning blocks are neither a security boundary nor a trust guarantee — treat any replayable token stream as extractable.

Actionable take: don't architect systems that assume provider-side reasoning is confidential. If you need auditable, controllable reasoning, run open-weight models where you own the trace. Which is a nice segue, because this week gave you good options for that.

Meta Is Back in Open Weights — With a Real License

Meta released Muse Glimmer, a 30B model under a clean Apache 2.0 license — a genuine departure from the restrictive Llama licenses that made enterprise adoption a legal headache. More importantly, Glimmer is explicitly optimized for agentic task completion, not just chat benchmarks.

Sebastian Raschka's architecture notes are worth reading before you deploy: Glimmer uses gated local and global GQA for KV-cache efficiency, which matters when you're running long agent loops where context accumulates fast. That KV efficiency is the difference between a model that stays fast on turn 40 and one that grinds to a halt.

This lands in a busy week for open models — Qwen 3.8 27B also shipped (Apache 2, vision-capable, laptop-runnable), though Simon Willison notes it "defaults to wildly overthinking things," so budget for prompt work to rein in its reasoning. Meanwhile DeepSeek V4 Pro arrived API-only with no open weights confirmed.

The takeaway: the 27-30B tier is now the sweet spot for self-hosted agents, and a permissive license from Meta removes the last real excuse for defaulting to closed APIs on internal tooling. Test Glimmer against your agent harness before your next infra bill.

Agent Frameworks Are Converging on the React Model

The most interesting framework news is Flue 2, Fred Schott's (creator of Astro) meta-harness for agents, which is built on React-style Agent Hooks. In Flue, an agent is a JavaScript function that re-renders on every turn, with hooks managing state, tools, and side effects across the loop.

This is a meaningful pattern, not just aesthetic borrowing. The core problem in agent engineering is managing state across turns: what's in context, what tools are available right now, what fires on each iteration. React solved an analogous problem for UIs — declarative state that re-renders predictably instead of imperative spaghetti. Applying hooks to the agent loop gives you the same benefit: your agent's behavior becomes a function of its state, and you stop hand-rolling turn-by-turn control flow.

Flue and Vercel's eve are setting the early template here, and the convergence signals where the ecosystem is heading. If you're still building agents as procedural while-loops with manually stitched context, it's worth prototyping one workflow in a hooks-based harness to feel the difference in how much accidental complexity disappears.

Contrast this with the cautionary tale from Florian Herrengt: teams shipping AI-generated code that nobody understands, until a bug appears that neither the engineer nor the AI can fix because no human ever knew where the data came from. Better agent frameworks help precisely because they make the control flow legible again.

Ultrafast Inference Is Now a Product Tier

OpenAI previewed Ultrafast mode, running GPT-5.6 Sol at up to 750 output tokens/second — 14x normal speed — powered by Cerebras hardware. This is quietly one of the more consequential releases for agent builders.

Throughput has been the hidden tax on agentic systems. A multi-step agent that makes 20 sequential LLM calls is bottlenecked by per-token latency at every hop, and those seconds compound into workflows that take minutes. At 750 tok/s, the calculus changes: agent loops that were too slow for interactive use become viable, and reasoning-heavy patterns (where the model burns tokens thinking) stop being prohibitively slow.

Pair this with OpenAI's builder's guide to GPT-5.6, which emphasizes smarter model selection and new Responses API capabilities. The strategic move is tiered routing: cheap fast models for simple steps, Ultrafast for latency-sensitive reasoning, and heavier models only where accuracy demands it.

The caveat: speed at the inference layer doesn't fix bad architecture. But if you've been avoiding sequential agent designs purely on latency grounds, re-benchmark now — the constraint may have moved.

The Week's Lesson

The theme running through all four stories is control moving back to builders. Reasoning traces you thought were locked away are extractable; a genuinely open 30B agentic model shipped under Apache 2.0; agent frameworks are adopting patterns that make behavior legible instead of magical; and inference speed is becoming a knob you tune rather than a wall you hit. The practitioners who win this cycle won't be the ones chasing the newest closed API — they'll be the ones who own their reasoning, understand their control flow, and route work deliberately across a tiered stack. Build for legibility and ownership now, because the tooling finally supports it.