The Data

The numbers behind the news.

When a story's own numbers support a chart or a table, the newsroom extracts one. Every value is machine-verified to appear in the original article before publication; a number that can't be verified never renders. Each visual links to its extended brief and to the original reporting.

llama.cpp latency without vs with persisted KV cache (4-core ARM)
Default (recompute)Persisted/warmed cache
3356-token prefill, fresh process−50.9seconds
54.4seconds
3.5seconds
2815-token TTFT at 09:00−73seconds
89.7seconds
16.7seconds

Author's measurements on an Oracle free-tier ARM box; reads from page cache drop prefill to 0.10s.

I made llama.cpp remember across restarts: 54.4s prefill -> 3.5s on a new process (free ARM box)

r/LocalLLaMA · Aug 2, 2026, 10:12 PM EDT · original article →

Who enforces the AI Act
Enforcement bodyScope
AI OfficeGeneral-purpose AI model providers, including systemic-risk models, and AI systems from th
National competent authorities (27 Member States)Other AI systems
European Data Protection SupervisorAI systems used by EU institutions, bodies, and agencies

Enforcement began August 2; the Digital Omnibus delayed some rules originally scheduled for that date.

Enforcement of the AI Act Starts Today

Luiza's Newsletter (Luiza Jarovsky) · Aug 2, 2026, 11:04 AM EDT · original article →

Unreported macOS vulnerability

$200,000

up to this amount on the black market

Bynario was initially blocked from reporting the flaw because Apple's bounty inbox was flooded with AI-generated reports.

A real macOS flaw worth $200K went unreported because Apple's bug bounty inbox was full of AI slop

The Decoder · Aug 2, 2026, 9:12 AM EDT · original article →

Two labs point frontier models at real research
RunTargetReported costPublished artifacts
OpenAI (internal Astra)Ten math problems stalled a decadeUnder $2,000 per solutionLean 4 proofs, paper, reconstruction PDF
Anthropic (Claude, Mythos Preview)Cryptographic weaknesses$100,000 in tokensFindings disclosed days earlier

OpenAI has not disclosed how many attempted problems went unsolved; the prompts remain unpublished.

Ten advances in mathematics and theoretical computer science

Simon Willison · Aug 1, 2026, 5:21 PM EDT · original article →

Executor-slot comparison after weeks of live use
ModelStrong atWeak atNotes
ling-3.0-flashMechanical, spec-driven edits and tool calls; holds tool schema over long chainsActs confidently wrong on ambiguous steps124B total / ~5B active params; API-only via OpenRouter
glm-5.2Ambiguous, decision-heavy stepsKept off mechanical steps in this setupAuthor's verdict: executor choice hinges on spec tightness

I've had ling-3.0-flash and glm-5.2 both in my executor slot for a few weeks. They don't split the way the benchmarks predict

r/LocalLLaMA · Aug 1, 2026, 2:22 PM EDT · original article →

Manifest's LLM router: launch to shutdown
WhenWhat happened
MarchRouter launched, sorting requests into four complexity tiers
JuneDeprecated after mixed results across 7,000 cloud users
September 1Shut down for good

The company now argues task complexity cannot be deduced from the prompt alone and recommends a single battle-tested model for most uses.

Everyone is building LLM routers, we deprecated ours

Hacker News · Aug 1, 2026, 12:02 AM EDT · original article →

Harness-design effects on the same 4B model (accuracy points)
Explicit rules added to the prompt13 pts
Task placed before reference material6.5 pts
Context cleared each turn (summaries carried)−12 pts

Overall accuracy moved from 60 to 82 percent with harness design as the only variable; the pre-registered harness and 250-issue corpus are public.

60-82% accuracy swing on 4B model classification task: the only variable was harness design

r/LocalLLaMA · Jul 31, 2026, 7:03 PM EDT · original article →

DeepSeek V4 Flash after the 0731 update
MetricValue
Artificial Analysis Intelligence Index50
Gain from the 0731 update+10 points
Gap to OpenAI GPT-5.6 Luna1 point behind
Cost vs GPT-5.6 Luna~60% lower

New Deepseek Flash model matches OpenAI's GPT-5.6 Luna at roughly 60 percent lower cost

The Decoder · Jul 31, 2026, 4:44 PM EDT · original article →

Ponytail skill: vendor claim vs measured reductions
Vendor-claimed code reduction54%
Measured code reduction (80 tasks)15%
Measured cost reduction (80 tasks)10.3%

Earlier tests in the same series: the caveman skill reduced code by 8.5 percent while rtk increased it by 7.6 percent.

Ponytail Skill for Claude Code: Does It Really Cut Agent Code by 54%?

JetBrains AI Blog · Jul 31, 2026, 4:24 PM EDT · original article →