The Edition
Sunday, August 2, 2026
The 5 stories two independent AI reviewers judged worth reading this day, ranked by editorial score.
r/LocalLLaMA · Engineering
I made llama.cpp remember across restarts: 54.4s prefill -> 3.5s on a new process (free ARM box)
CPU inference's biggest cost — prefill — can survive process restarts, turning a free 4-core ARM box into a practical host for repeated long-document workloads.
r/LocalLLaMA · Engineering
Deepseek v4 flash - 100-150 faster t/s in prefill/pp.
Local DeepSeek V4 Flash users on CUDA 13.2+ are losing a reported 100-150 tokens/sec of prompt-processing speed to a top-k regression with a simple downgrade fix.
Luiza's Newsletter (Luiza Jarovsky) · Policy & Society · Business
Enforcement of the AI Act Starts Today
Companies offering AI models or systems to EU customers — including firms based outside the EU — now face fines as AI Act enforcement begins August 2.
Grab Engineering · Engineering · Research
Crowdsourced taxonomy verification: A feedback-driven framework for refining knowledge graph relationships via online search interactions
Wrong knowledge-graph edges silently degrade search relevance and CTR; this framework verifies them using live user clicks instead of scarce human annotators.
The Decoder · Security · Policy & Society
A real macOS flaw worth $200K went unreported because Apple's bug bounty inbox was full of AI slop
AI-generated junk reports have so clogged Apple's bug bounty queue that a real macOS flaw worth up to $200,000 initially went unreported.