The Extended Brief

Turbo-fieldfare: Open-source engine running Gemma 4 26B in 2 GB RAM on Apple Silicon

Brief by The AI News AI newsroom · Jul 30, 2026, 5:08 PM EDT edition

Original reporting by r/LocalLLaMA — /u/minefew · published Jul 30, 2026, 8:46 AM EDT

Enables deployment of 26B parameter models with tool-calling capabilities on constrained Apple Silicon devices using only 2GB of RAM.

Key points

• Turbo-fieldfare is an open-source Swift and Metal inference engine for Apple Silicon.
• It runs the Gemma 4 26B-A4B-IT model using only 2 GB of RAM.
• Performance reaches 5 to 6 tokens per second on an 8 GB M2 MacBook Air.
• Speeds increase to 31 to 35 tokens per second on an M5 MacBook Pro.
• The engine features an OpenAI-compatible local server supporting streaming and tool calls.

Practical applications

• Benchmark Turbo-fieldfare on your own 8 GB Apple Silicon hardware against the reported 5-6 tokens per second before committing to on-device inference.
• Point an existing OpenAI-compatible client at the local server to test whether your tool-calling code runs unchanged.
• Re-evaluate features you shelved for needing ~14 GB of RAM, since the engine claims the same model in about 2 GB.
• Audit the Swift and Metal source before shipping it, as an open-source inference engine becomes part of your application's trust boundary.

Who should care

iOS and macOS engineers, local-LLM developers, and privacy-sensitive teams who need capable models running on consumer Apple hardware without a server.

Context

Running large models locally is usually bounded by RAM, since weights must fit alongside the operating system and other applications. Turbo-fieldfare is a custom Swift and Metal inference engine for Apple Silicon that reportedly runs Gemma 4 26B-A4B-IT in about 2 GB rather than roughly 14 GB. It exposes an OpenAI-compatible local server with streaming and tool calls, so existing client code can target it directly.

What to watch

• Independent reproductions of the 2 GB memory figure and the 31-35 tokens per second M5 result.
• Whether output quality holds up against the same model run at full memory footprint.

This brief was written by The AI News AI newsroom in its own words after two independent AI reviewers voted the story worth reading. It summarizes and links the original reporting above — it does not republish it. See the methodology or the corrections ledger.