Raspberry Pi tests Needle 2, a 14MB function-calling model, on a Pi 5: tool calls in 76–149 ms, CPU only
Raspberry Pi's Sep 22, 2026 tests of Cactus Compute's open 45M-parameter Needle 2 on a Raspberry Pi 5 (8GB) show plain-English requests turned into local Python function calls in 76–149 ms on the CPU alone, with the whole Python process, interpreter included, peaking at 43–46.4MB.
Read the story →