Local AI | Harris Oldroyd

Local AI

Running models locally.

Benchmarks, agent workflows, infrastructure decisions, and the practical realities of local-first AI systems.

Jul 11, 2026 local-ai 10 min read

Apple Silicon Macs for Local LLMs

A concise guide to the M3 Ultra Mac Studio, M4 Max Mac Studio, and M5 Max MacBook Pro for local LLMs, including real benchmarks, current and used pricing, MLX and Metal software, Thunderbolt clustering, and an estimate for a possible M5 Ultra.

Jul 11, 2026 local-ai 22 min read

NVIDIA DGX Spark and GB10 for Local LLMs

A practical guide to NVIDIA DGX Spark and other GB10 systems for local LLMs, covering real token speeds, memory bandwidth, MoE models, clustering, thermals, software support, pricing, Strix Halo, and Mac Studio alternatives.

Jul 11, 2026 local-ai 10 min read

AMD Strix Halo for Local LLMs

A concise guide to AMD Strix Halo for local LLMs, covering real token speeds, memory bandwidth, MoE models, ROCm and Vulkan support, clustering, and the 192 GB Gorgon Halo refresh.

Jul 9, 2026 local-ai 22 min read

Best GPUs and Devices for Local AI Inference

A comparison of GPUs, workstation cards, unified-memory devices, and CPU inference setups for local AI, focused on price, speed, memory capacity, software support, and practical tradeoffs.

Jul 9, 2026 local-ai 14 min read

RTX 3090 for Local AI Inference

A practical look at the RTX 3090 for local AI workloads, covering specs, VRAM, bandwidth, TFLOPS, used pricing, power limiting, LLM performance, image generation, and why it remains one of the best-value GPUs for running open models at home.