microsoft's trying to muscle apple on the ai front with this nvidia setup. saw some benchmarks where
Nemotron 3.5 Bolt was hitting 60 tokens per second. that's pretty wild for a laptop. qwen 27b was dragging though, barely hit 8 or 9 tokens at 8-bit quantization because of the bandwidth bottleneck. im skeptical about the price tag though. $4,300 is
insane for a machine that might throttle the second you push it too hard. probably still better than using google's garbage tools for everything but we'll see.
more here:
https://thenewstack.io/surface-ultra-local-ai/