Discussion about this post

User's avatar
Chaos Engine's avatar

Really interesting argument, and I think you’re right about one major point: Apple’s unified memory architecture is seriously underrated for running very large models locally.

Where I’m less convinced is the jump from “Apple is unusually good at local inference” to “Apple is the king of AI and NVIDIA is finished.” A Mac Studio and a data-center GPU cluster solve very different problems. Fitting a huge model into memory for one user is not the same as serving thousands of users with high throughput, batching, reliability, and fast interconnects.

The comparison also feels slightly selective when a single workstation GPU is used to represent NVIDIA’s entire platform. Apple may have a real advantage in private, local, high-memory inference, but that does not automatically translate into dominance in training, cloud infrastructure, or large-scale deployment.

So I agree with the underlying trend, but not the conclusion. Apple may become the leader in local AI hardware. That is a strong thesis on its own, without needing NVIDIA to be “dead.”

Harold Kildow's avatar

I appreciate the expert analysis—especially since it confirms my inchoate suspicions about this whole cluster we’re watching unfold. Apple is the second mover here—they stood back and watched the land rush unfold in the wrong direction and are using those mistakes to shape their own course. Really excellent work sir.

480 more comments...

No posts

Ready for more?