Apple's new Mac Studio with M5 Ultra runs 512GB of memory and 4.3x faster AI
Apple Introduces New Mac Studio with M5 Max and M5 Ultra
Apple has unveiled the new Mac Studio, its most powerful Mac ever, powered by the M5 Max and the all-new M5 Ultra chips. The M5 Ultra configuration delivers up to 4.3x faster AI performance and 1.8x faster graphics than the previous generation, with up to 512GB of unified memory and 1.2TB/s of bandwidth, enabling users to run massive LLMs entirely on-device. Thunderbolt 5 support allows clustering multiple Mac Studios for up to 3x faster distributed AI inference. Pre-orders start today, with availability from September 22.
With the powerful M5 Max and the incredible capabilities of M5 Ultra, Mac Studio ushers in a new era of desktop computing, delivering huge performance gains for pro workloads and AI inference with frontier-class models.
- joshstrange
Due to pricing insanity (not that Apple prices weren’t insane before the ram/ssd shortages) I’m not in the market but I do wonder if my next computer should be a Mac Studio instead of a MBP that lives its life docked. Might be better to just run a Studio and Neo for the very few times I actually need remote capabilities.
- osmukka
Reading this press release was almost physically painful, because of how much Apple loves to use the phrase "up to". In total it appears 46 times.
- blints
10 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth.
Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.
- doctoboggan
> Apple’s most powerful Mac raises the bar for local AI
Wow, "Local AI" mentioned in the subheading above the fold - it's really awesome to see Apple leaning into this use case and I think it will definitely pay off for them going forward. Fingers crossed Apple is able to put some engineering effort towards shipping with one of the frontier open weight models included and optimized exactly for the machine.
- OneWhereWhy
The thing that intrigues me the most is this:
"Storage performance is up to twice as fast, with a next-generation SSD architecture built on PCIe Gen 6..."
This is the first personal computer I've noticed that has PCIe Gen 6 storage. I've only seen enterprise PCIe Gen 6 SSDs up until now. Gen 5 SSDs in consumer devices already have high temperatures and thermal throttling, so I'm worried about how Apple's implementation will perform (I know they don't use off-the-shelf SSDs anymore, but I'd imagine the temps would still be a problem).
- GodelNumbering
1.2 TB/s bandwidth of M5 Ultra comes from two dies of M5 Max (each 614 GB/s) connected together using 4.4 TB/s inter-die fabric.
For a non-quantized Deepseek V4 flash on an ultra, I would estimate about 1000+ tokens per second prefill and 50+ tokens per second on generation. This is actually quite usable and near parity to cloud.
They mention "adds the GPU Neural Accelerators." which, if exploitable for LLM loads, would probably help the prefill a lot
- vadansky
Sorry for being lazy, but is there a rough breakdown like "You get sonnet level for M5 and Opus for M5 pro, etc.", or is it still speculative. Or put simpler, do you get Opus level for the 256GB M5 Max?
- meerita
Mac Studio with M5 Max starts at $2,499 (U.S.) and $2,299 (U.S.) for education. Additional configure-to-order options are available at apple.com/mac-studio. Mac Studio with M5 Ultra starts at $5,499 (U.S.) and $5,099 (U.S.).
I am in Europe, and the Mac Studio M5 Ultra GPU 64 cores with 96GB RAM is up to 6.649,00 €. Ouch.
- alberth
It looks like speculation that Apple would raise the base chip’s maximum RAM from 32GB to 48GB was wrong.
Apple also launched the base M6 today with a 32GB RAM limit, suggesting 512GB may remain the maximum for Ultra chips for some time. Since these Ultra chips combine 16 base chips:
32GB × 16 = 512GB
- larodi
Incredible that LMStudio, an open and ever evolving (unstable) project, is cited as a speed reference.