32 points | by alwillis 19 hours ago
6 comments
Related and test on MacBook Pro M5 vs M4:
https://machinelearning.apple.com/research/exploring-llms-ml...
"Exploring LLMs with MLX and the Neural Accelerators in the M5 GPU"
Prompt ingested (time to first token) in "18 seconds" with the new chip... end of the joke.
At this rate, Apple will be primed to replace OpenAI for realtime use somewhere around 2045.
Like prior iPad GPU upgrades, most customers will never notice until it reaches the Mac lineup. Another victim of the iOS/iPadOS capability bottleneck.
[dead]
Related and test on MacBook Pro M5 vs M4:
https://machinelearning.apple.com/research/exploring-llms-ml...
"Exploring LLMs with MLX and the Neural Accelerators in the M5 GPU"
Prompt ingested (time to first token) in "18 seconds" with the new chip... end of the joke.
At this rate, Apple will be primed to replace OpenAI for realtime use somewhere around 2045.
Like prior iPad GPU upgrades, most customers will never notice until it reaches the Mac lineup. Another victim of the iOS/iPadOS capability bottleneck.
[dead]