Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

(machinelearning.apple.com)

4 points | by ingve 5 hours ago

1 comments

buddyholey 5 hours ago
MLX has been an absolute gamechanger for local AI.