Hi all,
We are planning an 8-node M5 Ultra Mac Studio deployment for distributed LLM inference and training using MLX (mlx.distributed) and RDMA over Thunderbolt 5 (per Technote TN3205). Before finalizing our physical rack cabling, we would appreciate official confirmation on a few architectural details:
-
Is an 8-node M5 Ultra Mac Studio cluster supported for distributed AI workloads using Apple's MLX framework?
-
What is the recommended Thunderbolt 5 connection topology for eight Mac Studios: ring, mesh, or another configuration?
-
We currently plan to use 14 Thunderbolt 5 cables. Can this quantity be used effectively for an eight-node cluster, or would Apple recommend a different number?
-
Can Apple provide a detailed physical cabling diagram showing the specific Thunderbolt ports to connect between all eight machines?
-
Is it possible or beneficial to establish multiple Thunderbolt connections between the same two Mac Studios to increase communication bandwidth?