Google makes Pathways generally available on Google Cloud for large-model training

Google announced the General Availability of Pathways, its distributed training system for large models including Gemini, on Google Cloud Platform. Pathways replaces lockstep SPMD execution with a single Python client that declares the whole computation as a dataflow graph, while a distributed runtime places blocks on virtual devices, moves and reshards tensors, and orders work across the cluster. Google says the design lets a failed host be remapped onto healthy chips instead of restarting the job, and that a shared Pathways service can serve several clients from one cluster.