TensorFlow 2.0 - How to create a worker? Cluster

user_11959421 0
Viewed 223

I'm new to Tensorflow, I want to perform distributed computing/training using different machines.

The tutorial in this link mentions:

In practice, users would create multiple workers on external IP addresses/ports, and set TF_CONFIG on each worker appropriately.

I didn't find anything that tells how to do that.

I did find tutorials that used an old version of TensorFlow, but there was no TF_CONFIG there and I don't see any ClusterSpec used in the example, so I'm very confused.

tensor tensorflow deep-learning cluster-computing
1 Answers

Turns out the answer was simpler than expected.

Set the same TF_CONFIG on all machines and then run the same script on all machines.

The training does not start until all nodes/workers are connected.

user_119594210
Related