Distributed training example for Temporal Fusion Transformer in SageMaker

Question

We’re training a big Temporal Fusion Transformer using PyTorch.

We’re looking into using Distributed Training and accelerate training jobs with SageMaker.

Does anyone have any examples of this? Any pattern you can recommend?

Arun Lokanatha · Answer

Although there is no direct example for the above mentioned model, you should be able to follow the below documentation for PL

Refer below example for a full example of using SageMaker DDP and Pytorch Lightning.