I have a good understanding of the autograd algorithm, and I think I should learn about the source code in PyTorch. However, when I see the project on GitHub, I am confused by the structure, cuz so many files include autograd. So which part is the most important core code of autograd?
3 Answers
Reading the PyTorch code is doable, but you may be overwhelmed with details. To get a basic idea of autograd, you may want to refer to some simple autograd implementations, such as https://evcu.github.io/ml/autograd/ and https://medium.com/@ralphmao95/simple-autograd-implementation-understand-automatic-differentiation-hand-by-hand-9e86f6d703ab
Related