Back Propagation is used in CNN to update the randomly allotted weights, biases and filters. For updation of values, we find Gradient using chain rule from end to start and use the formula,
New Value = old value - (learning Rate * gradient)
Gradient Descent is an optimiser, which is used to optimize the loss functions. Here also gradient is calculated and the formula is
New value = old value - (learning Rate * gradient)
Correct me if I am wrong in the above explanation given.
My Doubts are:
- Does both Back propagation and Gradient Descent use the same logic?
- Is there any relation between Back Propagation and Gradient Descent ?