Keras, Tensorflow - What is the meaning of K.epsilon when computing metrics

Viewed 3593
2 Answers

When there's a division operation taking place, it's often added to the denominator to prevent a divide by zero error. Epsilon is small value (1e-07 in TensorFlow Core v2.2.0) that makes very little difference to the value of the denominator, but ensures that it isn't equal to exactly zero.

epsilon: A small constant for numerical stability. This epsilon is "epsilon hat" in the Kingma and Ba paper (in the formula just before Section 2.1), not the epsilon in Algorithm 1 of the paper. Defaults to 1e-7 Source= Click here

Related