(15) OPTIMIZATION: Momentum Gradient Descent

Another way to improve Gradient Descent convergence

In article 13 about optimization, we discussed optimization techniques, particularly focusing on gradient descent. the previous article have highlighted the potential issue of slow convergence with gradient descent, especially in cases of relatively flat gradients. To overcome this challenge, conjugate…