(15) OPTIMIZATION: Momentum Gradient Descent
Another way to improve Gradient Descent convergence
4 min readApr 11, 2024
In article 13 about optimization, we discussed optimization techniques, particularly focusing on gradient descent. the previous article have highlighted the potential issue of slow convergence with gradient descent, especially in cases of relatively flat gradients. To overcome this challenge, conjugate…