Model Training & Adaptation
Gradient descent
An optimization method that updates parameters in the direction that reduces loss.
Example
The optimizer takes repeated downhill steps on the loss surface.
Why people use it
Understanding “Gradient descent” helps teams adapt models deliberately and diagnose training problems.
What you'll hear
“Would Gradient descent improve the model for our specific use case?”