IIT Mumbai·1 day ago
Why gradient descent is like hiking down a foggy mountain
You can't see the base of the mountain (global minimum). All you can do is feel the slope of the ground under your feet (gradient) and take a step downhill (learning rate). If your step is too big, you overshoot the valley. If it's too small, you take 10 years to reach the bottom. Keep your analogies visual when learning AI!
