Gradient descent is the algorithm to nudge the weights in a neural network into the right direction. The concept is not easy but can be visualised by showing the back propagation of a neural network with one and three inputs.
Gradient descent is a big part of my 'Neural Network from scratch in Python'-course. If you like my style of teaching, you can support me by enrolling in the online course on Udemy.