This is a linkpost for the original article hosted on my old blog: Stochastic Gradient Descent, Part I, Gradient descent on linear, quadratic and sinusoidal data.