This is a linkpost for the original article hosted on my old blog: Stochastic Gradient Descent, Part IV, Experimenting with sinusoidal case.