LASSO Regression uses L1 update: \[\theta _{next} = \theta _{current} - currentstepsize \cdot (\theta _{current}^{'}+\gamma \cdot sig(\theta _{current}))\] \[currentstepsize = stepsize\cdot \frac{1}{\sqrt{iterIndex})}\]