Of Notes
Normal Equations
A set of equations used to find the best fitting curve to a least-squares problem.
Essentially they convert the optimization problem into a set of linear equations.
TODO: study how The key idea is that linear regression is actually a geometry problem. We're trying to find the point closest to our target, but we're only allowed to choose points from a particular space.