Of Notes
Map Reduce
This is a thing that comes up a lot in my thinking but I tend to forget the name.
It is a method used in processing large datasets into atomic steps that can be split and then shuffling and essentially combining the outputs into one dataset. In the mapping step we can do some expensive computation.