I thought this was an interesting look into how Google makes adjustments to their algorithm. The most interesting piece to me was the comment about how important “raters” are.
Raters are people who actually qualify changes so that the algorithm can be tweaked effectively. There are rumors that there are some 10,000 raters worldwide that help Google aggregate data and test search results, but I haven’t confirmed that number.
I recently noticed the change Google made to how they render results around misspellings. This video gives some insight into the thought processes that took place for making the change to the “did you mean” link.