a mathematical system that undergoes transitions from one state to another, between a finite or countable number of possible states. It is a random process characterized as memoryless: the next state depends only on the current state and not on the sequence of events that preceded it. This specific kind of "memorylessness" is called the Markov property. Markov chains have many applications as statistical models of real-world processes.

"a delightful futuristic absurdity: a computer program, pretending to be human, hawking a book about computers pretending to be human, while other computer programs pretend to have used copies of it. A book that was never actually written, much less printed and read."

Quite a lot of work for an extra 5% ;)

Detect near-duplicates; would be good for future Razor-like efficient near-duplicate detection. (slides)

using standard compression plus common (cached) line detection to reduce storage requirements