The smarter your guesses (prediction), the smaller the final compressed file Compression is to find smart way to throw away the low contribution part of the information Prediction means, that you can have high confidence that the next token is more rewarding.