Information is the resolution of uncertainty Shannon

Surprise Unexpected 越是低概率事件 觉得信息量越大