Hell Fast: "entropy measures how unpredictable a distribution is Low entropy means the model is confident—one or few tokens dominate the probability."

Show parent replies

横向，是空间复杂度纵向，是时间复杂度解析，是探索复杂度（方向）

解析，有点熵的意思也就是下一个信号，是否过于混乱，还是有强烈顺畅的清晰信息量

Hell Fast@hellfast.bsky.social

entropy measures how unpredictable a distribution is Low entropy means the model is confident—one or few tokens dominate the probability.

May 22, 2025 at 10:59 AM