liz's doc / Tags / #theory 中文 English 日本語 Knowledge graph Site map #theory Entropy and Information Measures Information Theory in LLMs Channel Capacity and Coding Source Coding and Compression Rate-Distortion and the Information Bottleneck KL Divergence and Cross-Entropy