embedding-condensation
Measure layer-wise token embedding cosine similarity, assessing the severity of embedding condensation. Concept from [ICML 2026] Dispersion loss counteracts embedding condensation and improves generalization in small language models.
embedding-condensation has been downloaded 5,544 times in total on PyPI, including 233 in the last 30 days. The latest version is 2.0, released May 17, 2026.
Version2.0
Downloads
5.54k
LicenseNon-Commercial License — see ../LICENSE.md in the LM-Dispersion repository.
AuthorChen Liu
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal2.*1.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included3 / 5 series
Selected total3.04k
5.5kAll-time
233Last 30 days
11Last 24 h
<0.01/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0147.4%
2.0
766 downloadsDownloads76647.4% - 0224.3%
1.1
393 downloadsDownloads39324.3% - 0316.3%
1.0.0
264 downloadsDownloads26416.3% - 0411.9%
0.1.0
192 downloadsDownloads19211.9%
Guess the next day
Thirteen recent days of embedding-condensation downloads. Drag the green handle on the right to guess where day fourteen lands.