embedding-condensation
Measure layer-wise token embedding cosine similarity, assessing the severity of embedding condensation. Concept from [ICML 2026] Dispersion loss counteracts embedding condensation and improves generalization in small language models.
embedding-condensation has been downloaded 4,006 times in total on PyPI, including 3,075 in the last 30 days. The latest version is 2.0, released May 17, 2026.
Version2.0
Downloads
4.01k
LicenseNon-Commercial License — see ../LICENSE.md in the LM-Dispersion repository.
AuthorChen Liu
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal2.*1.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included3 / 5 series
Selected total7.26k
4.0kAll-time
3.1kLast 30 days
19Last 24 h
<0.01/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0135.2%
2.0
1.4k downloadsDownloads1.4k35.2% - 0226.3%
1.1
1.1k downloadsDownloads1.1k26.3% - 0319.7%
1.0.0
789 downloadsDownloads78919.7% - 0418.8%
0.1.0
753 downloadsDownloads75318.8%
Guess the next day
Thirteen recent days of embedding-condensation downloads. Drag the green handle on the right to guess where day fourteen lands.