JPEG compress your LLM weights
by yoss90 on 12/2/2024, 4:07:03 AM
JPEG is unlikely to do a good job in compressing LLM weights, but here is different approach from this weekend (with benchmarks and code).
https://github.com/nadavrot/legday/#how-it-works
by billconan on 12/2/2024, 4:27:48 PM
does this make sense?
JPEG compression is based on the fact that natural images are of low frequency. Are weights also low frequency?
JPEG is unlikely to do a good job in compressing LLM weights, but here is different approach from this weekend (with benchmarks and code).
https://github.com/nadavrot/legday/#how-it-works