Matryoshka Quantization
by bryukh on 2/12/2025, 7:50:54 AM
How does this compare to just training separate quantized models? Is it actually easier in practice?
How does this compare to just training separate quantized models? Is it actually easier in practice?