Writing
- WarpQuant: Dual-Domain Low-Bit LLM Quantization
A post-training quantization method that reaches INT2/INT3 SOTA accuracy and runs the compressed weights directly through a C++/CUDA llama.cpp kernel — 7.36× faster decoding than GPTQ W3.
No posts match.