Kai Liu, Dehui Wang, Zhiteng Li, Zheng Chen, Yong Guo, Wenbo Li, Linghe Kong, and Yulun Zhang.
"CondiQuant: Condition Number Based Low-Bit Quantization for Image Super-Resolution", arXiv, 2025
[arXiv] [supplementary material] [visual results] [pretrained models]
- 2025-02-16: This repo is released.
Abstract: Low-bit model quantization for image super-resolution (SR) is a longstanding task that is renowned for its surprising compression and acceleration ability. However, accuracy degradation is inevitable when compressing the full-precision (FP) model to ultra-low bit widths (2~4 bits). Experimentally, we observe that the degradation of quantization is mainly attributed to the quantization of activation instead of model weights. In numerical analysis, the condition number of weights could measure how much the output value can change for a small change in the input argument, inherently reflecting the quantization error. Therefore, we propose CondiQuant, a condition number based low-bit post-training quantization for image super-resolution. Specifically, we formulate the quantization error as the condition number of weight metrics. By decoupling the representation ability and the quantization sensitivity, we design an efficient proximal gradient descent algorithm to iteratively minimize the condition number and maintain the output still. With comprehensive experiments, we demonstrate that CondiQuant outperforms existing state-of-the-art post-training quantization methods in accuracy without computation overhead and gains the theoretically optimal compression ratio in model parameters.
Image | HR | Bicubic | SwinIR(FP) | 2DQuant | CondiQuant (ours) |
---|---|---|---|---|---|
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
- Release datasets.
- Release models.
- Release training and testing code.
- Release pre-trained CondiQuant.
We achieve state-of-the-art performance. Detailed results can be found in the paper. All visual results of CondiQuant will be provided soon.
Click to expand
- results in Table 3 of the main paper
- visual comparison (x4) in the main paper
- visual comparison (x4) in the supplementary material
If you find the code helpful in your research or work, please cite it!
@article{liu2025condiquant,
title={CondiQuant: Condition Number Based Low-Bit Quantization for Image Super-Resolution},
author={Liu, Kai and Wang, Dehui and Li, Zhiteng and Chen, Zheng and Li, Wenbo and Guo, Yong and Kong, Linghe and Zhang, Yulun},
journal={arXiv preprint arXiv:2502.15478},
year={2025}
}
This code is built on BasicSR.