Quantization

ICML 2024arXiv:2402.04396

#2

QuIP$\#$: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks

Albert Tseng, Jerry Chee, Qingyao Sun et al.

post-training quantizationweight-only quantizationhadamard transformvector quantization+4

241

ICLR 2025arXiv:2411.05007

#3

SVDQuant: Absorbing Outliers by Low-Rank Component for 4-Bit Diffusion Models

Muyang Li, Yujun Lin, Zhekai Zhang et al.

model quantizationdiffusion modelslow-rank approximationsingular value decomposition+4

98

ICLR 2025arXiv:2411.04330

#4

Scaling Laws for Precision

Tanishq Kumar, Zachary Ankner, Benjamin Spector et al.

low precision trainingpost-training quantizationprecision-aware scaling lawseffective parameter count+4

68

AAAI 2024arXiv:2212.01593

#5

Make RepVGG Greater Again: A Quantization-Aware Approach

Xuesong Nie, Yunfeng Yan, Siyuan Li et al.

architecture reparameterizationquantization errorint8 inferencepost-training quantization+4

66

ICLR 2024arXiv:2403.12544

#6

AffineQuant: Affine Transformation Quantization for Large Language Models

Yuexiao Ma, Huixia Li, Xiawu Zheng et al.

44

ICCV 2025arXiv:2402.03666

#7

QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning

Haoxuan Wang, Yuzhang Shang, Zhihang Yuan et al.

44

AAAI 2024arXiv:2309.02784

#8

Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models

Liang Li, Qingyuan Li, Bo Zhang et al.

41

ICML 2025arXiv:2410.09426

#9

FlatQuant: Flatness Matters for LLM Quantization

Yuxuan Sun, Ruikang Liu, Haoli Bai et al.

39

ICML 2025arXiv:2405.14917

#10

SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models

Wei Huang, Haotong Qin, Yangdong Liu et al.

39

ECCV 2024arXiv:2405.17873

#11

MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization

Zhao Tianchen, Xuefei Ning, Tongcheng Fang et al.

text-to-image diffusionmixed precision quantizationmemory-efficient inferencefew-step diffusion models+4

37

COLM 2025arXiv:2504.04823

#12

Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models

Ruikang Liu, Yuxuan Sun, Manyi Zhang et al.

QuantizationReasoningLarge Language modelsAccuracy

35

ICML 2025arXiv:2501.17116

#13

Optimizing Large Language Model Training Using FP4 Quantization

Ruizhe Wang, Yeyun Gong, Xiao Liu et al.

33

ICLR 2025arXiv:2312.07950

#14

CBQ: Cross-Block Quantization for Large Language Models

Xin Ding, Xiaoyu Liu, Zhijun Tu et al.

31

NEURIPS 2025arXiv:2502.02631

#15

ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization

Zechun Liu, Changsheng Zhao, Hanxian Huang et al.

28

AAAI 2025arXiv:2408.08554

#16

ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models

Chao Zeng, Songwei Liu, Yusheng Xie et al.

19

AAAI 2025arXiv:2406.03482

#17

QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

Amir Zandieh, Majid Daliri, Insu Han

19

AAAI 2025arXiv:2412.11549

#18

MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models

Weilun Feng, Haotong Qin, Chuanguang Yang et al.

17

CVPR 2024arXiv:2401.01543

#19

Retraining-Free Model Quantization via One-Shot Weight-Coupling Learning

Chen Tang, Yuan Meng, Jiacheng Jiang et al.

17

CVPR 2025arXiv:2411.13918

#20

Quantization without Tears

Minghao Fu, Hao Yu, Jie Shao et al.

network quantizationmodel compressioninference accelerationweight discretization+4

16

ICML 2024arXiv:2403.06082

#21

FrameQuant: Flexible Low-Bit Quantization for Transformers

Harshavardhan Adepu, Zhanpeng Zeng, Li Zhang et al.

low-bit quantizationtransformer modelspost-training quantizationfusion frames+4

16

ICML 2025arXiv:2412.14363

#22

ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals

Utkarsh Saxena, Sayeh Sharify, Kaushik Roy et al.

15

ECCV 2024arXiv:2407.03917

#23

Timestep-Aware Correction for Quantized Diffusion Models

Yuzhe YAO, Feng Tian, Jun Chen et al.

11

ICLR 2025arXiv:2410.06040

#24

QERA: an Analytical Framework for Quantization Error Reconstruction

Cheng Zhang, Jeffrey T. H. Wong, Can Xiao et al.

quantization error reconstructionlow-rank approximationparameter-efficient fine-tuninglow-precision inference+4

11

ICML 2024arXiv:2401.10432

#25

A2Q+: Improving Accumulator-Aware Weight Quantization

Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig et al.

weight quantizationaccumulator-aware quantizationneural network inferencehardware efficiency+3

10

NEURIPS 2025arXiv:2506.13771

#26

PTMQ: Post-training Multi-Bit Quantization of Neural Networks

Ke Xu, Zhongcheng Li, Shanshan Wang et al.

LittleBit: Ultra Low-Bit Quantization via Latent Factorization

Banseok Lee, Dongkyu Kim, Youngcheon You et al.

7

AAAI 2025arXiv:2403.16883

#28

GLAD: Improving Latent Graph Generative Modeling with Simple Quantization

Van Khoa Nguyen, Yoann Boget, Frantzeska Lavda et al.

6

COLM 2025arXiv:2505.00850

#29

ICQuant: Index Coding enables Low-bit LLM Quantization

Xinlin Li, Osama Hanna, Christina Fragouli et al.

LLM QuantizationLLM CompressionPost Training Quantization

6

CVPR 2024arXiv:2404.00103

#30

Scaling Laws for Floating–Point Quantization Training

Xingwu Sun, Shuaipeng Li, Ruobing Xie et al.

PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks

Marina Neseem, Conor McCullough, Randy Hsin et al.

5

ICLR 2024arXiv:2401.14110

#32

Towards Cheaper Inference in Deep Networks with Lower Bit-Width Accumulators

Yaniv Blumenfeld, Itay Hubara, Daniel Soudry

5

ICML 2025arXiv:2502.06786

#33

Matryoshka Quantization

Pranav Nair, Puranjay Datta, Jeff Dean et al.

4

ICML 2025arXiv:2412.04180

#34

SKIM: Any-bit Quantization Pushing The Limits of Post-Training Quantization

Runsheng Bai, Bo Liu, qiang liu

3

CVPR 2025arXiv:2505.21591

#35

Pioneering 4-Bit FP Quantization for Diffusion Models: Mixup-Sign Quantization and Timestep-Aware Fine-Tuning

Maosen Zhao, Pengtao Chen, Chong Yu et al.

model quantizationfloating-point quantizationdiffusion modelslow-bit quantization+4

3

ECCV 2024arXiv:2407.12637

#36

Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients

Dohyung Kim, Junghyup Lee, Jeimin Jeon et al.

network quantizationfixed-point traininggradient quantizationquantization error analysis+4

2

ICCV 2025arXiv:2507.12933

#37

DMQ: Dissecting Outliers of Diffusion Models for Post-Training Quantization

Dongyeun Lee, jiwan hur, Hyounguk Shon et al.

diffusion modelspost-training quantizationlow-bit quantizationchannel-wise scaling+4

2

low-bit quantizationsuper resolution networksedge detectionfinite-difference approximations+4

#38

Memory-Efficient Generative Models via Product Quantization

Jie Shao, Hanxiao Zhang, Hao Yu et al.

Towards Robust Full Low-bit Quantization of Super Resolution Networks

Denis Makhov, Irina Zhelavskaya, Ruslan Ostapets et al.

ECCV 2024

1

COLM 2025arXiv:2504.07389

#40

Task-Circuit Quantization: Leveraging Knowledge Localization and Interpretability for Compression

Hanqi Xiao, Yi-Lin Sung, Elias Stengel-Eskin et al.

QuantizationMixed PrecisionInterpretability

1

block floating-pointlarge language modelsmodel quantizationhardware efficiency+3

#41

BiE: Bi-Exponent Block Floating-Point for Large Language Models Quantization

Lancheng Zou, Wenqian Zhao, Shuo Yin et al.

ICML 2024

ICCV 2025arXiv:2507.22349

#42

MSQ: Memory-Efficient Bit Sparsification Quantization

Seokho Han, Seoyeon Yoon, Jinhee Kim et al.

NEURIPS 2025arXiv:2510.20348

#43

Understanding the Unfairness in Network Quantization

Bing Liu, wenjun Miao, Boyu Zhang et al.

Qua2SeDiMo: Quantifiable Quantization Sensitivity of Diffusion Models

Keith G. Mills, Mohammad Salameh, Ruichen Chen et al.

AccuQuant: Simulating Multiple Denoising Steps for Quantizing Diffusion Models

Seunghoon Lee, Jeongwoo Choi, Byunggwan Son et al.

NEURIPS 2025arXiv:2510.18650

#46

Binary Quadratic Quantization: Beyond First-Order Quantization for Real-Valued Matrix Compression

Kyo Kuroki, Yasuyuki Okoshi, Thiem Van Chu et al.

matrix quantizationbinary quadratic quantizationpost-training quantizationvision transformer models+4

NEURIPS 2025arXiv:2509.20214

#47

Data-Free Quantization via Pseudo-label Filtering

Chunxiao Fan, Ziqi Wang, Dan Guo et al.

Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment

DEOKJAE LEE, Hyun Oh Song

weight-only quantizationpost-training quantizationlarge language model deploymentfractional-bit quantizers+4

low-bit integer trainingmixed-precision quantizationquantization sensitivity measurementimage classification+4

#49

Allowing Oscillation Quantization: Overcoming Solution Space Limitation in Low Bit-Width Quantization

Weiying Xie, Zihan Meng, Jitao Ma et al.

AMPA: Adaptive Mixed Precision Allocation for Low-Bit Integer Training

Li Ding, Wen Fei, Yuyang Huang et al.

ICML 2024