Energy-Based Models

CVPR 2024arXiv:2312.06059

#2

CONFORM: Contrast is All You Need for High-Fidelity Text-to-Image Diffusion Models

Tuna Han Salih Meral, Enis Simsar, Federico Tombari et al.

51

ICLR 2025arXiv:2406.00222

#3

Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training

Maximillian Chen, Ruoxi Sun, Tomas Pfister et al.

34

ICML 2025arXiv:2410.14632

#4

Diverging Preferences: When do Annotators Disagree and do Models Know?

Michael Zhang, Zhilin Wang, Jena Hwang et al.

33

ICLR 2024arXiv:2401.14142

#5

Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretations

Xinyue Xu, Yi Qin, Lu Mi et al.

29

ICLR 2024arXiv:2304.06094

#6

Energy-guided Entropic Neural Optimal Transport

Petr Mokrov, Alexander Korotin, Alexander Kolesov et al.

28

AAAI 2024arXiv:2401.17390

#7

Customizing Language Model Responses with Contrastive In-Context Learning

Xiang Gao, Kamalika Das

contrastive learninglanguage model alignmentin-context learningintent customization+4

20

ICLR 2025arXiv:2404.07983

#8

Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models

Simon Schrodi, David T. Hoffmann, Max Argus et al.

19

ICLR 2024arXiv:2309.05153

#9

Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood

yaxuan zhu, Jianwen Xie, Yingnian Wu et al.

18

ECCV 2024arXiv:2404.07389

#10

A New Mechanism for Eliminating Implicit Conflict in Graph Contrastive Learning

Dongxiao He, Jitao Zhao, Cuiying Huo et al.

Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion Models

Yasi Zhang, Peiyu Yu, Ying Nian Wu

18

NEURIPS 2025arXiv:2505.11293

#12

Breaking the Batch Barrier (B3) of Contrastive Learning via Smart Batch Mining

Raghuveer Thirukovalluru, Rui Meng, Ye Liu et al.

16

CVPR 2025arXiv:2408.04594

#13

Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Models

Qirui Jiao, Daoyuan Chen, Yilun Huang et al.

15

ICML 2025arXiv:2405.15476

#14

Editable Concept Bottleneck Models

Lijie Hu, Chenyang Ren, Zhengyu Hu et al.

14

NEURIPS 2025arXiv:2504.10612

#15

Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling

Michal Balcerak, Tamaz Amiranashvili, Antonio Terpin et al.

energy-based modelsflow matchinggenerative modelingoptimal transport paths+4

12

ICLR 2025arXiv:2309.05803

#16

Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Models

Sumeet Singh, Vikas Sindhwani, Stephen Tu

11

ICLR 2024arXiv:2402.07577

#17

Topic Modeling as Multi-Objective Contrastive Optimization

Thong Thanh Nguyen, Xiaobao Wu, Xinshuai Dong et al.

10

ICLR 2025arXiv:2410.16719

#18

Progressive Compositionality in Text-to-Image Generative Models

Xu Han, Linghao Jin, Xiaofeng Liu et al.

text-to-image synthesisdiffusion modelscompositional reasoningcontrastive learning+3

9

AAAI 2025arXiv:2409.05606

#19

CustomContrast: A Multilevel Contrastive Perspective for Subject-Driven Text-to-Image Customization

Nan Chen, Mengqi Huang, Zhuowei Chen et al.

9

ICML 2024arXiv:2402.19009

#20

Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding

Guangyi Liu, Yu Wang, Zeyu Feng et al.

diffusion modelslatent encoding-decodinggenerative modelsunified representation learning+3

8

ECCV 2024arXiv:2410.09802

#21

EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models

Lee Eungbean, Somi Jeong, Kwanghoon Sohn

exemplar-guided image translationbrownian-bridge diffusiondiffusion modelsstyle manipulation+3

8

ECCV 2024arXiv:2407.06315

#22

Shedding More Light on Robust Classifiers under the lens of Energy-based Models

Mujtaba Hussain Mirza, Maria Rosaria Briglia, Senad Beadini et al.

adversarial trainingenergy-based modelsrobust classifiersadversarial attacks+3

7

ICML 2025arXiv:2412.13862

#23

Energy-Based Preference Model Offers Better Offline Alignment than the Bradley-Terry Preference Model

Yuzhong Hong, Hanshan Zhang, Junwei Bao et al.

6

ICLR 2025arXiv:2410.11826

#24

Bayesian Experimental Design Via Contrastive Diffusions

Jacopo Iollo, Christophe Heinkelé, Pierre Alliez et al.

bayesian optimal experimental designexpected information gaincontrastive diffusionsdiffusion-based samplers+4

6

NEURIPS 2025arXiv:2506.16029

#25

EvoLM: In Search of Lost Language Model Training Dynamics

Zhenting Qi, Fan Nie, Alexandre Alahi et al.

language model trainingtraining dynamics analysiscontinued pre-trainingsupervised fine-tuning+4

AAAI 2024arXiv:2312.12659

#26

Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders

Bumsoo Kim, Jinhyung Kim, Yeonsik Jo et al.

contrastive language-image pretrainingknowledge distillationvision language pretrainingimage-text alignment+3

ICLR 2024arXiv:2309.08351

#27

Headless Language Models: Learning without Predicting with Contrastive Weight Tying

Nathan Godey, Éric Clergerie, Benoît Sagot

contrastive weight tyingself-supervised pre-traininglanguage modelsembedding reconstruction+3

ICML 2024arXiv:2405.13910

#28

Learning Latent Space Hierarchical EBM Diffusion Models

Jiali Cui, Tian Han

energy-based modelslatent space hierarchyprior hole problemdiffusion probabilistic models+4

ICML 2024arXiv:2403.01666

#29

Improving Adversarial Energy-Based Model via Diffusion Process

Cong Geng, Tian Han, Peng-Tao Jiang et al.

energy-based modelsadversarial trainingdiffusion modelsdensity estimation+4

ICLR 2025arXiv:2411.16502

#30

Interpreting Language Reward Models via Contrastive Explanations

Junqi Jiang, Tom Bewley, Saumitra Mishra et al.

reward modelslanguage model alignmentcontrastive explanationsexplainable ai+3

ICML 2025arXiv:2410.02131

#31

Boosting Masked ECG-Text Auto-Encoders as Discriminative Learners

Hung Manh Pham, Aaqib Saeed, Dong Ma

ECCV 2024arXiv:2409.19862

#32

Learning Multimodal Latent Generative Models with Energy-Based Prior

Shiyu Yuan, Jiali Cui, Hanao Li et al.

multimodal generative modelsenergy-based modelslatent generative modelsmultimodal representation learning+3

CVPR 2025arXiv:2503.16406

#33

VerbDiff: Text-Only Diffusion Models with Enhanced Interaction Awareness

SeungJu Cha, Kwanyoung Lee, Ye-Chan Kim et al.

text-to-image generationdiffusion modelsinteraction understandinghuman-object interaction+3

ECCV 2024arXiv:2408.01091

#34

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

Jin Gao, Lei Gan, Yuankai Li et al.

self-contradictory instructionsmultimodal modelsinstruction discordancedissonance detection+4

ICLR 2025arXiv:2411.08923

#35

Bridge Diffusion Model: Bridge Chinese Text-to-Image Diffusion Model with English Communities

Shanyuan Liu, Bo Cheng, Yuhang Ma et al.

Energy-Clibrated VAE with Test Time Free Lunch

Yihong Luo, Siya Qiu, Xingjian Tao et al.

Aligning Visual Contrastive learning models via Preference Optimization

Amirabbas Afzali, Borna khodabandeh, Ali Rasekh et al.

contrastive learningpreference optimizationtypographic attacksvision-language models+3

NEURIPS 2025arXiv:2510.20819

#38

Towards General Modality Translation with Contrastive and Predictive Latent Diffusion Bridge

Nimrod Berman, Omkar Joglekar, Eitan Kosman et al.

COLM 2025arXiv:2504.13134

#39

Energy-Based Reward Models for Robust Language Model Alignment

Anamika Lochab, Ruqi Zhang

Reward ModelsAlignmentEnergy Based Models

ICML 2025arXiv:2501.18528

#40

Joint Learning of Energy-based Models and their Partition Function

Michael Sander, Vincent Roulet, Tianlin Liu et al.

energy-based modelspartition function estimationmaximum likelihood estimationdiscrete combinatorial spaces+4

ICML 2024arXiv:2404.10575

#41

EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence

Chung-Yiu Yau, Hoi To Wai, Parameswaran Raman et al.

contrastive learningnegative samplingmarkov chain monte carloglobal convergence+4

2

CVPR 2025arXiv:2504.09606

#42

Early-Bird Diffusion: Investigating and Leveraging Timestep-Aware Early-Bird Tickets in Diffusion Models for Efficient Training

Lexington Whalen, Zhenbang Du, Haoran You et al.

diffusion modelsefficient trainingsparse subnetworksearly-bird tickets+4

2

ICLR 2025arXiv:2501.11326

#43

The "Law'' of the Unconscious Contrastive Learner: Probabilistic Alignment of Unpaired Modalities

Yongwei Che, Benjamin Eysenbach

contrastive embedding spacesunpaired modality alignmentprobabilistic graphical modelsmultimodal representation learning+3

ICML 2024arXiv:2306.11879

#44

Open-Domain Text Evaluation via Contrastive Distribution Methods

Sidi Lu, Hongyi Liu, Asli Celikyilmaz et al.

open-domain text generationcontrastive distribution methodslanguage model evaluationprobabilistic distribution mapping+3

NEURIPS 2025arXiv:2506.15893

#45

Formal Models of Active Learning from Contrastive Examples

Farnam Mansouri, Hans Simon, Adish Singla et al.

active learningcontrastive examplessample complexityconcept classes+3

NEURIPS 2025arXiv:2505.19646

#46

Energy-based generator matching: A neural sampler for general state space

Dongyeop Woo, Minsu Kim, Minkyu Kim et al.

ICCV 2025arXiv:2503.17226

#47

DDB: Diffusion Driven Balancing to Address Spurious Correlations

Aryan Yazdan Parast, Basim Azam, Naveed Akhtar

vision-language alignmentout-of-distribution detectionout-of-distribution generalizationenergy-based ood score+4

#48

DECIDER: Difference-aware Contrastive Diffusion Model with Adversarial Perturbations for Image Change Captioning

Guojin Zhong, Jinhong Hu, Jiajun Chen et al.

BiMAC: Bidirectional Multimodal Alignment in Contrastive Learning

Masoumeh Zareapoor, Pourya Shamsolmoali, Yue Lu

CLEP: A Novel Contrastive Learning Method for Evolutionary Reentrancy Vulnerability Detection

Jie Chen, Liangmin Wang, Huijuan Zhu et al.

$\Delta \mathrm{Energy}$: Optimizing Energy Change During Vision-Language Alignment Improves both OOD Detection and OOD Generalization

Lin Zhu, Yifeng Yang, Xinbing Wang et al.

NEURIPS 2025

ICCV 2025arXiv:2509.08940

#52

FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for

Jianqing Zhang, Yang Liu, Yang Hua et al.

Instruct Where the Model Fails: Generative Data Augmentation via Guided Self-contrastive Fine-tuning

Weijian Ma, Ruoxin Chen, Keyue Zhang et al.

Dual-Consistency Model Inversion for Non-Exemplar Class Incremental Learning

Zihuan Qiu, Yi Xu, Fanman Meng et al.

Multi-to-Single: Reducing Multimodal Dependency in Emotion Recognition Through Contrastive Learning

Yan-Kai Liu, Jinyu Cai, Bao-Liang Lu et al.

GeCC: Generalized Contrastive Clustering with Domain Shifts Modeling

Yujie Chen, Wenhui Wu, Le Ou-Yang et al.

Discovering Divergent Representations between Text-to-Image Models

Lisa Dunlap, Trevor Darrell, Joseph Gonzalez et al.

text-to-image modelsvisual representation divergenceevolutionary search algorithmprompt concept discovery+3

transition modelingcontrastive energy learningoffline reinforcement learningenergy-based models+4

#58

Offline Transition Modeling via Contrastive Energy Learning

Ruifeng Chen, Chengxing Jia, Zefang Huang et al.

ICML 2024

#59

Enhancing Post-training Quantization Calibration through Contrastive Learning

Yuzhang Shang, Gaowen Liu, Ramana Kompella et al.

What Limits Bidirectional Model's Generative Capabilities? A Uni-Bi-Directional Mixture-of-Expert Method For Bidirectional Fine-tuning

Zuchao Li, Yonghua Hei, Qiwei Li et al.

Boosting Multi-Domain Fine-Tuning of Large Language Models through Evolving Interactions between Samples

Xize Liang, Lin Yang, Jie Wang et al.

Dictionary Contrastive Learning for Efficient Local Supervision without Auxiliary Networks

Suhwan Choi, Myeongho Jeon, Yeonjung Hwang et al.

ICLR 2024