Cheng Luo

Taken at the G.E.M. concert

Hi,

I am currently a PhD student at IVUL lab at KAUST, supervised by Prof. Bernard Ghanem.

Previously, I earned my Master’s degree from the College of Computer Science and Software Engineering at Shenzhen University (SZU), under the co-supervision of A/Prof. Weicheng Xie and Prof. Linlin Shen.

My research focuses on affective artificial intelligence with three main goals:

Accurately comprehending human emotions (ME-GraphAU, SynFER)
Creating AI that interacts naturally with humans (OmniResponse, ReactFace, ReactDiff, React2023, React2024, and React2025)
Addressing mental health challenges through human-AI interaction

news

Sep 18, 2025	OmniResponse was accepted to NeurIPS 2025.
Jul 05, 2025	ReactDiff was accepted to ACM MM 2025.
Jul 03, 2025	SynFER was accepted to ICCV 2025.
Jul 03, 2025	Launched the grand challenge REACT2025 as an organizer on ACM MM conference.
Oct 21, 2024	ReactFace was accepted to TVCG (iEEE Transactions on Visualization and Computer Graphic)
Dec 09, 2023	One paper was accepted to AAAI 2024.
Jun 11, 2023	Launched the grand challenge REACT2023 as an organizer on ACM MM conference.
Apr 21, 2022	One paper was accepted to IJCAI 2022.
Mar 02, 2022	One paper was accepted to CVPR 2022.
Jul 23, 2021	One paper was accepted to ICCV 2021.

selected publications

NeurIPS

OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactions

Cheng Luo, Jianghui Wang, Bing Li, and 2 more authors

In Annual Conference on Neural Information Processing Systems, 2025

Bib HTML PDF Code

@inproceedings{luo2025omniresponseonlinemultimodalconversational,
  title = {OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactions},
  author = {Luo, Cheng and Wang, Jianghui and Li, Bing and Song, Siyang and Ghanem, Bernard},
  booktitle = {Annual Conference on Neural Information Processing Systems},
  year = {2025},
}

ACM MM

ReactDiff: Fundamental Multiple Appropriate Facial Reaction Diffusion Model

Cheng Luo, Siyang Song, Siyuan Yan, and 2 more authors

In Proceedings of the ACM International Conference on Multimedia, 2025

Bib

@inproceedings{luo2025reactidff,
  title = {ReactDiff: Fundamental Multiple Appropriate Facial Reaction Diffusion Model},
  author = {Luo, Cheng and Song, Siyang and Yan, Siyuan and Yu, Zhen and Ge, Zongyuan},
  booktitle = {Proceedings of the ACM International Conference on Multimedia},
  year = {2025},
}

TVCG

ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions

Cheng Luo, Siyang Song, Weicheng Xie, and 4 more authors

IEEE Transactions on Visualization and Computer Graphics, 2024

Bib Code

@article{luo2024reactface,
  title = {ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactions},
  author = {Luo, Cheng and Song, Siyang and Xie, Weicheng and Spitale, Micol and Ge, Zongyuan and Shen, Linlin and Gunes, Hatice},
  journal = {IEEE Transactions on Visualization and Computer Graphics},
  year = {2024},
}

IJCAI

Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition

Cheng Luo, Siyang Song, Weicheng Xie, and 2 more authors

In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, 2022

Bib PDF Code

@inproceedings{luo2022learning,
  title = {Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition},
  author = {Luo, Cheng and Song, Siyang and Xie, Weicheng and Shen, Linlin and Gunes, Hatice},
  booktitle = {Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, {IJCAI-22}},
  pages = {1239--1246},
  year = {2022},
}

CVPR

Frequency-driven imperceptible adversarial attack on semantic similarity

Cheng Luo, Qinliang Lin, Weicheng Xie, and 3 more authors

In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022

Bib PDF Code

@inproceedings{luo2022frequency,
  title = {Frequency-driven imperceptible adversarial attack on semantic similarity},
  author = {Luo, Cheng and Lin, Qinliang and Xie, Weicheng and Wu, Bizhu and Xie, Jinheng and Shen, Linlin},
  booktitle = {Proceedings of the IEEE/CVF conference on computer vision and pattern recognition},
  pages = {15315--15324},
  year = {2022},
}