Dr. Xin Liu is a Tenured Associate Professor at the School of Psychology, Shanghai Jiao Tong University (2026–present). Prior to this, he served as an Associate Professor at LUT University in Finland (2021–2025) and as an Associate Professor at Tianjin University, China. He continues his affiliation with LUT University as an Adjunct Doctoral Supervisor.

He received dual Ph.D. degrees, one in Computer Science from the University of Oulu, Finland, supervised by Prof. Guoying Zhao, and another in Information and Communication Engineering from Xi'an Jiaotong University, China, supervised by Prof. Chun Qi. His academic journey includes research collaborations with Prof. Dacheng Tao at the University of Sydney as an Endeavour Research Fellow, and with Prof. Stefanos Zafeiriou at Imperial College London. He later returned to the University of Oulu as an Academy of Finland Postdoctoral Fellow, working alongside Prof. Guoying Zhao and Prof. Matti Pietikäinen at the CMVS group.

Dr. Liu's contributions to artificial intelligence have been recognized through numerous grants and awards. He has led multiple research projects funded by the National Natural Science Foundation of China, the Academy of Finland, the Finnish Ministry of Education, and CSC–IT Center for Science. His work has also received support from foundations and industry partners including the Finnish Foundation for Technology Promotion , the Nokia Foundation, the KAUTE Foundation, the Otto A. Malm Foundation, the Tauno Tönning Foundation, and the Riitta and Jorma J. Takanen Foundation. He was also the recipient of the prestigious Endeavour Research Fellowship awarded by the Australian Government. Dr. Liu is a Senior Member of IEEE and an active member of ACM, SPIE, ELLIS, and APA.

His research lies at the intersection of artificial intelligence and psychology, with a focus on developing objective computational methods and tools for emotion understanding and mental health assessment using computer vision and machine learning. His core interests include trustworthy affective computing and human-machine empathy, and he has made innovative contributions to multimodal large language models for emotion analysis, micro-gesture and micro-expression analysis, and remote physiological signal detection. He has published over 80 papers in leading international journals and conferences, including IEEE TPAMI, IJCV, CVPR, and ICLR, and holds more than 20 patents. He currently serves as an Associate Editor for several international journals, including IEEE Transactions on Multimedia.

Website:https://linuxsino.github.io/

Human–AI Empathy

Trustworthy Affective Intelligence

Multimodal Large Models for Emotion Understanding

Shanghai Jiao Tong University, China

Associate Professor, School of Psychology

January 2026 – Present

LUT University, Finland

Associate Professor (Tenure Track), Department of Computational Engineering

August 2021 – July 2025

Tianjin University, China

Associate Professor

August 2020 – July 2021

University of Oulu, Finland

Postdoctoral Researcher

April 2019 – July 2020

Imperial College London, UK

Visiting Scholar

March 2019 – August 2019

The University of Sydney, Australia

Endeavour Research Fellow

August 2017 – February 2018

Adjunct Doctoral Supervisor, LUT University, Finland

Editorial Board Member of three international journals, including IEEE Transactions on Multimedia

Area Chair, Senior Program Committee (SPC) Member, and Program Committee Member for major international conferences, including CVPR, ICCV, ECCV, ICLR, NeurIPS, ICML, ACM MM, and AAAI.

IEEE Senior Member

Member of ACM, APA, ELLIS, and SPIE

Xin Liu has published more than 80 papers in international journals and conferences and holds more than 20 patents.

Selected Publications

1.B. Xing, X. Liu, G. Zhao, C. Liu, X. Fu, and H. Kälviäinen. “EmotionHallucer: Evaluating Emotion Hallucinations in Multimodal Large Language Models.” International Conference on Learning Representations, 2026. (ICLR)

2.B. Xing, Z. Yu, X. Liu, K. Yuan, Q. Ye, W. Xie, H. Yue, J. Yang, and H. Kälviäinen. “EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuning.” International Journal of Computer Vision, 2026. (IJCV)

3.R. Gao, X. Liu, Z. Hu, B. Xing, B. Xia, Z. Yu, and H. Kälviäinen. “Identity-free Artificial Emotional Intelligence via Micro-Gesture Understanding.” IEEE Transactions on Affective Computing, 2026. (TAC)

4.K. Yuan, Z. Yu, X. Liu, B. Xing, Y. Zhang, W. Xie, L. Shen, and B. Schuller. “Multi-granularity Facial Emotional Representation with Unlabeled Data and Textual Supervision.” IEEE Transactions on Image Processing, 2026. (TIP)

5.D. Li, J. Shao, B. Xing, R. Gao, B. Wen, H. Kälviäinen, and X. Liu. “MSF-Mamba: Motion-aware State Fusion Mamba for Efficient Micro-Gesture Recognition.” IEEE Transactions on Multimedia, 2026. (TMM)

6.L. Zheng, Y. Zong, C. Lu, T. Zhang, J. Shi, X. Liu, and W. Zheng. “Advancing Micro-Expression Recognition: A Task-Specific Framework Integrating Frequency Analysis and Structural Embedding.” IEEE Transactions on Affective Computing, 2026. (TAC)

7.R. Gao, X. Li, D. Li, X. Liu, and H. Kälviäinen. “Speak on Cue, Remember on Point: Event-Aware Streaming Video Commentary.” ACM International Conference on Multimedia, 2026. (ACM MM)

8.Y. Ma, X. Lin, Z. Yu, H. Wang, R. Zhang, S. Ding, X. Liu, X. Yuan, W. Xie, and L. Shen. “Purify then Guide: Rethinking Domain Generalization for Multimodal Face Anti-Spoofing.” European Conference on Computer Vision, 2026. (ECCV)

9.X. Ge, S. Chai, L. Gong, Z. Yu, X. Liu, and T. Ge. “VC-VAE: Leveraging Video Codecs for Training-Efficient and High-Fidelity Video VAE.” European Conference on Computer Vision, 2026. (ECCV)

10.H. Yue, X. Li, G. Liu, M. Sun, X. Liu, and J. Yang. “DIC-DDA: Learned Distributed Image Compression via Dual Domain Alignment.” IEEE Transactions on Image Processing, 2026. (TIP)

11.D. Li, B. Xing, X. Liu, B. Xia, B. Wen, and H. Kälviäinen. “DEEMO: De-identity Multimodal Emotion Recognition and Reasoning.” ACM International Conference on Multimedia, 2025. (ACM MM)

12.Z. Hu, K. Yuan, X. Liu, Z. Yu, Y. Zong, J. Shi, H. Yue, and J. Yang. “FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoning.” ACM International Conference on Multimedia, 2025. (ACM MM)

13.Q. Ye, Z. Yu, R. Shao, Y. Cui, X. Kang, X. Liu, P. Torr, and X. Cao. “CAT+: Investigating and Enhancing Audio-visual Understanding in Large Language Models.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025. (TPAMI)

14.R. Wu, W. Zhuo, J. Shi, X. Liu, L. Shen, Y. Gong, and G. Zhao. “HemNet: Hemoglobin-Assistant Network for Video-based Remote Photoplethysmography Measurement.” IEEE Transactions on Circuits and Systems for Video Technology, 2025. (TCSVT)

15.Y. Zhang, H. Lu, X. Liu, Y. Chen, and K. Wu. “Advancing Generalizable Remote Physiological Measurement through the Integration of Explicit and Implicit Prior Knowledge.” IEEE Transactions on Image Processing, 2025. (TIP)

16.C. Hao, Z. Yu, X. Liu, J. Xu, H. Yue, and J. Yang. “A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection.” IEEE Transactions on Image Processing, 2025. (TIP)

17.R. Gao, X. Liu, Z. Hu, B. Xing, B. Xia, Z. Yu, and H. Kälviäinen. “FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding.” IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025. (CVPR)

18.Y. Zhang, H. Lu, Q. Hu, Y. Wang, K. Yuan, X. Liu, and K. Wu. “Period-LLM: Extending the Periodic Capability of Multimodal Large Language Model.” IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025. (CVPR)

19.S. Chu, J. Shi, X. Cheng, H. Chen, X. Liu, and G. Zhao. “To Remember, To Adapt, To Preempt: A Stable Continual Test-Time Adaptation Framework for Remote Physiological Measurement in Dynamic Domain Shifts.” ACM International Conference on Multimedia, 2025. (ACM MM)

20.J. Yang, X. Lin, Y. Cui, L. Zhang, X. Liu, H. Li, and Z. Yu. “Dual Alignment of Domain and Modality for Face Anti-spoofing.” International Conference on Computer Vision, 2025. (ICCV)

21.C. Cao, H. Yue, X. Liu, and J. Yang. “Zero-shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model.” AAAI Conference on Artificial Intelligence, 2025. (AAAI)

22.X. Liu, K. Yuan, X. Niu, J. Shi, Z. Yu, H. Yue, and J. Yang. “Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection.” IEEE Transactions on Affective Computing, 2024. (TAC)

23.Z. Yu, R. Cai, Y. Cui, X. Liu, Y. Hu, and A. Kot. “Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofing.” International Journal of Computer Vision, 2024. (IJCV)

24.X. Liu, Y. Zhang, Z. Yu, H. Lu, H. Yue, and J. Yang. “rPPG-MAE: Self-Supervised Pretraining with Masked Autoencoders for Remote Physiological Measurements.” IEEE Transactions on Multimedia, 2024. (TMM)

25.K. Yuan, Z. Yu, X. Liu, W. Xie, H. Yue, and J. Yang. “AUFormer: Vision Transformers are Parameter-Efficient Facial Action Unit Detectors.” European Conference on Computer Vision, 2024. (ECCV)

26.X. Ge, X. Liu, Z. Yu, J. Shi, C. Qi, J. Li, and H. Kälviäinen. “DiffFAS: Face Anti-Spoofing via Generative Diffusion Models.” European Conference on Computer Vision, 2024. (ECCV)

27.H. Chen, H. Shi, X. Liu, X. Li, and G. Zhao. “SMG: A Micro-Gesture Dataset Towards Spontaneous Body Gestures for Emotional Stress State Analysis.” International Journal of Computer Vision, 2023. (IJCV)

28.Z. Wang, Z. Yu, X. Wang, J. Li, C. Zhao, X. Liu, and Z. Lei. “Consistency Regularization for Deep Face Anti-Spoofing.” IEEE Transactions on Information Forensics and Security, 2023. (TIFS)

29.H. Yue, Y. Cheng, X. Liu, and J. Yang. “Recaptured Raw Screen Image and Video Demoiréing via Channel and Spatial Modulations.” Advances in Neural Information Processing Systems, 2023. (NeurIPS)

30.X. Liu and G. Zhao. “3D Skeletal Gesture Recognition using Sparse Coding of Time-Warping Invariant Riemannian Trajectories.” IEEE Transactions on Multimedia, 2021. (TMM)

31.Z. Yu, B. Zhou, J. Wan, P. Wang, H. Chen, X. Liu, S. Li, and G. Zhao. “Searching Multi-Rate and Multi-Modal Temporal Enhanced Networks for Gesture Recognition.” IEEE Transactions on Image Processing, 2021. (TIP)

32.X. Liu, H. Shi, H. Chen, Z. Yu, X. Li, and G. Zhao. “iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis.” IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021. (CVPR)

33.X. Liu, H. Shi, X. Hong, H. Chen, D. Tao, and G. Zhao. “3D Skeletal Gesture Recognition via Hidden States Exploration.” IEEE Transactions on Image Processing, 2020. (TIP)

● High-Performance Computing Project, Finnish IT Center for Science (CSC)

Multimodal Large Models for Human Emotion Prediction

Principal Investigator

● General Program, National Natural Science Foundation of China (NSFC)

Self-Supervised Learning for Human Micro-Gesture Recognition and Affective Analysis

Principal Investigator

● Doctoral Student Funding, Finnish Ministry of Education and Culture (OKM)

Identity-Free Micro-Gesture-Based Emotion Recognition and Understanding

Principal Investigator

● Postdoctoral Researcher Funding, Academy of Finland

Win or Lose? Emotion AI via Identity-Free Body Language Recognition and Understanding

Principal Investigator

● KAUTE Foundation Research Grant, Finland

Human Micro-Gesture Analysis for Implicit Emotion Understanding

Principal Investigator

● Technology Promotion Foundation, Finland

Communicative Gesture Analysis Using Computer Vision Methods

Principal Investigator

● Australian Government Department of Education Endeavour Research Fellowship

Communicative Gesture Analysis through Temporal Dynamics and Contextual Understanding

Principal Investigator