General

Xiaoming Deng

Professor, Institute of Software Chinese Academy of Sciences


Email: xiaoming@iscas.ac.cn
Address: 4# South Fourth Street, Zhong Guan Cun, Beijing 100190

Postcode: 100190

Research Areas

My main research topics are computer vision, computer graphics, and robotics. Recently, I mainly design advanced algorithm or system to capture and synthesize high-quality 3D/2D human gestures, design gesture based user interface and dexterous manipulation system, and understand 3D/2D scene.


Feel free to contact me if you are interested in potential collaborations.

Education

1997-2001, Wuhan University, Bachelor 

2001-2004, Wuhan University, Master 

2004-2008, Institute of Automation Chinese Academy of Sciences, Ph.D. 


Experience

2008-2010, Institute of Computing Technology Chinese Academy of Sciences, Postdoctoral Research Fellow 

2012-2013, National University of Singapore, Singapore, Research Fellow 

2010-now, Institute of Software Chinese Academy of Sciences, Assistant Professor, Associate Professor, Professor


Honors & Distinctions

1. Excellent Young Scientist, Chinese Simulation Federation, 2019. 

2. CCF Science and Technology Award Invention Award: Key Technology of 3D Dynamical Human Modelling and Applications (the first prize), 2018. 

3. Distinguished Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2015. 

4. Excellent Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2014. 

5. Member of Youth Innovation Promotion Association, Chinese Academy of Sciences, 2013. 

6. K.C.Wong Post-doctoral Fellowship Award, 2009 (Awarded annually to 50 post-doctoral research fellows from all institutes of Chinese Academy of Sciences). 


Publications


Journal:

[1] Zejian Li, Qi Liu, Jiaman Pan, Rui Huang, Lefan Hou, Xiangfei Hu, Jiarui Ma, Shengyuan Zhang, Jiesi Zhang,

Xuetao Tian, Yun Lu, Hao Jiang, Ling Yang, Xiaoming Deng, SCoRE: Standardized Human Evaluation Provides

a Reliable Measure for Semantic Consistency of Text-to-Image Generation. International Journal of Computer

Vision 134, 234 (2026).

[2] Haosheng Li, Weixin Mao, Zihan Lan, Hongwei Xiong, Hongan Wang, Chenyang Si, Ziwei Liu, Xiaoming

Deng, Hua Chen, BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action

Model, IEEE Robotics and Automation Letters, (2026). Video

[3] Jianping Jiang, Jiahe Li, Baowen Zhang, Xiaoming Deng, Boxin Shi, EvHandPose: Event-based 3D hand

 pose estimation with sparse supervision. IEEE Transactions on Pattern Analysis and Machine Intelligence,

 (2024) Video

[4] Xiaoming Deng, Dexin Zuo, Yinda Zhang, Zhaopeng Cui, Jian Cheng, Ping Tan, Liang Chang, Marc Pollefeys,

 Sean Fanello, Hongan Wang, Recurrent 3D hand pose estimation using cascaded pose-guided 3D alignments.

 IEEE Transactions on Pattern Analysis and Machine Intelligence, (2023) Video

[5] Fang Liu, Xiaoming Deng, Changqing Zou, Yu-Kun Lai, Keqi Chen, Ran Zuo, Cuixia Ma, Yong-Jin Liu,

Hongan Wang, SceneSketcher-v2: Fine-grained scene-level sketch-based image retrieval using adaptive

GCNs. IEEE Transactions on Image Processing, (2023) Video

[6] Ran Zuo, Xiaoming Deng, Keqi Chen, Zhengming Zhang, Yu-Kun Lai, Fang Liu, Cuixia Ma, Hao Wang,

Yong-Jin Liu, Hongan Wang, Fine-Grained Video Retrieval With Scene Sketches. IEEE Transactions on

Image Processing, (2023)

[7] Ze-Yuan Huang, Qiang He, Kevin T. Maher, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Shengfeng Qin,

Yong-Jin Liu, Hongan Wang, SpeechMirror: A Multimodal Visual Analytics System for Personalized Reflection

 of Online Public Speaking Effectiveness. IEEE Transactions on Visualization and Computer Graphics, (2023)

 Video

[8] Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma, Hongan Wang,

 Weakly-supervised  learning for single depth based hand shape recovery. IEEE Transactions on Image

 Processing, (2021) Video

[9] Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui, Ping Tan,

 Liang Chang, Hongan Wang, Hand pose understanding with large-scale photo-realistic rendering dataset.

 IEEE Transactions on Image Processing, (2021) Video

[10] Kevin T. Maher, Ze-Yuan Huang, Jian-Cheng Song, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Hao Wang,

 Yong-Jin Liu, Hongan Wang, E-ffective: A visual analytic system for exploring the emotion and effectiveness

 of inspirational speeches. IEEE Transactions on Visualization and Computer Graphics, (2021)

[11] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Weakly supervised adversarial learning for 3D human

 pose estimation from point clouds. IEEE Transactions on Visualization and Computer Graphics, (2020) Video

[12] Xiaobing Du, Xiaoming Deng, Hangyu Qin, Yezhi Shu, Fang Liu, Guozhen Zhao, Yu-Kun Lai,  Cuixia Ma,

 Yong-Jin Liu, Hongan Wang, MMPosE: Movie-induced multi-label positive emotion classification through EEG

 signals, IEEE Transactions on Affective Computing, (2023)

[13] Xiaobing Du, Cuixia Ma, Guanhua Zhang, Jinyao Li, Yu-Kun Lai, Guozhen Zhao, Xiaoming Deng,  Yong-Jin

 Liu, Hongan Wang,  An efficient LSTM network for emotion recognition from multichannel EEG signals. IEEE

 Transactions on Affective Computing, (2020)

[14] Xiaoming Deng, Yinda Zhang, Shuo Yang, Ping Tan, Liang Chang, Ye Yuan, Hongan Wang, Joint hand detection

 and rotation estimation using CNN, IEEE Transactions on Image Processing,  (2018)

[15] Wei Zhang, Zeyi Lin, Jian Cheng, Cuixia Ma, Xiaoming Deng, Hongan Wang, STA-GCN: two-stream

 graph convolutional network with spatial–temporal attention for hand gesture recognition, The Visual

 Computer, (2020)

[16] Dachuan Cheng, Jian Shi, Yanyun Chen, Xiaoming Deng, Xiaopeng Zhang, Learning scene illumination

 by pairwise photos from rear and front mobile cameras, Computer Graphics Forum, (2018)

[17] Xiaoming Deng, Fuchao Wu, Yihong Wu, Fuqing Duan, Liang Chang, Hongan Wang, Self-calibration of hybrid

 central catadioptric and perspective cameras, Computer Vision and Image Understanding, (2012)  

[18] Fuqing Duan, Fuchao Wu, Mingquan Zhou, Xiaoming Deng, Yun Tian, Calibrating effective focal length

 for central catadioptric cameras using one space line, Pattern Recognition Letters, (2012) 

[19] Hui Zeng, Xiaoming Deng, Zhanyi Hu, A new normalized method on line-based homography estimation,

 Pattern Recognition Letters, (2008)


Conference:

[1] Haosheng Li, Weixin Mao, Weipeng Deng, Chenyu Meng, Haoqiang Fan, Tiancai Wang, Osamu Yoshie,

Ping Tan, Hongan Wang, Xiaoming Deng, Multi-GraspLLM: Multimodal LLM for Multi-Hand Semantic Guided

Grasp Generation. CoRL 2026

[2] Yang Zou, Yanguang Wan, Yonghao Zhang,  Xiao Zhou, Jian Cheng, Cuixia  Ma, Chun Yu, Xiaoming Deng,

 Hongan Wang, Gesture Builder: Flexible Gesture Customization and Efficient Recognition on VR Devices.

 Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2025  Video

[3] Zeyuan Huang, Cangjun Gao, Yaxian Shan, Haoxiang Hu, Qingkun Li, Xiaoming Deng, Cuixia Ma, Yu-Kun Lai,

Yong-Jin Liu, Feng Tian, Guozhong Dai, and Hongan Wang. SketchGPT: A Sketch-based Multimodal Interface

for Application-Agnostic LLM Interaction. UIST 2025 Video

[4] Wentian Qu, Jiahe Li, Jian Cheng, Jian Shi, Chenyu Meng, Cuixia Ma, Hongan Wang, Xiaoming Deng,

 Yinda Zhang, HOGSA: Bimanual Hand-Object Interaction Understanding with 3D Gaussian Splatting

Based Data Augmentation. AAAI 2025 Video

[5] Wentian Qu, Chenyu Meng, Heng Li, Jian Cheng, Cuixia Ma, Hongan Wang, Xiao Zhou, Xiaoming Deng,

 Ping Tan, Universal Features Guided Zero-Shot Category-Level Object Pose Estimation.  AAAI 2025 

[6] Yonghao Zhang, Qiang He, Yanguang Wan, Yinda Zhang, Xiaoming Deng, Cuixia Ma, Hongan Wang,

 DiffGrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model.  AAAI 2025 Video

[7] Jianping Jiang, Xinyu Zhou, Bingxuan Wang, Xiaoming Deng, Chao Xu, Boxin Shi, Complementing event

  streams and RGB frames for hand mesh reconstruction. CVPR 2024. Video

[8] Ran Zuo, Haoxiang Hu, Xiaoming Deng, Cangjun Gao, Zhengming Zhang, Yu-Kun Lai, Cuixia Ma,

 Yong-Jin Liu, Hongan Wang, SceneDiff: Generative Scene-Level Image Retrieval with Text and Sketch Using

 Diffusion Models. IJCAI 2024.

[9] Zeyuan Huang, Cangjun Gao, Haiyan Wang, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Shengfeng Qin,

 Yong-Jin Liu, Hongan Wang, SpeciFingers: Finger Identification and Error Correction on Capacitive

 Touchscreens. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8(1) 2024.

[10] Haoxiang Hu, Cangjun Gao, Yaokun Li, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Yong-Jin Liu, Hongan Wang,

 SpaceGTN: A Time-Agnostic Graph Transformer Network for Handwritten Diagram Recognition and

 Segmentation. AAAI 2024.

[11] Baowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang, Cuixia Ma, Hongan Wang, Self-supervised

 learning of implicit shape representation with dense correspondence for deformable objects. ICCV 2023.

[12] Wentian Qu, Zhaopeng Cui, Yinda Zhang, Chenyu Meng, Cuixia Ma, Xiaoming Deng, Hongan Wang,

 Novel-view synthesis and pose estimation for hand-object interaction from sparse views. ICCV 2023. Video

[13] Jian Cheng, Yanguang Wan, Dexin Zuo, Cuixia Ma, Jian Gu, Ping Tan, Hongan Wang, Xiaoming Deng,

 Yinda Zhang, Efficient virtual view selection for 3D hand pose estimation, AAAI 2022. 

[14] Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma, Hongan Wang,

 Interacting two-hand 3D pose and shape reconstruction from single color image, ICCV 2021. Video

[15] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Sequential 3D human pose estimation using

 adaptive point cloud sampling strategy, IJCAI 2021. Video

[16] Fang Liu, Changqing Zou, Xiaoming Deng, Ran Zuo, Yu-Kun Lai, Cuixia Ma, Yong-Jin Liu, Hongan Wang,

 SceneSketcher: Fine-grained image retrieval with scene sketches, ECCV 2020. Video

[17] Fang Liu, Xiaoming Deng, Yu-Kun Lai, Yong-Jin Liu, Cuixia Ma, Hongan Wang, SketchGAN: Joint sketch

 completion and recognition with generative adversarial network, CVPR 2019.

[18] Xiaoming Deng, Shihong Xia, Wenzhong Wang, Zhaoqi Wang, Liang Chang, Hongan Wang, Automatic gait

 motion capture with missing-marker fillings, ICPR 2014. 

[19] Zhenlong Zhou, Bo Shu, Shaojie. Zhuo, Xiaoming Deng, Ping Tan, Stephen Lin, Image-based clothes animation

 for virtual fitting, ACM SIGGRAPH Asia 2012, Technical briefs.

Students

GRADUATED STUDENTS

Ye Yuan, MSc,  

Shuo Yang, MSc, 

Yuying Zhu, MSc

Dexin Zuo, MSc

Zeyi Lin, MSc

Jian Cheng, MSc

Mingyu Ke, MSc

Baowen Zhang, MSc

Yanguang Wan, MSc

Jiahe Li, MSc

Wentian Qu, PhD

Yonghao Zhang, MSc

  

CURRENT STUDENTS  

Jian Cheng, PhD Student 

Chenyu Meng, PhD Student 

Liufei Ouyang, PhD Student

Qiang He, PhD Student

Yang Zou, Master Student

Haosheng Li, Master Student

Jiaxi Sun, Master Student