Xiaoming Deng
Professor, Institute of Software Chinese Academy of Sciences
Email: xiaoming@iscas.ac.cn
Address: 4# South Fourth Street, Zhong Guan Cun, Beijing 100190
Postcode: 100190
Research Areas
My main research topics are computer vision, computer graphics, and robotics. Recently, I mainly design advanced algorithm or system to capture and synthesize high-quality 3D/2D human gestures, design gesture based user interface and dexterous manipulation system, and understand 3D/2D scene.
Feel free to contact me if you are interested in potential collaborations.
Education
1997-2001, Wuhan University, Bachelor
2001-2004, Wuhan University, Master
2004-2008, Institute of Automation Chinese Academy of Sciences, Ph.D.
Experience
2008-2010, Institute of Computing Technology Chinese Academy of Sciences, Postdoctoral Research Fellow
2012-2013, National University of Singapore, Singapore, Research Fellow
2010-now, Institute of Software Chinese Academy of Sciences, Assistant Professor, Associate Professor, Professor
Honors & Distinctions
1. Excellent Young Scientist, Chinese Simulation Federation, 2019.
2. CCF Science and Technology Award Invention Award: Key Technology of 3D Dynamical Human Modelling and Applications (the first prize), 2018.
3. Distinguished Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2015.
4. Excellent Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2014.
5. Member of Youth Innovation Promotion Association, Chinese Academy of Sciences, 2013.
6. K.C.Wong Post-doctoral Fellowship Award, 2009 (Awarded annually to 50 post-doctoral research fellows from all institutes of Chinese Academy of Sciences).
Publications
Journal:
[1] Zejian Li, Qi Liu, Jiaman Pan, Rui Huang, Lefan Hou, Xiangfei Hu, Jiarui Ma, Shengyuan Zhang, Jiesi Zhang,
Xuetao Tian, Yun Lu, Hao Jiang, Ling Yang, Xiaoming Deng, SCoRE: Standardized Human Evaluation Provides
a Reliable Measure for Semantic Consistency of Text-to-Image Generation. International Journal of Computer
Vision 134, 234 (2026).
[2] Haosheng Li, Weixin Mao, Zihan Lan, Hongwei Xiong, Hongan Wang, Chenyang Si, Ziwei Liu, Xiaoming
Deng, Hua Chen, BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action
Model, IEEE Robotics and Automation Letters, (2026). Video
[3] Jianping Jiang, Jiahe Li, Baowen Zhang, Xiaoming Deng, Boxin Shi, EvHandPose: Event-based 3D hand
pose estimation with sparse supervision. IEEE Transactions on Pattern Analysis and Machine Intelligence,
(2024) Video
[4] Xiaoming Deng, Dexin Zuo, Yinda Zhang, Zhaopeng Cui, Jian Cheng, Ping Tan, Liang Chang, Marc Pollefeys,
Sean Fanello, Hongan Wang, Recurrent 3D hand pose estimation using cascaded pose-guided 3D alignments.
IEEE Transactions on Pattern Analysis and Machine Intelligence, (2023) Video
[5] Fang Liu, Xiaoming Deng, Changqing Zou, Yu-Kun Lai, Keqi Chen, Ran Zuo, Cuixia Ma, Yong-Jin Liu,
Hongan Wang, SceneSketcher-v2: Fine-grained scene-level sketch-based image retrieval using adaptive
GCNs. IEEE Transactions on Image Processing, (2023) Video
[6] Ran Zuo, Xiaoming Deng, Keqi Chen, Zhengming Zhang, Yu-Kun Lai, Fang Liu, Cuixia Ma, Hao Wang,
Yong-Jin Liu, Hongan Wang, Fine-Grained Video Retrieval With Scene Sketches. IEEE Transactions on
Image Processing, (2023)
[7] Ze-Yuan Huang, Qiang He, Kevin T. Maher, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Shengfeng Qin,
Yong-Jin Liu, Hongan Wang, SpeechMirror: A Multimodal Visual Analytics System for Personalized Reflection
of Online Public Speaking Effectiveness. IEEE Transactions on Visualization and Computer Graphics, (2023)
[8] Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma, Hongan Wang,
Weakly-supervised learning for single depth based hand shape recovery. IEEE Transactions on Image
Processing, (2021) Video
[9] Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui, Ping Tan,
Liang Chang, Hongan Wang, Hand pose understanding with large-scale photo-realistic rendering dataset.
IEEE Transactions on Image Processing, (2021) Video
[10] Kevin T. Maher, Ze-Yuan Huang, Jian-Cheng Song, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Hao Wang,
Yong-Jin Liu, Hongan Wang, E-ffective: A visual analytic system for exploring the emotion and effectiveness
of inspirational speeches. IEEE Transactions on Visualization and Computer Graphics, (2021)
[11] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Weakly supervised adversarial learning for 3D human
pose estimation from point clouds. IEEE Transactions on Visualization and Computer Graphics, (2020) Video
[12] Xiaobing Du, Xiaoming Deng, Hangyu Qin, Yezhi Shu, Fang Liu, Guozhen Zhao, Yu-Kun Lai, Cuixia Ma,
Yong-Jin Liu, Hongan Wang, MMPosE: Movie-induced multi-label positive emotion classification through EEG
signals, IEEE Transactions on Affective Computing, (2023)
[13] Xiaobing Du, Cuixia Ma, Guanhua Zhang, Jinyao Li, Yu-Kun Lai, Guozhen Zhao, Xiaoming Deng, Yong-Jin
Liu, Hongan Wang, An efficient LSTM network for emotion recognition from multichannel EEG signals. IEEE
Transactions on Affective Computing, (2020)
[14] Xiaoming Deng, Yinda Zhang, Shuo Yang, Ping Tan, Liang Chang, Ye Yuan, Hongan Wang, Joint hand detection
and rotation estimation using CNN, IEEE Transactions on Image Processing, (2018)
[15] Wei Zhang, Zeyi Lin, Jian Cheng, Cuixia Ma, Xiaoming Deng, Hongan Wang, STA-GCN: two-stream
graph convolutional network with spatial–temporal attention for hand gesture recognition, The Visual
Computer, (2020)
[16] Dachuan Cheng, Jian Shi, Yanyun Chen, Xiaoming Deng, Xiaopeng Zhang, Learning scene illumination
by pairwise photos from rear and front mobile cameras, Computer Graphics Forum, (2018)
[17] Xiaoming Deng, Fuchao Wu, Yihong Wu, Fuqing Duan, Liang Chang, Hongan Wang, Self-calibration of hybrid
central catadioptric and perspective cameras, Computer Vision and Image Understanding, (2012)
[18] Fuqing Duan, Fuchao Wu, Mingquan Zhou, Xiaoming Deng, Yun Tian, Calibrating effective focal length
for central catadioptric cameras using one space line, Pattern Recognition Letters, (2012)
[19] Hui Zeng, Xiaoming Deng, Zhanyi Hu, A new normalized method on line-based homography estimation,
Pattern Recognition Letters, (2008)
Conference:
[1] Haosheng Li, Weixin Mao, Weipeng Deng, Chenyu Meng, Haoqiang Fan, Tiancai Wang, Osamu Yoshie,
Ping Tan, Hongan Wang, Xiaoming Deng, Multi-GraspLLM: Multimodal LLM for Multi-Hand Semantic Guided
Grasp Generation. CoRL 2026
[2] Yang Zou, Yanguang Wan, Yonghao Zhang, Xiao Zhou, Jian Cheng, Cuixia Ma, Chun Yu, Xiaoming Deng,
Hongan Wang, Gesture Builder: Flexible Gesture Customization and Efficient Recognition on VR Devices.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2025 Video
[3] Zeyuan Huang, Cangjun Gao, Yaxian Shan, Haoxiang Hu, Qingkun Li, Xiaoming Deng, Cuixia Ma, Yu-Kun Lai,
Yong-Jin Liu, Feng Tian, Guozhong Dai, and Hongan Wang. SketchGPT: A Sketch-based Multimodal Interface
for Application-Agnostic LLM Interaction. UIST 2025 Video
[4] Wentian Qu, Jiahe Li, Jian Cheng, Jian Shi, Chenyu Meng, Cuixia Ma, Hongan Wang, Xiaoming Deng,
Yinda Zhang, HOGSA: Bimanual Hand-Object Interaction Understanding with 3D Gaussian Splatting
Based Data Augmentation. AAAI 2025 Video
[5] Wentian Qu, Chenyu Meng, Heng Li, Jian Cheng, Cuixia Ma, Hongan Wang, Xiao Zhou, Xiaoming Deng,
Ping Tan, Universal Features Guided Zero-Shot Category-Level Object Pose Estimation. AAAI 2025
[6] Yonghao Zhang, Qiang He, Yanguang Wan, Yinda Zhang, Xiaoming Deng, Cuixia Ma, Hongan Wang,
DiffGrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model. AAAI 2025 Video
[7] Jianping Jiang, Xinyu Zhou, Bingxuan Wang, Xiaoming Deng, Chao Xu, Boxin Shi, Complementing event
streams and RGB frames for hand mesh reconstruction. CVPR 2024. Video
[8] Ran Zuo, Haoxiang Hu, Xiaoming Deng, Cangjun Gao, Zhengming Zhang, Yu-Kun Lai, Cuixia Ma,
Yong-Jin Liu, Hongan Wang, SceneDiff: Generative Scene-Level Image Retrieval with Text and Sketch Using
Diffusion Models. IJCAI 2024.
[9] Zeyuan Huang, Cangjun Gao, Haiyan Wang, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Shengfeng Qin,
Yong-Jin Liu, Hongan Wang, SpeciFingers: Finger Identification and Error Correction on Capacitive
Touchscreens. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8(1) 2024.
[10] Haoxiang Hu, Cangjun Gao, Yaokun Li, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Yong-Jin Liu, Hongan Wang,
SpaceGTN: A Time-Agnostic Graph Transformer Network for Handwritten Diagram Recognition and
Segmentation. AAAI 2024.
[11] Baowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang, Cuixia Ma, Hongan Wang, Self-supervised
learning of implicit shape representation with dense correspondence for deformable objects. ICCV 2023.
[12] Wentian Qu, Zhaopeng Cui, Yinda Zhang, Chenyu Meng, Cuixia Ma, Xiaoming Deng, Hongan Wang,
Novel-view synthesis and pose estimation for hand-object interaction from sparse views. ICCV 2023. Video
[13] Jian Cheng, Yanguang Wan, Dexin Zuo, Cuixia Ma, Jian Gu, Ping Tan, Hongan Wang, Xiaoming Deng,
Yinda Zhang, Efficient virtual view selection for 3D hand pose estimation, AAAI 2022.
[14] Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma, Hongan Wang,
Interacting two-hand 3D pose and shape reconstruction from single color image, ICCV 2021. Video
[15] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Sequential 3D human pose estimation using
adaptive point cloud sampling strategy, IJCAI 2021. Video
[16] Fang Liu, Changqing Zou, Xiaoming Deng, Ran Zuo, Yu-Kun Lai, Cuixia Ma, Yong-Jin Liu, Hongan Wang,
SceneSketcher: Fine-grained image retrieval with scene sketches, ECCV 2020. Video
[17] Fang Liu, Xiaoming Deng, Yu-Kun Lai, Yong-Jin Liu, Cuixia Ma, Hongan Wang, SketchGAN: Joint sketch
completion and recognition with generative adversarial network, CVPR 2019.
[18] Xiaoming Deng, Shihong Xia, Wenzhong Wang, Zhaoqi Wang, Liang Chang, Hongan Wang, Automatic gait
motion capture with missing-marker fillings, ICPR 2014.
[19] Zhenlong Zhou, Bo Shu, Shaojie. Zhuo, Xiaoming Deng, Ping Tan, Stephen Lin, Image-based clothes animation
for virtual fitting, ACM SIGGRAPH Asia 2012, Technical briefs.
Students
GRADUATED STUDENTS
Ye Yuan, MSc,
Shuo Yang, MSc,
Yuying Zhu, MSc
Dexin Zuo, MSc
Zeyi Lin, MSc
Jian Cheng, MSc
Mingyu Ke, MSc
Baowen Zhang, MSc
Yanguang Wan, MSc
Jiahe Li, MSc
Wentian Qu, PhD
Yonghao Zhang, MSc
CURRENT STUDENTS
Jian Cheng, PhD Student
Chenyu Meng, PhD Student
Liufei Ouyang, PhD Student
Qiang He, PhD Student
Yang Zou, Master Student
Haosheng Li, Master Student
Jiaxi Sun, Master Student