
Xiaoming Deng
Professor, Institute of Software Chinese Academy of Sciences
Email: xiaoming@iscas.ac.cn
Address: 4# South Fourth Street, Zhong Guan Cun, Beijing 100190
Postcode: 100190
Research Areas
My main research topics are computer vision, computer graphics, and robotics. Recently, I mainly design advanced algorithm or system to capture and synthesize high-quality 3D/2D human gestures, design gesture based user interface and dexterous manipulation system, and understand 3D/2D scene.
Feel free to contact me if you are interested in potential collaborations.
Education
1997-2001, Wuhan University, Bachelor
2001-2004, Wuhan University, Master
2004-2008, Institute of Automation Chinese Academy of Sciences, Ph.D.
Experience
2008-2010, Institute of Computing Technology Chinese Academy of Sciences, Postdoctoral Research Fellow
2012-2013, National University of Singapore, Singapore, Research Fellow
2010-now, Institute of Software Chinese Academy of Sciences, Assistant Professor, Associate Professor, Professor
Honors & Distinctions
1. Excellent Young Scientist, Chinese Simulation Federation, 2019.
2. CCF Science and Technology Award Invention Award: Key Technology of 3D Dynamical Human Modelling and Applications (the first prize), 2018.
3. Distinguished Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2015.
4. Excellent Young Researcher Program, Institute of Software Chinese Academy of Sciences, 2014.
5. Member of Youth Innovation Promotion Association, Chinese Academy of Sciences, 2013.
6. K.C.Wong Post-doctoral Fellowship Award, 2009 (Awarded annually to 50 post-doctoral research fellows from all institutes of Chinese Academy of Sciences).
7. Huawei Scholarship for Outstanding Graduate Students, 2003.
Publications
[1] Jianping Jiang, Jiahe Li, Baowen Zhang, Xiaoming Deng, Boxin Shi, EvHandPose: Event-based 3D hand
pose estimation with sparse supervision. IEEE Transactions on Pattern Analysis and Machine
Intelligence, (2024) Video
[2] Xiaoming Deng, Dexin Zuo, Yinda Zhang, Zhaopeng Cui, Jian Cheng, Ping Tan, Liang Chang,
Marc Pollefeys, Sean Fanello, Hongan Wang, Recurrent 3D hand pose estimation using cascaded
pose-guided 3D alignments. IEEE Transactions on Pattern Analysis and Machine Intelligence,
(2023) Video
[3] Fang Liu, Xiaoming Deng, Changqing Zou, Yu-Kun Lai, Keqi Chen, Ran Zuo, Cuixia Ma, Yong-Jin Liu,
Hongan Wang, SceneSketcher-v2: Fine-grained scene-level sketch-based image retrieval using adaptive
GCNs. IEEE Transactions on Image Processing, (2023) Video
[4] Ran Zuo, Xiaoming Deng, Keqi Chen, Zhengming Zhang, Yu-Kun Lai, Fang Liu, Cuixia Ma, Hao Wang,
Yong-Jin Liu, Hongan Wang, Fine-Grained Video Retrieval With Scene Sketches. IEEE Transactions on
Image Processing, (2023)
[5] Ze-Yuan Huang, Qiang He, Kevin T. Maher, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Shengfeng Qin,
Yong-Jin Liu, Hongan Wang, SpeechMirror: A Multimodal Visual Analytics System for Personalized
Reflection of Online Public Speaking Effectiveness. IEEE Transactions on Visualization and Computer
Graphics, (2023) Video
[6] Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma,
Hongan Wang, Weakly-supervised learning for single depth based hand shape recovery. IEEE
Transactions on Image Processing, (2021) Video
[7] Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui,
Ping Tan, Liang Chang, Hongan Wang, Hand pose understanding with large-scale photo-realistic
rendering dataset. IEEE Transactions on Image Processing, (2021) Video
[8] Kevin T. Maher, Ze-Yuan Huang, Jian-Cheng Song, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma,
Hao Wang, Yong-Jin Liu, Hongan Wang, E-ffective: A visual analytic system for exploring the emotion
and effectiveness of inspirational speeches. IEEE Transactions on Visualization and Computer
Graphics, (2021)
[9] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Weakly supervised adversarial learning for 3D human
pose estimation from point clouds. IEEE Transactions on Visualization and Computer Graphics,
(2020) Video
[10] Xiaobing Du, Xiaoming Deng, Hangyu Qin, Yezhi Shu, Fang Liu, Guozhen Zhao, Yu-Kun Lai, Cuixia Ma,
Yong-Jin Liu, Hongan Wang, MMPosE: Movie-induced multi-label positive emotion classification through
EEG signals, IEEE Transactions on Affective Computing, (2023)
[11] Xiaobing Du, Cuixia Ma, Guanhua Zhang, Jinyao Li, Yu-Kun Lai, Guozhen Zhao, Xiaoming Deng,
Yong-Jin Liu, Hongan Wang, An efficient LSTM network for emotion recognition from multichannel
EEG signals. IEEE Transactions on Affective Computing, (2020)
[12] Xiaoming Deng, Yinda Zhang, Shuo Yang, Ping Tan, Liang Chang, Ye Yuan, Hongan Wang, Joint
hand detection and rotation estimation using CNN, IEEE Transactions on Image Processing, (2018)
[13] Wei Zhang, Zeyi Lin, Jian Cheng, Cuixia Ma, Xiaoming Deng, Hongan Wang, STA-GCN: two-stream
graph convolutional network with spatial–temporal attention for hand gesture recognition, The Visual
Computer, (2020)
[14] Dachuan Cheng, Jian Shi, Yanyun Chen, Xiaoming Deng, Xiaopeng Zhang, Learning scene illumination
by pairwise photos from rear and front mobile cameras, Computer Graphics Forum, (2018)
[15] Xiaoming Deng, Fuchao Wu, Yihong Wu, Fuqing Duan, Liang Chang, Hongan Wang, Self-calibration
of hybrid central catadioptric and perspective cameras, Computer Vision and Image Understanding,
(2012)
[16] Fuqing Duan, Fuchao Wu, Mingquan Zhou, Xiaoming Deng, Yun Tian, Calibrating effective focal
length for central catadioptric cameras using one space line, Pattern Recognition Letters, (2012)
[17] Hui Zeng, Xiaoming Deng, Zhanyi Hu, A new normalized method on line-based homography
estimation, Pattern Recognition Letters, (2008)
[18] Jianping Jiang, Xinyu Zhou, Bingxuan Wang, Xiaoming Deng, Chao Xu, Boxin Shi, Complementing
event streams and RGB frames for hand mesh reconstruction. CVPR 2024. Video
[19] Baowen Zhang, Jiahe Li, Xiaoming Deng, Yinda Zhang, Cuixia Ma, Hongan Wang, Self-supervised
learning of implicit shape representation with dense correspondence for deformable objects. ICCV 2023.
[20] Wentian Qu, Zhaopeng Cui, Yinda Zhang, Chenyu Meng, Cuixia Ma, Xiaoming Deng, Hongan Wang,
Novel-view synthesis and pose estimation for hand-object interaction from sparse views. ICCV
2023. Video
[21] Jian Cheng, Yanguang Wan, Dexin Zuo, Cuixia Ma, Jian Gu, Ping Tan, Hongan Wang, Xiaoming Deng,
Yinda Zhang, Efficient virtual view selection for 3D hand pose estimation, AAAI 2022.
[22] Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma, Hongan Wang,
Interacting two-hand 3D pose and shape reconstruction from single color image, ICCV 2021. Video
[23] Zihao Zhang, Lei Hu, Xiaoming Deng, Shihong Xia, Sequential 3D human pose estimation using
adaptive point cloud sampling strategy, IJCAI 2021. Video
[24] Fang Liu, Changqing Zou, Xiaoming Deng, Ran Zuo, Yu-Kun Lai, Cuixia Ma, Yong-Jin Liu, Hongan Wang,
SceneSketcher: Fine-grained image retrieval with scene sketches, ECCV 2020. Video
[25] Fang Liu, Xiaoming Deng, Yu-Kun Lai, Yong-Jin Liu, Cuixia Ma, Hongan Wang, SketchGAN: Joint sketch
completion and recognition with generative adversarial network, CVPR 2019.
[26] Xiaoming Deng, Shihong Xia, Wenzhong Wang, Zhaoqi Wang, Liang Chang, Hongan Wang, Automatic
gait motion capture with missing-marker fillings, ICPR 2014.
[27] Zhenlong Zhou, Bo Shu, Shaojie. Zhuo, Xiaoming Deng, Ping Tan, Stephen Lin, Image-based clothes
animation for virtual fitting, ACM SIGGRAPH Asia 2012, Technical briefs.
Students
GRADUATED STUDENTS
Ye Yuan, MSc,
Shuo Yang, MSc,
Yuying Zhu, MSc
Dexin Zuo, MSc
Zeyi Lin, MSc
Jian Cheng, MSc
Mingyu Ke, MSc
Baowen Zhang, MSc
Yanguang Wan, MSc
Jiahe Li, MSc
CURRENT STUDENTS
Wentian Qu, PhD Student
Chenyu Meng, PhD Student
Yonghao Zhang, Master Student
Yang Zou, Master Student
Haosheng Li, Master Student
Liufei Ouyang, Master Student