申抒含  研究员  博导  中国科学院自动化研究所

电子邮件: shshen@nlpr.ia.ac.cn
通信地址: 北京市海淀区中关村东路95号
邮政编码: 100190

主页:http://vision.ia.ac.cn/Faculty/shshen/index.htm

研究领域

三维计算机视觉理论与应用,包括大规模场景三维重建、智能机器人三维环境感知、场景三维语义建模等。

招生信息

我们长期以来从事三维计算机视觉理论和应用的研究,尤其专注于基于图像的大规模场景三维感知研究。我们的研究属于应用基础研究,着力解决实际应用中存在的核心科学问题,目前我们已在计算机视觉、摄影测量、机器人等领域国际期刊和国际会议,如International Journal of Computer Vision、IEEE Trans. on Image Processing、ISPRS Journal of Photogrammetry and Remote Sensing、CVPR、ECCV、ICRA、IROS等发表论文60余篇。我们的图像三维建模和视觉定位系统曾获2018年中国图象图形学会科学技术二等奖、CVPR2019大时间跨度视觉定位竞赛冠军、CVPR2021三维矢量化BIM建模竞赛冠军等。

我们的研究工作获得了国家自然科学基金重点、国家自然科学基金面上、中科院人才专项、中科院国际合作等多个项目的资助,在三维视觉理论方法方面开展系统性探索;同时我们也得到国内主要AI企业的长期资助,在倾斜摄影城市三维建模、大规模室内场景重建与视觉定位、无人车高精地图构建等方面开展技术落地。

欢迎优秀的学生以各种方式(推免、考研、实习等)加入我们,详细信息可参见:招生说明

招生专业
081104-模式识别与智能系统
081203-计算机应用技术
招生方向
三维计算机视觉理论与应用,包括大规模场景三维重建、智能机器人三维环境感知、场景三维语义建模等。

教育背景

2006-09--2010-04   上海交通大学   博士
2003-09--2006-03   西南交通大学   硕士
1999-09--2003-06   西南交通大学   学士

工作经历

   
工作简历
2019-10~现在, 中国科学院自动化研究所, 模式识别国家重点实验室, 研究员
2015-10~现在, 中国科学院大学, 人工智能学院, 岗位教授
2013-10~2019-10,中国科学院自动化研究所, 模式识别国家重点实验室, 副研究员
2010-05~2013-10,中国科学院自动化研究所, 模式识别国家重点实验室, 助理研究员
社会兼职
2021-01-01-今,中国图象图形学会三维视觉专委会, 常务委员
2021-01-01-今,中国电影美术学会虚拟空间专委会, 委员
2017-01-01-今,中国图象图形学学会机器视觉专委会, 委员
2016-01-01-今,中国计算机学会计算机视觉专委会, 委员

教授课程

计算机视觉
计算机视觉 II

出版信息

Book Chapter

  1. Shuhan Shen, Hainan Cui, 3D Scene Gemoetry and Semantic Reconstruction, in Advances in Visual Information Processing, Shanghai Jiaotong University Press, 2021. (in Chinese)

Journal Papers

  1. Hainan Cui, Diantao Tu, Fulin Tang, Pengfei Xu, Hongmin Liu, Shuhan Shen. VidSfM: Robust and Accurate Structure-from-Motion for Monocular Videos. IEEE Transactions on Image Processing, 31: 2449-2462, 2022.
  2. Xiang Gao, Lingjie Zhu, Hainan Cui, Zexiao Xie, Shuhan Shen, IRA++: Distributed Incremental Rotation Averaging. IEEE Transactions on Circuits and Systems for Video Technology, 2021.
  3. Jiali Han, Lingjie Zhu, Xiang Gao, Zhanyi Hu, Liyang Zhou, Hongmin Liu, Shuhan Shen. Urban Scene LOD Vectorized Modeling from Photogrammetry Meshes. IEEE Transactions on Image Processing, 30: 7458-7471, 2021.
  4. Mengqi Rong, Hainan Cui, Zhanyi Hu, Hanqing Jiang, Hongmin Liu, Shuhan Shen. Active Learning Based 3D Semantic Labeling From Images and Videos. IEEE Transactions on Circuits and Systems for Video Technology, 2021.
  5. Jiali Han, Mengqi Rong, Hanqing Jiang, Hongmin Liu, Shuhan Shen. Vectorized Indoor Surface Reconstruction from 3D Point Cloud with Multistep 2D Optimization. ISPRS Journal of Photogrammetry and Remote Sensing, 177: 57-74, 2021. (Winner of CVPR 2021 International Scan-to-BIM Challenge)
  6. Xiang Gao, Lingjie Zhu, Zexiao Xie, Hongmin Liu, Shuhan Shen. Incremental Rotation Averaging. International Journal of Computer Vision, 129: 1202–1216, 2021.
  7. Hainan Cui, Tianxin Shi, Jun Zhang, Pengfei Xu, Yiping Meng, Shuhan Shen. View-graph Construction Framework for Robust and Efficient Structure-from-MotionPattern Recognition, 114: 107712, 2021.
  8. Xiang Gao, Lingjie Zhu, Hainan Cui, Zhanyi Hu, Hongmin Liu, Shuhan Shen. Complete and Accurate Indoor Scene Capturing and Reconstruction Using a Drone and a Robot. IEEE Sensors Journal, 21(10): 11858-11869, 2021.
  9. Yu Chen, Shuhan Shen, Yisong Chen, Guoping Wang. Graph-Based Parallel Large Scale Structure from MotionPattern Recognition, 107: 107537, 2020.
  10. Hongmin Liu, Xincheng Tang, Shuhan Shen. Depth-map Completion for Large Indoor Scene ReconstructionPattern Recognition, 99: 107112, 2020.
  11. Lingjie Zhu, Shuhan Shen, Xiang Gao, Zhanyi Hu. Urban Scene Vectorized Modeling Based on Contour Deformation. ISPRS International Journal of Geo-Information, 9(3), 162, 2020.
  12. Xiang Gao, Shuhan Shen, Lingjie Zhu, Tianxin Shi, Zhiheng Wang, Zhanyi Hu. Complete Scene Reconstruction by Merging Images and Laser Scans. IEEE Transactions on Circuits and Systems for Video Technology, 30(10): 3688-3701, 2020.
  13. Hainan Cui, Shuhan Shen, Wei Gao, Hongmin Liu, Zhiheng Wang. Efficient and Robust Large-Scale Structure-from-Motion via Track Selection and Camera Prioritization. ISPRS Journal of Photogrammetry and Remote Sensing, 156: 202-214, 2019.
  14. Xiang Gao, Shuhan Shen, Zhanyi Hu, Zhiheng Wang. Ground and aerial meta-data integration for localization and reconstruction: A review. Pattern Recognition Letters, 127: 202-214, 2019.
  15. Yang Zhou, Shuhan Shen, Zhanyi Hu. Detail Preserved Surface Reconstruction from Point Cloud. Sensors, 19(6): 1278, 2019.
  16. Jiali Han, Shuhan Shen. Scalable Point Cloud Meshing for Image Based Large Scale 3D Modeling. Visual Computing for Industry, Biomedicine, and Art, 2(10): 1-10, 2019.
  17. Xiang Gao, Hainan Cui, Lingjie Zhu, Tianxin Shi, Shuhan Shen. Multi-source Data Based 3D Digital Preservation of Large-scale Ancient Chinese Architecture: A Case Report. Virtual Reality & Intelligent Hardware, 1(5): 525-541 2019.
  18. Xiaofeng Sun, Shuhan Shen, Hainan Cui, Lihua Hu, Zhanyi Hu. Geographic, Geometrical and Semantic Reconstruction of Urban Scene from High Resolution Oblique Aerial Images. IEEE/CAA Journal of Automatica Sinica, 6(1): 118-130, 2019.
  19. Xiang Gao, Shuhan Shen, Yang Zhou, Hainan Cui, Lingjie Zhu, Zhanyi Hu. Ancient Chinese Architecture 3D Preservation by Merging Ground and Aerial Point Clouds. ISPRS Journal of Photogrammetry and Remote Sensing, 143: 72-84, 2018.
  20. Xiang Gao, Lihua Hu, Hainan Cui, Shuhan Shen, Zhanyi Hu. Accurate and Efficient Ground-to-Aerial Model Alignment. Pattern Recognition, 76: 288-302, 2018.
  21. Miao Yu, Shuhan Shen, Zhanyi Hu. Dynamic Graph Cuts in Parallel, IEEE Transactions on Image Processing, 26(8): 3775-3788, 2017.
  22. Hainan Cui, Shuhan Shen, Zhanyi Hu. Tracks Selection for Robust, Efficient and Scalable Large-Scale Structure from Motion. Pattern Recognition, 72: 341-354, 2017.
  23. Xiaofeng Sun, Xiangguo Lin, Shuhan Shen, Zhanyi Hu. High-Resolution Remote Sensing Data Classification over Urban Areas Using Random Forest Ensemble and Fully Connected Conditional Random Field. ISPRS International Journal of Geo-Information, 6(8), 245, 2017.
  24. Xiaofeng Sun, Shuhan Shen, Xiangguo Lin, Zhanyi Hu. Semantic labeling of High Resolution Aerial Images Using an Ensemble of Fully Convolutional Networks. Journal of Applied Remote Sensing, 2017.
  25. Hainan Cui, Shuhan Shen, Zhanyi Hu. Global Fusion of Generalized Camera Model for Efficient Large-Scale Structure from Motion. Science China: Information Sciences, 60(038101):1-3, 2017.
  26. Miao Yu, Shuhan Shen, Zhanyi Hu. Dynamic Parallel and Distributed Graph Cuts. IEEE Transactions on Image Processing, 25(12): 5511-5525, 2016.
  27. Hainan Cui, Shuhan Shen, Wei Gao, Zhanyi Hu. Efficient Large-Scale Structure from Motion by Fusing Auxiliary Imaging Information. IEEE Transactions on Image Processing, 24(11): 3561-3573, 2015.
  28. Shuhan Shen, Zhanyi Hu. How to Select Good Neighboring Images in Depth-Map Merging Based 3D Modeling. IEEE Transactions on Image Processing, 23(1): 308-318, 2014.
  29. Kangping Fu, Shuhan Shen, Zhanyi Hu. Line Matching Across Views Based on Multiple View Stereo. Acta Automatica Sinica, 40(8): 1680-1689, 2014.
  30. Shuhan Shen. Accurate Multiple View 3D Reconstruction Using Patch Based Stereo for Large-Scale Scenes. IEEE Transactions on Image Processing, 22(5): 1901-1914, 2013.
  31. Haixia Wang, Shuhan Shen, Xiao Lu. A Screw Axis Identification Method for Serial Robot Calibration Based on the POE Model. Industrial Robot: An International Journal, 39(2): 146-153, 2012.
  32. Chenhao Wang, Shuhan Shen, Yuncai Liu. A Fast Approach to Deformable Surface 3D Tracking, Pattern Recognition, 44(12): 2915-2925, 2011.
  33. Shuhan Shen, Wenhuan Shi, Yuncai Liu. Monocular 3D Tracking of Inextensible Deformable Surfaces under L2-Norm. IEEE Transactions on Image Processing, 19(2): 512-521, 2010.
  34. Shuhan Shen, Wenjuan Ma, Wenhuan Shi, Yuncai Liu. Convex Optimization for Non-Rigid Stereo Reconstruction. IEEE Transactions on Image Processing, 19(3): 782-794, 2010.
  35. Shuhan Shen, Yuncai Liu, Wu-Sheng Lu. Monocular 3D Tracking of Deformable Surfaces Using Sequential Second Order Cone Programming. Pattern Recognition, 43(1): 244-254, 2010.
  36. Junchi Yan, Shuhan Shen, Yin Li, Yuncai Liu. An Optimization Based Framework for Human Pose Estimation. IEEE Signal Processing Letters, 17(8): 766-769, 2010.
  37. Shuhan Shen, Yuncai Liu. Efficient Multiple Faces Tracking Based on Relevance Vector Machine and Boosting Learning. Journal of Visual Communication and Image Representation. 19(6): 382-391, 2008.
  38. Shuhan Shen, Minglei Tong, Haolong Deng, Yuncai Liu, et. al. Model Based Human Motion Tracking Using Probability Evolutionary Algorithm. Pattern Recognition Letters. 29(13): 1877-1886, 2008.

Conference Papers

  1. Hainan Cui, Shuhan Shen. MMA: Multi-camera Based Global Motion Averaging. AAAI 2022 (Oral).
  2. Zhuo Song, Chuting Wang, Yuqian Liu, Shuhan Shen. Recalling Direct 2D-3D Matches for Large-Scale Visual Localization. IROS 2021.
  3. Mingzhe Lv, Diantao Tu, Xincheng Tang, Yuqian Liu, Shuhan Shen. Semantically Guided Multi-View Stereo for Dense 3D Road Mapping. ICRA 2021.
  4. Mengqi Rong, Shuhan Shen, Zhanyi Hu. 3D Semantic Labeling of Photogrammetry Meshes Based on Active Learning. ICPR 2020.
  5. Jiali Han, Shuhan Shen. Distributed Surface Reconstruction from Point Cloud for City-Scale Scenes. International Conference on 3D Vision, 3DV 2019.
  6. Yang Zhou, Shuhan Shen, Zhanyi Hu. Active Semantic Labeling of Street View Point Clouds. International Conference on Multimedia and Expo, ICME 2019.
  7. Tianxin Shi, Shuhan Shen, Xiang Gao, Lingjie Zhu. Visual Localization Using Sparse Semantic 3D Map. International Conference on Image Processing, ICIP 2019. (Winner of CVPR 2019 Long-Term Visual Localization Challenge)
  8. Yang Zhou, Shuhan Shen, Zhanyi Hu. Fine-Level Semantic Labeling of Large-Scale 3D Model by Active Learning. International Conference on 3D Vision, 3DV 2018 (Oral).
  9. Hainan Cui, Shuhan Shen, Wei Gao, Zhiheng Wang. Progressive Large-Scale Structure-from-Motion with Orthogonal MSTs. International Conference on 3D Vision, 3DV 2018.
  10. Lingjie Zhu, Shuhan Shen, Zhanyi Hu. Large Scale Urban Scene Modeling from MVS Meshes. European Conference on Computer Vision, ECCV 2018.
  11. Hainan Cui, Shuhan Shen, Wei Gao. Voting-based Incremental Structure-from-Motion. ICPR 2018.
  12. Hainan Cui, Xiang Gao, Shuhan Shen, Zhanyi Hu. HSfM: Hybrid Structure-from-Motion. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 (Spotlight).
  13. Lingjie Zhu, Shuhan Shen, Zhanyi Hu. Variational Building Modeling from Urban MVS Meshes. International Conference on 3D Vision, 3DV 2017.
  14. Hainan Cui, Shuhan Shen, Xiang Gao, Zhanyi Hu. Batched Incremental Structure-from-Motion. International Conference on 3D Vision, 3DV 2017.
  15. Yang Zhou, Shuhan Shen, Xiang Gao, Zhanyi Hu. Accurate Mesh-based Alignment for Ground and Aerial Multi-view Stereo Models. IEEE International Conference on Image Processing, ICIP 2017.
  16. Hainan Cui, Shuhan Shen, Xiang Gao, Zhanyi Hu. CSfM: Community-based Structure from Motion. IEEE International Conference on Image Processing, ICIP 2017.
  17. Xiaofeng Sun, Shuhan Shen, Zhanyi Hu. Automatic Building Extraction from Oblique Aerial Images. The 23th International Conference on Pattern Recognition, ICPR 2016.
  18. Hainan Cui, Shuhan Shen, Zhanyi Hu. Robust Global Translation Averaging with Feature Tracks. The 23th International Conference on Pattern Recognition, ICPR 2016.
  19. Hainan Cui, Shuhan Shen, Wei Gao, Zhanyi Hu. Fusion of Auxiliary Imaging Information for Robust, Scalable and Fast 3D Reconstruction. The 12th Asian Conference on Computer Vision, ACCV 2014.
  20. Shuhan Shen. Depth-Map Merging for Multi-View Stereo with High Resolution Images. The 21th International Conference on Pattern Recognition, ICPR 2012.
  21. Wenjuan Ma, Shuhan Shen, Yuncai Liu. Linear relaxation for global pose estimation. The 8th World Congress on Intelligent Control and Automation, 2010.
  22. Shuhan Shen, Wenhuan Shi, Yuncai Liu. Monocular Template-based Tracking of Inextensible Deformable Surfaces under L2-Norm. The 9th Asian Conference on Computer Vision, ACCV 2009.
  23. Wenhuan Shi, Shuhan Shen, Yuncai Liu. Automatic Generation of Road Network Map from Massive GPS, vehicle trajectories. The 12th International IEEE Conference on Intelligent Transportation Systems, 2009.
  24. Shuhan Shen, Yuncai Liu. Deformable Surface Stereo Tracking-by-Detection Using Second Order Cone Programming. The 19th International Conference on Pattern Recognition, ICPR 2008.
  25. Shuhan Shen, Haolong Deng, Yuncai Liu. Probability Evolutionary Algorithm Based Human Motion Tracking Using Voxel Data. The 2008 IEEE World Congress on Evolutionary Computation, CEC 2008.
  26. Shuhan Shen, Yuncai Liu. Probability Evolutionary Algorithm for Functional and Combinatorial Optimization. The 7th World Congress on Intelligent Control and Automation, 2008.
  27. Shuhan Shen, Weirong Chen. Human body tracking based on Probability Evolutionary Algorithm. The 1st International Conference on Computer Vision Theory and Applications, VISAPP 2006.
  28. Shuhan Shen, Weirong Chen. Probability Evolutionary Algorithm Based Human Body Tracking. The 8th European Workshop on Evolutionary Computation in Image Analysis and Signal Processing, 2006. 


科研活动

   
科研项目
( 1 ) 基于深度图融合的大场景多视图立体重建研究, 主持, 国家级, 2015-01--2018-12
( 2 ) 基于单目图像的变形体三维重建, 主持, 国家级, 2012-01--2014-12
( 3 ) 中科院青促会, 主持, 部委级, 2015-01--2018-12
( 4 ) 基于n阶引力场分类的构造方法, 参与, 国家级, 2013-01--2016-12
( 5 ) 城市场景稠密三维重建, 主持, 院级, 2014-01--2015-12
( 6 ) 多源图像数据配准与融合, 参与, 国家级, 2013-01--2015-12
( 7 ) 三维场景中的高阶能量优化理论, 参与, 国家级, 2014-01--2018-12
( 8 ) 场景三维信息获取与理解, 参与, 部委级, 2012-01--2016-12
( 9 ) 手机图像桌面场景三维重建, 主持, 院级, 2017-01--2017-12
( 10 ) 基于语义分析的大规模场景视觉重建关键技术研究, 参与, 国家级, 2017-01--2021-12
( 11 ) 中国古建三维数字化保护中的天地图像融合问题研究, 主持, 国家级, 2019-01--2022-12
( 12 ) 基于视觉的大规模室内场景重建与定位, 主持, 院级, 2019-01--2019-12
( 13 ) 数字场景重建定制开发包模块授权使用协议, 主持, 院级, 2018-09--2019-06
( 14 ) 基于手机图像采集的室内视觉定位技术, 主持, 院级, 2019-06--2021-06
( 15 ) 室内外大规模场景三维语义矢量重建技术研发, 主持, 院级, 2019-01--2023-12
( 16 ) 城市场景高精三维感知与高效语义理解, 主持, 部委级, 2021-01--2022-12
( 17 ) 面向地理信息和定位导航的三维视觉系统与装备, 主持, 部委级, 2021-06--2023-06

指导学生

已指导学生

时天欣  硕士研究生  081104-模式识别与智能系统  

王宝宇  硕士研究生  085211-计算机技术  

和颖  硕士研究生  085211-计算机技术  

吕明哲  硕士研究生  085208-电子与通信工程  

现指导学生

荣梦琪  博士研究生  081104-模式识别与智能系统  

韩佳丽  硕士研究生  081104-模式识别与智能系统  

宋卓  硕士研究生  085211-计算机技术  

屠殿韬  硕士研究生  081104-模式识别与智能系统  

刘昱州  硕士研究生  081104-模式识别与智能系统  

张子钰  硕士研究生  081104-模式识别与智能系统