基本信息

郭龙腾  男    中国科学院自动化研究所

紫东太初大模型研究中心

北京中关村学院共建导师

中国科学院院长奖

电子邮件: longteng.guo@ia.ac.cn
通信地址: 北京市海淀区中关村东路95号
邮政编码:100190

个人简介

郭龙腾,硕导,中科院自动化所-紫东太初大模型研究中心副研究员。主要研究方向为多模态大模型、多模态具身智能等,在相关领域的国内外期刊和会议上发表论文50余篇,相关研究成果在国际图像、视频及多模态理解竞赛中斩获5项冠军和3项亚季军。曾获得中国科学院院长奖,参与研发的“紫东太初”大模型荣获2022年度世界人工智能大会最高奖项SAIL奖。主持或参与多个重要科研项目,包括国家新一代人工智能重大项目、基金重点项目、中国科学院战略性先导课题、CCF-腾讯犀牛鸟基金等。

招生信息

专业背景不限,建议具有较强自主性和编程能力的同学邮件(longteng.guo@nlpr.ia.ac.cn)联系我。

由于招生数量有限,希望提前与我联系。 

另招收少量实习生,要求计算机相关专业的在读本科或研究生,具有较强的编程能力或机器人软硬件经验,实习期半年以上者优先。

招生方向
多模态大模型,具身智能
招生专业

081104-模式识别与智能系统

081203-计算机应用技术

教育背景

2016-09--2021-06   中国科学院自动化研究所   博士学位
2012-09--2016-06   西安交通大学   学士学位

工作经历

   
工作简历
2023-07~现在, 中国科学院自动化研究所, 副研究员
2021-07~2023-06,字节跳动AI Lab, 算法研究员
社会兼职
2025-03-01-今,北京中关村学院, 兼职教师

教授课程

   

在北京中关村学院开设《多模态大模型》课程,主持具身认知大模型项目。

出版信息

发表论文50余篇,包括TPAMI、TMM等中科院一区期刊论文,以及NeurIPS、ICLR、CVPR、ACL、ACM MM、SIGIR、ICRA等国际顶级会议论文。完整论文列表请查阅Google Scholar 。

部分已发表论文
  • Yanghong Mei, Longteng Guo, Ming-Ming Yu, Guiyu Zhao, Xingjian He, Jing Liu, NavWM: A Unified Navigation World Model for Foresight-Driven Planning, ECCV, 2026.
  • Yanghong Mei, Yirong Yang, Longteng Guo, Qunbo Wang, Ming-Ming Yu, Xingjian He, Wenjun Wu, Jing Liu, UrbanNav: Learning Language-Guided Embodied Urban Navigation from Web-Scale Human Trajectories, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2026.
  • Guiyu Zhao, Longteng Guo, Junyou Zhu, Jun Fu, Yanghong Mei, Bin Cao, Jie Jiang, Xingjian He, Jing Liu, VeriSpace: Spatially Grounded Action Verification for Vision-Language-Action Models, 2026.
  • Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun, Yuanteng Chen, Tao Liu, Lan Yang, Longteng Guo, Honggang Zhang, LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video, 2026.
  • Tianrun Xu, Yue Sun, Qixun Wang, Jingyi Lu, Yuan Wang, Tianren Zhang, Longteng Guo, Fengyun Rao, Jing Lyu, Feng Chen, Jing Liu, Semantic-Enriched Latent Visual Reasoning, ICML, 2026.
  • Zikang Liu, Longteng Guo, Handong Li, Ru Zhen, Xingjian He, Ruyi Ji, Xiaoming Ren, Yanhao Zhang, Haonan Lu, Jing Liu. Thinking in streaming video, ICML, 2026.
  • Yang Y, Lin Y, Guo L, Song L, et al. MemOcc: Hierarchical Memory for Indoor Continuous Occupancy Mapping[C]//International Conference on Robotics and Automation (ICRA), 2026.
  • Ming-Ming Yu, Qunbo Wang, Rongtao Xu, Yanghong Mei, Yirong Yang, Longteng Guo, Wenjun Wu, Jing Liu, SurveilNav: Collaborative Object Goal Navigation with Robot and Surveillance System[C]//International Conference on Robotics and Automation (ICRA), 2026.
  • Longteng Guo, Xuanxu Lin, Dongze Hao, Tongtian Yue, Pengkang Huo, Jiatong Ma, Yuchen Liu, Jing Liu, SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation, ACL, 2026.
  • Jiatong Ma, Longteng Guo, Yuchen Liu, Zijia Zhao, Dongze Hao, Xuanxu Lin, Jing Liu, M^3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering, ACL, 2026.
  • Longteng Guo, Yifan Wang, Pengkang Huo, Tailai Chen, Yuze Wu, Jing Liu, Xinxin Zhu, VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning, ACL, 2026.
  • Tongtian Yue, Xuange Gao, Longteng Guo, Zijia Zhao, Zikang Liu, Jie Jiang, Hua Huang, Jing Liu, ROSE: Rotate Your Large Language Model to See. CVPR, 2026.
  • Handong Li, Zikang Liu, Longteng Guo, Tongtian Yue, Yepeng Tang, Xinxin Zhu, Chuanyang Zheng, Ziming Wang, Zhibin Wang, Jun Song, Cheng Yu, Bo Zheng, Jing Liu, AdaSpark: Adaptive Sparsity for Efficient Long-Video Understanding, CVPR, 2026.
  • Yirong Yang, Li Song, Qunbo Wang, Longteng Guo, Ruyi Ji, Mingming Yu, Wenjun Wu, Jing Liu, TAS-DAQ: Task-Adaptive Sparse Prediction with Dense Query Auxiliary Supervisory for Efficient 3D Object Detection, IEEE Transactions on Multimedia (IEEE TMM), 2026.
  • He Wang, Longteng Guo, Pengkang Huo, Xuanxu Lin, Yichen Yuan, Jie Jiang, Jing Liu, S1-MMAlign: A Large-Scale, Multi-Disciplinary Dataset for Scientific Figure-Text Understanding, arXiv preprint arXiv:2601.00264, 2026.
  • Yepeng Tang, Weining Wang, Longteng Guo, Tongtian Yue, Wenxuan Wang, Chunjie Zhang, Jing Liu, Divid: Disentangled Spatial-Temporal Modeling within LLMs for Temporally Grounded Video Understanding, The Fourteenth International Conference on Learning Representations (ICLR), 2026.
  • Shichen Lu, Tongtian Yue, Longteng Guo, Handong Li, Xingjian He, Si Liu, Jing Liu, ViPE: Visual Perception in Parameter Space for Efficient Video-Language Understanding, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025.
  • Zikang Liu, Longteng Guo, Yepeng Tang, Tongtian Yue, Junxian Cai, Kai Ma, Qingbin Liu, Xi Chen, Jing Liu, VRoPE: Rotary Position Embedding for Video Large Language Models, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025.
  • Zijia Zhao, Longteng Guo, Tongtian Yue, Erdong Hu, Shuai Shao, Zehuan Yuan, Hua Huang, Jing Liu, Chatsearch: A Dataset and a Generative Retrieval Model for General Conversational Image Retrieval, Pattern Recognition (PR), 2025.
  • Siqi Zhang, Yanyuan Qiao, Qunbo Wang, Longteng Guo, Zhihua Wei, Jing Liu, FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Tasks, IEEE Transactions on Multimedia (IEEE TMM), 2025.
  • Zijia Zhao, Yuqi Huo, Tongtian Yue, Longteng Guo, Haoyu Lu, Bingning Wang, Weipeng Chen, Jing Liu, Efficient Motion-Aware Video Multimodal Large Language Model, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
  • Qianyi Liu, Siqi Zhang, Yanyuan Qiao, Junyou Zhu, Xiang Li, Longteng Guo, Qunbo Wang, Xingjian He, Qi Wu, Jing Liu, GroundingMate: Aiding Object Grounding for Goal-Oriented Vision-and-Language Navigation, 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025.
  • Shuning Xue, Bu Jin, Jie Jiang, Longteng Guo, Jin Zhou, Changyong Wang, Jing Liu, A Multi-Subject and Multi-Session EEG Dataset for Modelling Human Visual Object Recognition, Scientific Data (Sci. Data), 2025.
  • Zijia Zhao, Haoyu Lu, Yuqi Huo, Yifan Du, Tongtian Yue, Longteng Guo, Bingning Wang, Weipeng Chen, Jing Liu, Needle in a Video Haystack: A Scalable Synthetic Framework for Benchmarking Video Multimodal Large Language Models, The Thirteenth International Conference on Learning Representations (ICLR), 2025.
  • Tongtian Yue, Longteng Guo, Jie Cheng, Xuange Gao, Hua Huang, Jing Liu, Ada-k Routing: Boosting the Efficiency of Mixture-of-Experts-Based Large Language Models, The Thirteenth International Conference on Learning Representations (ICLR), 2025.
  • Sihan Chen, Xingjian He, Longteng Guo, Xinxin Zhu, Weining Wang, Jinhui Tang, Jing Liu, Valor: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.
  • Junyi Chen, Longteng Guo, Jia Sun, Shuai Shao, Zehuan Yuan, Liang Lin, Dongyu Zhang, EVE: Efficient Vision-Language Pre-Training with Masked Prediction and Modality-Aware Mixture-of-Experts, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
  • Wenxuan Wang, Tongtian Yue, Yisi Zhang, Longteng Guo, Xingjian He, Xinlong Wang, Jing Liu, Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentation, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  • Wenxuan Wang, Xingjian He, Yisi Zhang, Longteng Guo, Jiachen Shen, Jiangyun Li, Jing Liu, CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation, IEEE Transactions on Multimedia (IEEE TMM), 2024.
  • Mingzhen Sun, Weining Wang, Yanyuan Qiao, Jiahui Sun, Zihan Qin, Longteng Guo, Xinxin Zhu, Jing Liu, MM-LDM: Multi-Modal Latent Diffusion Model for Sounding Video Generation, Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM), 2024.
  • Yanyuan Qiao, Zheng Yu, Longteng Guo, Sihan Chen, Zijia Zhao, Mingzhen Sun, Qi Wu, Jing Liu, Vl-Mamba: Exploring State Space Models for Multimodal Learning, Neural Information Processing Systems Workshop (NeurIPS Workshop), 2024.
  • Tongtian Yue*, Jie Cheng*, Longteng Guo*, Xingyuan Dai, Zijia Zhao, Xingjian He, Gang Xiong, Yisheng Lv, Jing Liu, Sc-Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  • Erdong Hu, Longteng Guo, Tongtian Yue, Zijia Zhao, Shuning Xue, Jing Liu, OneDiff: A Generalist Model for Image Difference Captioning, Proceedings of the Asian Conference on Computer Vision (ACCV), 2024.
  • Shichen Lu, Longteng Guo, Wenxuan Wang, Zijia Zhao, Tongtian Yue, Jing Liu, Si Liu, Collaborative Training of Tiny-Large Vision Language Models, Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM), 2024.
  • Jing Liu, Sihan Chen, Xingjian He, Longteng Guo, Xinxin Zhu, Weining Wang, Jinhui Tang, Valor: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.
  • Shuning Xue, Bu Jin, Jie Jiang, Longteng Guo, Jing Liu, A Hybrid Local-Global Neural Network for Visual Classification Using Raw EEG Signals, Scientific Reports (Sci. Rep.), 2024.
  • Dongze Hao, Qunbo Wang, Longteng Guo, Jie Jiang, Jing Liu, Self-Bootstrapped Visual-Language Model for Knowledge Selection and Question Answering, Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024.
  • Zikang Liu, Sihan Chen, Longteng Guo, Handong Li, Xingjian He, Jing Liu, Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner, Proceedings of the 31st ACM International Conference on Multimedia (ACM MM), 2023.
  • Zijia Zhao*, Longteng Guo*, Xingjian He, Shuai Shao, Zehuan Yuan, Jing Liu, Mamo: Fine-Grained Vision-Language Representations Learning with Masked Multimodal Modeling, Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023.
  • Shichen Lu, Longteng Guo, Xingjian He, Xinxin Zhu, Jing Liu, Si Liu, CSDNet: Contrastive Similarity Distillation Network for Multi-Lingual Image-Text Retrieval, International Conference on Image and Graphics (ICIG), 2023.
  • Jing Liu, Longteng Guo, GPT-4 对多模态大模型在多模态理解, 生成, 交互上的启发, 国家自然科学基金 (China Sci. Fund), 2023.
  • Wenzhu Wu, Weining Wang, Longteng Guo, Jing Liu, Keypoint Context Aggregation for Human Pose Estimation, Image and Graphics: 11th International Conference (ICIG), 2021.
  • Sihan Chen, Xinxin Zhu, Dongze Hao, Wei Liu, Jiawei Liu, Zijia Zhao, Longteng Guo, Jing Liu, Mm21 Pre-Training for Video Understanding Challenge: Video Captioning with Pretraining Techniques, Proceedings of the 29th ACM International Conference on Multimedia (ACM MM), 2021.
  • Longteng Guo, Jing Liu, Xinxin Zhu, Peng Yao, Shichen Lu, Hanqing Lu, Normalized and Geometry-Aware Self-Attention Network for Image Captioning, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  • Peng Yao, Jiangyun Li, Longteng Guo, Jing Liu, Modeling Local and Global Contexts for Image Captioning, 2020 IEEE International Conference on Multimedia and Expo (ICME), 2020.
  • Longteng Guo, Jing Liu, Peng Yao, Jiangwei Li, Shichen Lu, Hanqing Lu, Mscap: Multi-Style Image Captioning with Unpaired Stylized Text, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  • Shichen Lu, Ruimin Hu, Jing Liu, Longteng Guo, Fei Zheng, Structure Preserving Convolutional Attention for Image Captioning, Applied Sciences (Appl. Sci.), 2019.
  • Longteng Guo, Jing Liu, Jinhui Tang, Jiangwei Li, Wei Luo, Hanqing Lu, Aligning Linguistic Words and Visual Semantic Units for Image Captioning, Proceedings of the 27th ACM International Conference on Multimedia (ACM MM), 2019.
  • Jiangyun Li, Peng Yao, Longteng Guo, Weicun Zhang, Boosted Transformer for Image Captioning, Applied Sciences (Appl. Sci.), 2019.
  • Longteng Guo, Jing Liu, Yuhang Wang, Zhonghua Luo, Wei Wen, Hanqing Lu, Show, Tell, and Polish: Ruminant Decoding for Image Captioning, IEEE Transactions on Multimedia (IEEE TMM), 2019.
  • Longteng Guo, Jing Liu, Yuhang Wang, Zhonghua Luo, Wei Wen, Hanqing Lu, Sketch-Based Image Retrieval Using Generative Adversarial Networks, Proceedings of the 25th ACM International Conference on Multimedia (ACM MM), 2017.

指导学生及去向

2021-2026,赵子嘉,博士研究生,毕业去向:Kimi

2023-2026,朱峻佑,硕士研究生,毕业去向:小鹏

2021-2025,陈思涵,博士研究生,(获中科院院长奖)毕业去向:字节跳动

2021-2025,郝东泽,博士研究生,毕业去向:OPPO

2022-2025,胡尔东,硕士研究生,毕业去向:京东

2022-,岳同天,博士研究生

2023-,李翰东,博士研究生

2023-,刘梓康,博士研究生

2024-,朱子林,博士研究生

2024-,梅阳鸿,博士研究生

2024-,袁奕晨,博士研究生