081202-计算机软件与理论
081203-计算机应用技术

多模态机器学习
跨模态生成
多模态大模型

2012-09--2019-06   中国科学院计算技术研究所   工学博士
2008-09--2012-06   武汉大学   工学学士

   

2023-11~现在, 中国科学院计算技术研究所, 副研究员
2021-08~2023-11,百度在线网络技术（北京）有限公司, 资深研发工程师
2019-07~2021-08,百度在线网络技术（北京）有限公司 和 北京邮电大学, 博士后
2012-09~2019-06,中国科学院计算技术研究所, 工学博士
2008-09~2012-06,武汉大学, 工学学士

   

（ 1 ） 摘要生成模型的训练方法、装置、设备和存储介质, 2023, 第 2 作者, 专利号: CN113408272B

（ 2 ） 用于生成会议纪要的方法、装置、设备、介质和产品, 2023, 第 6 作者, 专利号: CN113642294B

（ 3 ） 视频脚本生成方法、装置、电子设备及介质, 2022, 第 3 作者, 专利号: CN114860995A

（ 4 ） 对话摘要训练数据的生成方法、装置、设备及存储介质, 2022, 第 2 作者, 专利号: CN114490976A

（ 5 ） 语义识别方法、装置、电子设备及存储介质, 2022, 第 1 作者, 专利号: CN114417878A

（ 6 ） 多模态数据联合学习模型训练方法及装置, 2021, 第 1 作者, 专利号: CN113240056A

（ 7 ） 生成摘要的方法和装置, 2021, 第 1 作者, 专利号: CN111506725B

（ 8 ） 预训练模型的获取方法和装置, 2021, 第 2 作者, 专利号: CN112668671A

（ 9 ） 摘要抽取模型训练方法、摘要抽取方法、装置和电子设备, 2021, 第 2 作者, 专利号: CN112560479A

（ 10 ） 文本生成模型的训练方法、装置及电子设备, 2020, 第 1 作者, 专利号: CN111709248A

   

（1） InstructEval: Instruction-Tuned Text Evaluator from Human Preference, Findings of ACL 2024, 2024, 第 2 作者
（2） KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction, The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), 2024, 第 11 作者
（3） Unlocking the Power of Large Language Models for Entity Alignment, The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), 2024, 第 5 作者
（4） UNIMO-G: Unified Image Generation through Multimodal Conditional Diffusion, The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), 2024, 第 1 作者
（5） WeCheck: Strong Factual Consistency Checker via Weakly Supervised Learning, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023), 2023, 第 2 作者
（6） FactGen: Faithful Text Generation by Factuality-aware Pre-training and Contrastive Ranking Fine-tuning, JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2023, 第 2 作者
（7） Precisely the Point: Adversarial Augmentations for Faithful and Informative Text Generation, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022, 第 2 作者
（8） Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning, The 60th Annual Meeting of the Association for Computational Linguistics (ACL-2022), 2022, 第 8 作者
（9） UNIMO-2: End-to-End Unified Vision-Language Grounded Learning, Findings of the Association for Computational Linguistics: ACL 2022, 2022, 第 1 作者
（10） Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods, 2022, 第 1 作者
（11） HiSMatch: Historical Structure Matching based Temporal Knowledge Graph Reasoning, The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP-2022), 2022, 第 8 作者
（12） Upainting: Unified text-to-image diffusion generation with cross-modal guidance, 2022, 第 1 作者
（13） Meta-CQG: A Meta-Learning Framework for Complex Question Generation over Knowledge Bases, Proceedings of the 29th International Conference on Computational Linguistics (COLING 2022), 2022, 第 5 作者
（14） FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness, Findings of the Association for Computational Linguistics: EMNLP 2022, 2022, 第 2 作者
（15） Abstractive Multi-Document Summarization Based on Semantic Link Network, IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 第 1 作者
（16） UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning, 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, 第 1 作者
（17） Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning, The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2021), 2021, 第 3 作者
（18） SgSum: Transforming Multi-document Summarization into Sub-graph Selection, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), 2021, 第 2 作者  通讯作者
（19） BASS: Boosting Abstractive Summarization with Unified Semantic Graph, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL 2021), 2021, 第 2 作者
（20） Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs, 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, 第 4 作者
（21） Leveraging Graph to Improve Abstractive Multi-Document Summarization, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), 2020, 第 1 作者
（22） Probabilistic inference on uncertain semantic link network and its application in event identification, FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 第 1 作者
（23） Joint Event Extraction Based on Hierarchical Event Schemas From FrameNet, IEEE ACCESS, 2019, 第 1 作者
（24） Improving neural abstractive document summarization with explicit information selection modeling, Proceedings of EMNLP2018, the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, 第 1 作者
（25） Improving neural abstractive document summarization with structural regularization, Proceedings of EMNLP2018, the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, 第 1 作者
（26） Abstractive news summarization based on event semantic link network, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 2016, 第 1 作者
（27） Exploring differential topic models for comparative summarization of scientific papers, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 2016, 第 2 作者
（28） Abstractive multi-document summarization with semantic information extraction, Proceedings of EMNLP2015, the 2015 Conference on Empirical Methods in Natural Language Processing, 2015, 第 1 作者

   

（ 1 ） 智能算法认知博弈 - 认知博弈的交互模拟, 参与, 中国科学院计划, 2023-12--2028-11

（1）可靠跨模态生成技术及应用   中国科学院计算技术研究所夏培肃论坛   2022-12-01
（2）自然语言生成的事实一致性问题   中文信息学会自然语言生成与智能写作专委会主题讲坛 - 文本生成评价研究   2022-07-31
（3）UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning   机器之心ACL 2021论文分享会   2021-07-31