基本信息

 

张晓宇 研究员/博导

中国科学院信息工程研究所

6研究室

 

电子邮件:zhangxiaoyu@iie.ac.cn
通信地址:北京市海淀区树村路19
邮政编码:100093

 

研究方向

人工智能与深度学习、大数据内容安全、计算机视觉与多媒体等。

成果荣誉

  在相关领域IJCV、TIPTIFSToNTMMTNNLSPR等国际知名期刊和AAAIMMWWWKDDIJCAICIKMEMNLP等国际知名会议上发表学术论文100余篇;
  授权发明专利19项;
  主持国家自然科学基金4项,主持和参与国家重点研发计划、国家科技支撑计划、国家重大工程等科研项目10余项;
  荣获2019年中国图象图形学学会科学技术奖二等奖、2016年吴文俊人工智能科学技术创新奖二等奖、2018年北京市科学技术协会北京青年优秀科技论文奖三等奖、2017年中国电影电视技术学会影视科技优秀论文奖三等奖、2017CCCV2017 Best Paper Nominate Award2009年微软杯IEEE中国学生论文大赛银奖等学术荣誉。

学术任职

  中国计算机学会(CCF)杰出会员;
  电气和电子工程师协会(IEEE)、国际计算机学会(ACM)、中国图像图形学会(CSIG)、中国人工智能学会(CAAI)高级会员;
  中国图像图形学会(CSIG)视觉大数据专委会、中国自动化学会(CAA)模式识别与机器智能专委会副秘书长。

 

目前,2025级硕/博
招生名额充足,欢迎联系!

研究领域

人工智能,模式识别,深度学习,多媒体分析与理解。

招生信息

   
招生专业
083900-网络空间安全
081203-计算机应用技术
081104-模式识别与智能系统
招生方向
智能认知安全
机器学习与数据挖掘
模式识别与人工智能

教育背景

2005-09--2010-06   中国科学院自动化研究所   工学博士(硕博连读)
2001-09--2005-06   南京理工大学   工学学士
学历
博士
学位
博士

工作经历

   
工作简历
2023-10~现在, 中国科学院信息工程研究所, 研究员
2015-10~2023-10,中国科学院信息工程研究所, 副研究员
2014-05~2015-10,中国科学院信息工程研究所, 助理研究员
2010-07~2014-04,中国科学技术信息研究所, 助理研究员
学术兼职

[1]    电气和电子工程师协会(IEEE):Senior Member2016.02-
[2]    国际计算机学会(ACM):Senior Member2016.12-
[3]    中国计算机学会(CCF):高级会员,2017.01-2022.09杰出会员2022.09-
[4]    中国图像图形学会(CSIG):高级会员2019.05-
[5]    中国人工智能学会(CAAI):高级会员2022.11-
[6]    中国图像图形学会(CSIG)视觉大数据专委会:副秘书长2017.05-
[7]    中国自动化学会(CAA)模式识别与机器智能专委会:副秘书长2017.11-

专利与奖励

   
科技奖励

[1]    WACV 2024国际竞赛: FRCSyn Challenge: Face Recognition Challenge in the Era of Synthetic Data, 第一名,排名5/6指导老师】,2024
[2]    全国大数据与计算智能挑战赛,优胜奖,排名2/5指导老师】,2023
[3]    北京图象图形学学会优秀导师提名奖,排名1/12023
[4]    中国科学院职工技能大赛人工智能领域,优胜奖,排名1/5指导老师】,2023
[5]    CVPR 2021国际竞赛: Woodscape Fisheye Semantic Segmentation for Autonomous Driving Challenge, 第一名,排名5/5指导老师】,2021
——冠军方案:“Full swin-transformer encoder-decoder
[6]    中国图象图形学学会科学技术奖,省部级二等奖,排名1/2第一完成人】,2019
——获奖成果:“基于协同融合的媒体智能感知”
[7]    北京市科学技术协会第十四届北京青年优秀科技论文奖,省部级,三等奖,排名1/1第一作者】,2018
——获奖论文:《Bidirectional active learning: a two-way exploration into unlabeled and labeled dataset
[8]    中国电影电视技术学会影视科技优秀论文奖,省部级,三等奖,排名3/32017
——获奖论文:《基于深度学习的融合媒体智能引擎研究》
[9]    中国电影电视技术学会影视科技优秀论文奖,省部级,三等奖,排名3/32017
——获奖论文:《基于海量异构数据关联和挖掘的媒体融合技术研究》
[10] CCCV2017 Best Paper Nominate Award,排名3/6唯一通讯作者】,2017
——获奖论文:《A novel framework for image description generation
[11] 吴文俊人工智能科学技术创新奖,省部级二等奖,排名1/1第一完成人】,2016
——获奖成果:“智能交互式主动学习关键技术”
[12] 微软杯IEEE中国学生论文大赛,银奖,排名1/1第一作者】,2009
——获奖论文:《Effective annotation and search for video blogs with integration of context and content analysis
[13] 宝钢教育基金,优秀学生奖,2009
[14] 中国科学院研究生院,三好学生标兵,2010

授权发明专利
[1]    一种基于双级对比学习与噪声鲁棒的弱监督时序语言定位方法和装置. 2023.05.25, CN202310598246.2. 授权
[2]    一种基于可解释人工智能的实时入侵检测方法及系统. 2022.12.08, CN202211571092.X. 授权
[3]    基于对抗扰动的实时网络连接隐私保护方法和系统. 2022.06.01, CN202210622904.2.授权
[4]    基于优化元学习的轻量恶意软件流量检测方法及装置. 2022.05.18, CN2022105476786.6. 授权
[5]    基于直推图的加密流量识别与分类方法及系统. 2022.04.25, CN202210440703.0. 授权
[6]    基于图匹配的不同网络环境的加密流量分类方法及系统. 2022.04.15, CN202210397693.7. 授权
[7]    一种基于动作片段排序的弱监督行为定位方法和装置. 2021.09.27, CN202111135210.8. 授权
[8]    一种基于图结构信息交互增强的行为检测方法及电子装置. 2020.07.20, CN202010698168.X. 【授权】
[9]    一种基于自表达相关的数据分类方法和装置. 2018.12.12, CN201811518273.X. 【授权】
[10] 一种基于生成对抗网络的安全隐写方法和装置. 2017.08.08, CN201710670786.1. 【授权】
[11] 一种支持全局复杂检索的跨地域查询方法及系统. 2017.06.07, CN201710422561.4. 【授权】
[12] 一种针对多源异构数据的异源间相似性度量方法. 2016.06.17, CN201610439325.9. 【授权】
[13] 一种新鲜度敏感的大数据概要信息维护及聚合值查询方法. 2015.05.18, CN201510252988.5. 授权】
[14] 一种社交网络结构构建方法. 2015.01.30, CN201510050126.4. 授权】
[15] 一种已标注样本的维护方法及双向学习交互式分类方法. 2015.01.29, CN201510046891.9. 授权】
[16] 一种基于非确定主动学习的多分类器训练方法及分类方法. 2015.01.29, CN201510046879.8. 授权】
[17] 面向大数据环境的概要信息动态构建与查询方法及装置. 2015.02.05, CN201510061345.2. 授权】
[18] 一种提取地标性场景摘要的方法. 2009.12.16, CN200910242751.3. 授权】
[19] 一种交互式图像检索方法. 2007.08.29, CN200710121079.3. 授权】

论文专著

   
代表性期刊论文
CCF-A类:
[1]    Masked face transformer. IEEE Transactions on Information Forensics and Security (TIFS), 2024. 5作者,CCF-A类期刊
[2]    Prism: real-time privacy protection against temporal network traffic analyzers. IEEE Transactions on Information Forensics and Security (TIFS), 2023. *通信作者,CCF-A类期刊】
[3]    Masked relation learning for deepfake detection. IEEE Transactions on Information Forensics and Security (TIFS), 2023. *通信作者,CCF-A类期刊】
[4]    StochasticFormer: stochastic modeling for weakly supervised temporal action localization. IEEE Transactions on Image Processing (TIP), 2023. *通信作者,CCF-A类期刊
[5]    Face forgery detection by 3d decomposition and composition search. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. 【第5作者CCF-A类期刊
[6]    ProGraph: robust network traffic identification with graph propagation. IEEE/ACM Transactions on Networking (ToN), 2022. *通信作者,CCF-A类期刊
[7]    Action shuffling for weakly supervised temporal localization. IEEE Transactions on Image Processing (TIP), 2022. 第一作者,CCF-A类期刊
[8]    Heterogeneous face recognition via face synthesis with identity-attribute disentanglement. IEEE Transactions on Information Forensics and Security (TIFS), 2022. *通信作者,CCF-A类期刊】
[9]    FA-GAN: face augmentation GAN for deformation-invariant face recognition. IEEE Transactions on Information Forensics and Security (TIFS), 2021. *通信作者,CCF-A类期刊】
[10] Context-aware local abnormality detection in crowded scene. Science China Information Sciences (SCIS), 2015. *通信作者,CCF-A类期刊】
CCF-B类:
[11] OW-TAL: learning unknown human activities for open-world temporal action localization. Pattern Recognition (PR), 2023. *通信作者,CCF-B类期刊
[12] Robust network traffic identification with graph matching. Computer Networks (COMNET), 2022. *通信作者,CCF-B类期刊
[13] DyGCN: efficient dynamic graph embedding with graph convolutional network. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022. 【第4作者CCF-B类期刊】
[14] SAPS: Self-Attentive Pathway Search for weakly-supervised action localization with background-action augmentation. Computer Vision and Image Understanding (CVIU), 2021. *通信作者,CCF-B类期刊】
[15] Weakly-supervised action localization via embedding-modeling iterative optimization. Pattern Recognition (PR), 2021. 第一作者,CCF-B类期刊
[16] Hashing nets for hashing: a quantized deep learning to hash framework for remote sensing image retrieval. IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2020. 【第4作者CCF-B类期刊
[17] AdapNet: adaptability decomposing encoder-decoder network for weakly supervised action recognition and localization. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020. 第一作者,CCF-B类期刊】
[18] Generative adversarial image super-resolution through deep dense skip connections. Computer Graphics Forum (CGF), 2018.*通信作者,CCF-B类期刊】
[19] A self-paced regularization framework for multi-label learning. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2018. 【第4作者CCF-B类期刊】
[20] Bidirectional active learning: a two-way exploration into unlabeled and labeled dataset. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2015.第一作者,CCF-B类期刊】
[21] Effective annotation and search for video blogs with integration of context and content analysis. IEEE Transactions on Multimedia (TMM), 2009.第一作者,CCF-B类期刊】
其它:
[22] TwinNet: twin structured knowledge transfer network for weakly supervised action localization. Machine Intelligence Research (MIR), 2022. 第一作者,SCI期刊
[23] Consistent sub-decision network for low-quality masked face recognition. Signal Processing Letters (SPL), 2022. 【第4作者CCF-C类期刊】
[24] Active semi-supervised learning based on self-expressive correlation with generative adversarial networks. Neurocomputing (NEUCOM), 2019. 第一作者,CCF-C类期刊】
[25] A novel framework for semantic segmentation with generative adversarial network. Journal of Visual Communication and Image Representation (JVCI), 2019. *通信作者,CCF-C类期刊】
[26] Deep convolutional representations and kernel extreme learning machines for image classification. Multimedia Tools and Applications (MTA), 2019.*通信作者,CCF-C类期刊】
[27] ListNet-based object proposals ranking. Neurocomputing (NEUCOM), 2017. *通信作者,CCF-C类期刊】
[28] Simultaneous Optimization for robust correlation estimation in partially observed social network. Neurocomputing (NEUCOM), 2016.第一作者,CCF-C类期刊】
[29] Weighted hierarchical geographic information description model for social relation estimation. Neurocomputing (NEUCOM), 2016. *通信作者,CCF-C类期刊】
[30] Update vs. upgrade: modeling with indeterminate multi-class active learning. Neurocomputing (NEUCOM), 2015.第一作者,CCF-C类期刊】
[31] Interactive Patent classification based on multi-classifier fusion and active learning. Neurocomputing (NEUCOM), 2014.第一作者,CCF-C类期刊】
[32] Personalized retrieval of sports video based on multi-modal analysis and user preference acquisition. Multimedia Tools and Applications (MTA), 2009. 【第3作者CCF-C类期刊】
代表性会议论文

CCF-A类:
[1]    Cross-architecture distillation for face recognition. In Proc. ACM International Conference on Multimedia (MM), 2023. *通信作者,CCF-A类会议
[2]    Rumor detection with diverse counterfactual evidence. In Proc. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2023. *通信作者,CCF-A类会议
[3]    Grouped knowledge distillation for deep face recognition. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2022. *通信作者,CCF-A类会议
[4]    Dynamic graph modeling for weakly-supervised temporal action localization. In Proc. ACM International Conference on Multimedia (MM), 2022. *通信作者,CCF-A类会议】
[5]    Multi-instance multi-label action recognition and localization based on spatio-temporal pre-trimming for untrimmed videos. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2020. 第一作者,CCF-A类会议
[6]    On deep unsupervised active learning. In Proc. International Joint Conference on Artificial Intelligence (IJCAI), 2020. 【第5作者CCF-A类会议
[7]    Dressing as a whole: outfit compatibility learning based on node-wise graph neural networks. In Proc. World Wide Web Conference (WWW), 2019. *通信作者,CCF-A类会议
[8]    Learning transferable self-attentive representations for action recognition in untrimmed videos with weak supervision. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2019. 第一作者,CCF-A类会议
[9]    Residual invertible spatio-temporal network for video super-resolution. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2019. *通信作者,CCF-A类会议
[10] Collaborative multi-view denoising. In Proc. ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2016. 【第3作者CCF-A类会议】
[11] MC-HOG correlation tracking with saliency proposal. In Proc. AAAI Conference on Artificial Intelligence (AAAI), 2016. 【第4作者CCF-A类会议】
CCF-B类:
[12] MetaTKG: learning evolutionary meta-knowledge for temporal knowledge graph reasoning. In Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022. *通信作者,CCF-B类会议】
[13] Fi-GNN: modeling feature interactions via graph neural networks for CTR prediction. In Proc. ACM International Conference on Information and Knowledge Management (CIKM), 2019. *通信作者,CCF-B类会议
[14] Semi-supervised compatibility learning across categories for clothing matching. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2019. *通信作者,CCF-B类会议
[15] Compressing deep neural networks for efficient visual inference. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2017. *通信作者,CCF-B类会议】
[16] Supporting real-time analytic queries in big and fast data environments. In Proc. International Conference on Database Systems for Advanced Applications (DASFAA), 2017. 【第6作者CCF-B类会议】
[17] Multi-view multi-label active learning for image classification. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2009. 第一作者,CCF-B类会议】
[18] Automatic semantic annotation for video blogs. In Proc. IEEE International Conference on Multimedia and Expo (ICME), 2008. 第一作者,CCF-B类会议】
其它:
[19] Denoised dual-level contrastive network for weakly-supervised temporal sentence grounding. In Proc. Computational Visual Media Conference (CVM), 2024. *通信作者,CCF-C类会议
[20] Spoof-guided image decomposition for face anti-spoofing. In Proc. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 2023. 【第3作者CCF-C类会议】
[21] Modeling spoof noise by de-spoofing diffusion and its application in face anti-spoofing. In Proc. IEEE International Joint Conference on Biometrics (IJCB), 2023. 【第3作者CCF-C类会议】
[22] A glimpse of the whole: detecting few-shot android malware encrypted network traffic. In Proc. IEEE International Conferences on High Performance Computing and Communications (HPCC), 2022. *通信作者,CCF-C类会议】
[23] Malware classification based on semi-supervised learning. In Proc. International Conference on Science of Cyber Security (SciSec), 2022. *通信作者,CCF-C类会议】
[24] GBLNet: detecting intrusion traffic with multi-granularity BiLSTM. In Proc. International Conference on Computational Science (ICCS), 2022. *通信作者,IIE-B类会议】
[25] AMDetector: detecting large-scale and novel android malware traffic with meta-learning. In Proc. International Conference on Computational Science (ICCS), 2022. *通信作者,IIE-B类会议】
[26] Cyberbullying detection with side information: a real-world application of COVID-19 news comment in chinese language. In Proc. International Conference on Computational Science (ICCS), 2022. 【第2作者IIE-B类会议】
[27] Malware classification on imbalanced data through self-attention. In Proc. International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), 2020. 【第4作者CCF-C类会议】
[28] Weakly-supervised action recognition and localization via knowledge transfer. In Proc. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 2019. *通信作者,CCF-C类会议】
[29] Synchronized detection and recovery of steganographic messages with adversarial learning. In Proc. International Conference on Computational Science (ICCS), 2019. *共同一作,IIE-B类会议】
[30] A novel partition method for busy urban area based on spatial-temporal information. In Proc. International Conference on Computational Science (ICCS), 2019. 【第5作者IIE-B类会议】
[31] SegGAN: semantic segmentation with generative adversarial network. In Proc. International Conference on Multimedia Big Data (BigMM), 2018. *通信作者,EI会议
[32] Augmented self-paced learning with generative adversarial networks. In Proc. International Conference on Computational Science (ICCS), 2018. 第一作者,IIE-B类会议】
[33] Effective semi-supervised learning based on local correlation. In Proc. International Conference on Computational Science (ICCS), 2018. 第一作者,IIE-B类会议】
[34] Effective learning with joint discriminative and representative feature selection. In Proc. International Conference on Computational Science (ICCS), 2018. *通信作者,IIE-B类会议】
[35] A novel framework for image description generation. In Proc. Chinese Conference on Computer Vision (CCCV), 2017. *通信作者,EI会议,最佳论文提名奖
[36] SSGAN: secure steganography based on generative adversarial networks. In Proc. Pacific-Rim Conference on Multimedia (PCM), 2017. *通信作者,CCF-C类会议
[37] Discriminative learning from selective recommendation and its application in AdaBoost. In Proc. International Conference on Computational Science (ICCS), 2017. 第一作者,IIE-B类会议】
[38] Effective learning with 2-dimensional active selection on feature and instance. In Proc. International Conference on Computational Science (ICCS), 2017. 第一作者,IIE-B类会议】
[39] Retweeting behavior prediction using probabilistic matrix factorization. In Proc. IEEE Symposium on Computers and Communications (ISCC), 2016. *通信作者,CCF-C类会议】
[40] A markov random field approach to automated protocol signature inference. In Proc. EAI International Conference on Security and Privacy in Communication Networks (SecureComm), 2015. 【第5作者CCF-C类会议】
[41] Selective sampling based on dynamic certainty propagation for image retrieval. In Proc. International Multimedia Modeling Conference (MMM), 2008. 第一作者,CCF-C类会议】
[42] Weighted co-SVM for image retrieval with MVB strategy. In Proce. IEEE International Conference on Image Processing (ICIP), 2007. 第一作者,CCF-C类会议】

科研活动

   
主持项目

[1]    项目负责人:国家自然科学基金-面上项目,2024.01-2027.1251万元
[2]    课题负责人:基础科研计划-重大项目,2022.01-2025.12400万元(项目总经费2030万元)
[3]    课题负责人:国家发改委重大工程项目,2022.01-2023.127288.8万元
[4]    项目负责人:国家信息技术安全研究中心采购项目,2021.06-2021.12189万元
[5]    项目负责人:国家自然科学基金-联合基金项目-培育项目(NSFC-新疆联合基金),2021.01-2023.1258万元
[6]    项目负责人:中国科学技术发展战略研究院项目,2020.12-2021.1130万元
[7]    项目负责人:订购项目,2020.07-2020.12708万元
[8]    项目负责人:国家自然科学基金-面上项目,2019.01-2022.1261万元
[9]    项目负责人:模式识别国家重点实验室开放课题,2018.01-2019.124万元,
[10] 项目负责人:工程项目,2017.05-2018.04219万元
[11] 项目负责人:国家242信息安全计划,2016.06-2017.0580万元
[12] 项目负责人:国家自然科学基金-青年科学基金项目,2016.01-2018.1223.7万元
[13] 课题负责人:国家科技支撑计划,2015.04-2017.12172.2万元(项目总经费2361万元)
[14] 项目负责人:国家242信息安全计划,2014.06-2015.0510万元
[15] 项目负责人:中央级公益性科研院所基本科研业务费专项资金-重点工作,2011.07-2012.0658万元
[16] 项目负责人:中央级公益性科研院所基本科研业务费专项资金-重点工作,2010.07-2011.0680万元

指导学生


毕业研究生
[1]    张凯,2014普博(协助指导),信息安全,2018毕业
[2]    石海超,2017学硕/2020转博,网络空间安全,2022毕业
[3]    李泽坤,2018学硕,网络空间安全,2021毕业
[4]    邢剑,2018普博,网络空间安全,2022毕业
[5]    丁煜,2018普博,网络空间安全,2023毕业
[6]    杨梓铭,2020学硕,计算机应用技术,2023毕业
在读研究生

[1]    张亚如,2019学硕/2022转博,计算机应用技术
[2]    李文灏,2019学硕/2022转博,网络空间安全
[3]    夏雨微,2021直博,网络空间安全
[4]    赵唯松,2021直博,计算机应用技术
[5]    张斌,2021学硕,计算机应用技术
[6]    于艾靖,2022普博,计算机应用技术
[7]    童昭,2022普博,计算机应用技术
[8]    邢思雨,2022学硕,计算机应用技术
[9]    张凯薇,2022学硕,网络空间安全
[10] 徐文武,2022学硕,网络空间安全
[11] 戴光祥,2022学硕,网络空间安全
[12] 徐雨婷,2023普博,计算机应用技术
[13] 刘继鹏,2023直博,计算机应用技术
[14] 杨琛,2023专硕,电子信息

荣誉奖励

[1]    石海超:北京市科学技术协会青年人才托举工程,2024
[2]    石海超:北京图象图形学学会优秀博士论文提名奖,2023
[3]    石海超:朱李月华优秀博士生奖学金,2022
[4]    张亚如:国家奖学金,2021
[5]    石海超:国家奖学金,2019
[6]    张凯:中国科学院院长奖学金,2017
[7]    张凯:国家奖学金,2017