Jiaming Xu, Associate Professor


Address: Intelligent Building 808, No. 95 Zhongguancun East Road, Haidian District, Beijing, China. 100190

Auditory Model and Cognitive Computing Laboratory 

Lab's Github:

Research Areas

Research interest on Multimodal Speech Perception, Speech and Language Processing, Speech Separation and Recognition, Spiking Neural Networks, Question&Answer and Dialogue System.


2012-09~2016-01, Ph.D, University of Chinese Academy of Sciences (UCAS), Beijing, China
2009-09~2012-01, Master, University of Science and Technology Beijing (USTB), Beijing, China


Work Experience

2018-10~Present, Associate Professor, at Institute of Automation, Chinese Academy of Sciences
2016-02~2018-10, Assistant Professor, at Institute of Automation, Chinese Academy of Sciences
2014-06~2014-08, Visiting Scholar, at the Chinese University of Hong Kong


(1)Jiaming Xu, Jing Shi, Bo Xu. Chinese Version of "The Auditory System at the Cocktail Party", China Machine Press, 2020-12
Selected Papers [Google Scholar]
(30)Yating Huang, Yunzhe Hao, Jiaming Xu, Bo Xu. Compressing Speaker Extraction Model with Ultra-low Precision Quantization and Knowledge Distillation, Neural Networks, 2022 [Code]
(29)Qinghua Liu, Yating Huang, Yunzhe Hao, 
Jiaming Xu, Bo Xu. LiMuSE: Lightweight Multi-modal Speaker ExtractionArXiv, 2022 [Code]
(28) Ziyi Ni, Jiaming Xu, Yuwei Wu, Mengfan Li, Guizhi Xu, Bo Xu. Improving Cross-State and Cross-Subject Visual ERP-Based BCI With Temporal Modeling and Adversarial TrainingTNSRE, 2022 [Code]
(27) Xiyun Li, Yong Xu, Meng Yu, Shi-Xiong Zhang, Jiaming Xu, Bo Xu, Dong Yu. MIMO Self-attentive RNN Beamformer for Multi-speaker Speech SeparationINTERSPEECH, 2021
Chenxing Li, Jiaming Xu, Nima Mesgarani, Bo Xu. Speaker and Direction Inferred Dual-Channel Speech Separation, ICASSP, 2021 [Code]
Yunzhe Hao, Jiaming Xu, Bo Xu. WASE: Learning When to Attend for Speaker Extraction in Cocktail Party Environments, ICASSP, 2021 [Code]
Yunzhe Hao, Jiaming Xu, Jing Shi, Peng Zhang, Lei Qin, Bo Xu. A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments, INTERSPEECH, 2020
(23) Jing Shi, Jiaming Xu, Yusuke Fujita, Shinji Watanabe, Bo Xu. Speaker-Conditional Chain Model for Speech Separation and Extraction, INTERSPEECH, 2020
(22) Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie. Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals, NeurIPS, 2020
(21) Feilong Chen, Fandong Meng, Jiaming Xu, Peng Li, Bo Xu, Jie Zhou. DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog, AAAI, 2020
(20) Xiang Cheng, Yunzhe Hao, Jiaming Xu, Bo Xu. LISNN: Improving Spiking Neural Networks with Lateral Interactions for Robust Object RecognitionIJCAI, 2020
(19) Jing Shi, Jiaming Xu, Yiqun Yao, Bo Xu. Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural NetworksNeural Networks, 2019
(18)Yating Huang, Jing Shi, Jiaming Xu, Bo Xu. Research Advances and Perspectives on the Cocktail Party Problem and Related Auditory ModelsActa Automatica Sinica, 2019
(17) Yiqun Yao, Jiaming Xu, Bo Xu. The World in My Mind: Visual Dialog with Adversarial Multi-modal Feature EncodingNAACL, 2019
(16) Xiuyi Chen, Jiaming Xu, Bo Xu. A Working Memory Model for Task-oriented Dialog Response GenerationACL, 2019
(15) Guangcan Liu, Yu Cao, Jiaming Xu, Bo Xu. Natural Language Inference Based on Adversarial RegularizationActa Automatica Sinica, 2019
(14) Jing Shi, Jiaming Xu, Bo Xu. Which Ones Are Speaking? Speaker-inferred Model for Multi-talker Speech SeparationINTERSPEECH, 2019
(13) Jiaming Xu, Jing Shi, Guangcan Liu, Xiuyi Chen, Bo Xu. Modeling Attention and Memory for Auditory Selection in a Cocktail Party EnvironmentAAAI, 2018
(12) Jing Shi, Jiaming Xu, Guangcan Liu, Bo Xu. Listen, Think and Listen Again: Capturing Top-down Auditory Attention for Speaker-independent Speech SeparationIJCAI, 2018
(11) Yiqun Yao, Jiaming Xu, Jing Shi, Bo Xu. Learning to Activate Logic Rules for Textual ReasoningNeural Networks, 2018
(10) Yiqun Yao, Jiaming Xu, Feng Wang, Bo Xu. Cascaded Mutual Modulation for Visual ReasoningEMNLP, 2018
(9) Peng Zhou, Jiaming Xu, Zhenyu Qi, Hongyun Bao, Zhineng Chen, Bo Xu. Distant Supervision for Relation Extraction with Hierarchical Selective AttentionNeural Networks, 2018
(8) Jiaming Xu, Bo Xu, Peng Wang, Suncong Zheng, Guanhua Tian, Jun Zhao, Bo Xu. Self-Taught Convolutional Neural Networks for Short Text ClusteringNeural Networks, 2017
(7) Peng Wang, Bo Xu, Jiaming Xu, Guanhua Tian, Chenglin Liu, Hongwei Hao. Semantic Expansion using Word Embedding Clustering and Convolutional Neural Network for Improving Short Text ClassificationNeurocomputing, 2016
(6) Suncong Zheng, Jiaming Xu, Hongyun Bao, Zhenyu Qi, Jie Zhang, Hongwei Hao, Bo Xu. Joint Learning of Entity Semantics and Relation Pattern for Relation ExtractionECML, 2016
(5) Peng Zhou, Zhenyu Qi, Suncong Zheng, Jiaming Xu, Hongyun Bao, Bo Xu. Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max PoolingCOLING, 2016
(4) Jiaming Xu, Jing Shi, Yiqun Yao, Suncong Zheng, Bo Xu, Bo Xu. Hierarchical Memory Networks for Answer Selection on Unknown WordsCOLING, 2016
(3) Suncong Zheng, Jiaming Xu, Peng Zhou, Hongyun Bao, Zhenyu Qi, Bo Xu. A Neural Network Framework for Relation Extraction: Learning Entity Semantic and Relation PatternKnowledge-Based Systems, 2016
(2) Jiaming Xu, Peng Wang, Guanhua Tian, Bo Xu, Jun Zhao, Fangyuan Wang, Hongwei Hao. Convolutional Neural Networks for Text HashingIJCAI, 2015
(1) Peng Wang, Jiaming Xu, Bo Xu, Chenglin Liu, Heng Zhang, Fangyuan Wang, Hongwei Hao. Semantic Clustering and Convolutional Neural Network for Short Text CategorizationACL, 2015