Jiaming Xu, Associate Professor
Email: jiaming.xu@ia.ac.cn
Address: Intelligent Building 808, No. 95 Zhongguancun East Road, Haidian District, Beijing, China. 100190
Auditory Model and Cognitive Computing Laboratory
Lab's Github: https://github.com/aispeech-lab
Research Areas
Research interest on Multimodal Speech Perception, Speech and Language Processing, Speech Separation and Recognition, Spiking Neural Networks, Question&Answer and Dialogue System.
Education
2012-09~2016-01, Ph.D, University of Chinese Academy of Sciences (UCAS), Beijing, China
2009-09~2012-01, Master, University of Science and Technology Beijing (USTB), Beijing, China
Experience
Work Experience
2018-10~Present, Associate Professor, at Institute of Automation, Chinese Academy of Sciences
2016-02~2018-10, Assistant Professor, at Institute of Automation, Chinese Academy of Sciences
2014-06~2014-08, Visiting Scholar, at the Chinese University of Hong Kong
Publications
Books
(1)Jiaming Xu, Jing Shi, Bo Xu. Chinese Version of "The Auditory System at the Cocktail Party", China Machine Press, 2020-12
Selected Papers [Google Scholar]
(31)Jiaming Xu, Jian Cui, Yunzhe Hao, Bo Xu. Multi-Cue Guided Semi-Supervised Learning toward Target Speaker Separation in Real Environments, 2022 (under review)
(30)Yating Huang, Yunzhe Hao, Jiaming Xu, Bo Xu. Compressing Speaker Extraction Model with Ultra-low Precision Quantization and Knowledge Distillation, Neural Networks, 2022 [Code]
(29)Qinghua Liu, Yating Huang, Yunzhe Hao, Jiaming Xu, Bo Xu. LiMuSE: Lightweight Multi-modal Speaker Extraction, SLT, 2022 [Code]
(28) Ziyi Ni, Jiaming Xu, Yuwei Wu, Mengfan Li, Guizhi Xu, Bo Xu. Improving Cross-State and Cross-Subject Visual ERP-Based BCI With Temporal Modeling and Adversarial Training, TNSRE, 2022 [Code]
(27) Xiyun Li, Yong Xu, Meng Yu, Shi-Xiong Zhang, Jiaming Xu, Bo Xu, Dong Yu. MIMO Self-attentive RNN Beamformer for Multi-speaker Speech Separation, INTERSPEECH, 2021
(26) Chenxing Li, Jiaming Xu, Nima Mesgarani, Bo Xu. Speaker and Direction Inferred Dual-Channel Speech Separation, ICASSP, 2021 [Code]
(25) Yunzhe Hao, Jiaming Xu, Bo Xu. WASE: Learning When to Attend for Speaker Extraction in Cocktail Party Environments, ICASSP, 2021 [Code]
(24) Yunzhe Hao, Jiaming Xu, Jing Shi, Peng Zhang, Lei Qin, Bo Xu. A Unified Framework for Low-Latency Speaker Extraction in Cocktail Party Environments, INTERSPEECH, 2020
(23) Jing Shi, Jiaming Xu, Yusuke Fujita, Shinji Watanabe, Bo Xu. Speaker-Conditional Chain Model for Speech Separation and Extraction, INTERSPEECH, 2020
(22) Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie. Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals, NeurIPS, 2020
(21) Feilong Chen, Fandong Meng, Jiaming Xu, Peng Li, Bo Xu, Jie Zhou. DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog, AAAI, 2020
(20) Xiang Cheng, Yunzhe Hao, Jiaming Xu, Bo Xu. LISNN: Improving Spiking Neural Networks with Lateral Interactions for Robust Object Recognition, IJCAI, 2020
(19) Jing Shi, Jiaming Xu, Yiqun Yao, Bo Xu. Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural Networks, Neural Networks, 2019
(18)Yating Huang, Jing Shi, Jiaming Xu, Bo Xu. Research Advances and Perspectives on the Cocktail Party Problem and Related Auditory Models, Acta Automatica Sinica, 2019
(17) Yiqun Yao, Jiaming Xu, Bo Xu. The World in My Mind: Visual Dialog with Adversarial Multi-modal Feature Encoding, NAACL, 2019
(16) Xiuyi Chen, Jiaming Xu, Bo Xu. A Working Memory Model for Task-oriented Dialog Response Generation, ACL, 2019
(15) Guangcan Liu, Yu Cao, Jiaming Xu, Bo Xu. Natural Language Inference Based on Adversarial Regularization, Acta Automatica Sinica, 2019
(14) Jing Shi, Jiaming Xu, Bo Xu. Which Ones Are Speaking? Speaker-inferred Model for Multi-talker Speech Separation, INTERSPEECH, 2019
(13) Jiaming Xu, Jing Shi, Guangcan Liu, Xiuyi Chen, Bo Xu. Modeling Attention and Memory for Auditory Selection in a Cocktail Party Environment, AAAI, 2018
(12) Jing Shi, Jiaming Xu, Guangcan Liu, Bo Xu. Listen, Think and Listen Again: Capturing Top-down Auditory Attention for Speaker-independent Speech Separation, IJCAI, 2018
(11) Yiqun Yao, Jiaming Xu, Jing Shi, Bo Xu. Learning to Activate Logic Rules for Textual Reasoning, Neural Networks, 2018
(10) Yiqun Yao, Jiaming Xu, Feng Wang, Bo Xu. Cascaded Mutual Modulation for Visual Reasoning, EMNLP, 2018
(9) Peng Zhou, Jiaming Xu, Zhenyu Qi, Hongyun Bao, Zhineng Chen, Bo Xu. Distant Supervision for Relation Extraction with Hierarchical Selective Attention, Neural Networks, 2018
(8) Jiaming Xu, Bo Xu, Peng Wang, Suncong Zheng, Guanhua Tian, Jun Zhao, Bo Xu. Self-Taught Convolutional Neural Networks for Short Text Clustering, Neural Networks, 2017
(7) Peng Wang, Bo Xu, Jiaming Xu, Guanhua Tian, Chenglin Liu, Hongwei Hao. Semantic Expansion using Word Embedding Clustering and Convolutional Neural Network for Improving Short Text Classification, Neurocomputing, 2016
(6) Suncong Zheng, Jiaming Xu, Hongyun Bao, Zhenyu Qi, Jie Zhang, Hongwei Hao, Bo Xu. Joint Learning of Entity Semantics and Relation Pattern for Relation Extraction, ECML, 2016
(5) Peng Zhou, Zhenyu Qi, Suncong Zheng, Jiaming Xu, Hongyun Bao, Bo Xu. Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling, COLING, 2016
(4) Jiaming Xu, Jing Shi, Yiqun Yao, Suncong Zheng, Bo Xu, Bo Xu. Hierarchical Memory Networks for Answer Selection on Unknown Words, COLING, 2016
(3) Suncong Zheng, Jiaming Xu, Peng Zhou, Hongyun Bao, Zhenyu Qi, Bo Xu. A Neural Network Framework for Relation Extraction: Learning Entity Semantic and Relation Pattern, Knowledge-Based Systems, 2016
(2) Jiaming Xu, Peng Wang, Guanhua Tian, Bo Xu, Jun Zhao, Fangyuan Wang, Hongwei Hao. Convolutional Neural Networks for Text Hashing, IJCAI, 2015
(1) Peng Wang, Jiaming Xu, Bo Xu, Chenglin Liu, Heng Zhang, Fangyuan Wang, Hongwei Hao. Semantic Clustering and Convolutional Neural Network for Short Text Categorization, ACL, 2015