General
Prof. Jianhua Tao

Deputy Director,  National Laboratory of Pattern Recognition (NLPR)
Institute of Automation, Chinese Academy of Sciences


Email: jhtao@nlpr.ia.ac.cn
Tel: +86-10-82614523
Address: 95# Zhong Guan Cun East Road, Beijing, China
Postcode: 100190

Research Areas

Speech and Language Processing, Multmedia Information Processing, Human Computer Interaction, Pattern Recognition

Education

From 1998 to 2001, Ph.D., Tsinghua University
From 1993 to 1996, Master Degree Nanjing University
From 1989 to 1993, Bachelor Degree, Nanjing University

Experience

   
Work Experience
2003 to now, National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 

Other positions:
Speech Communication,  Subject Editor 
IEEE Transactions on Affective Computing,  Steering Committee Member 
International Journal on Synthetic Emotions,  Editorial Board Member
International Journal on Multimodal User Interface,  Editorial Board Member 
HUMAINE Association,  Executive Committee Member
China Computer Federation,  Executive Board Member
Chinese Information Processing Society of China,  Board Member
Chiense Association for Artificial Intelligence,  Board Member

Honors & Distinctions

Winner of IMAGINATION2001 (organized by Eurospeech2001)
Best paper of 2001 National Conference on Man Machine Speech Communction
Best paper of 2004 National Conference on Signal Processing

Publications

   
English Papers
1. Jianhua Tao, Yongguo Kang, Aijun Li,"Prosody conversion from neutral speech to emotional speech", IEEE Transactions on Audio, Speech, and Language Processing, VOL. 14, NO. 4, JULY 2006, pp1145-1154

2. Jianhua Tao, Le Xin, Panrong Yin, "Realistic Visual Speech Synthesis based on Hybrid Concatenation Method", IEEE Transactions on Audio, Speech and Language Processing, Vol. 17, No. 3, March 2009, pp 469-477

3. Meng Zhang, Jianhua Tao, Jani Nurminen, Jilei Tian, Xia Wang, "Supervisory Data Alignment for Text-independent Voice Conversion", IEEE Transactions on Audio, Speech and Language Processing, 2010.

4. Jian Yu, Jianhua Tao, "A Novel Prosody Adaptation Method for Mandarin Concatenation based Text-To-Speech System", International Journal of Acoustical Science and Technology, accepted for publishing in Jan. 2009

5. Jianhua Tao, Panrong Yin, "Speech Driven Face Animation Based on Dynamic Concatenation Model", International Journal of Information and Computational Science, v 4, n 1, March, 2007, p 271-280

6. Mingyu You, Chun Chen, Jiajun Bu, Jia Liu, Jianhua Tao, "Manifolds based Emotion Recognition in Speech", International Journal of Computational Linguistics & Chinese Language Processing, Vol. 12, No. 1, March 2007, pp49-64

7. Meng Zhang, Jianhua Tao, Jani Nurminen, Jilei Tian, Xia Wang, "Phoneme Cluster Based State Mapping for Text-Independent Voice Conversion", 34th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP2009, April 2009, Taipei, China

8. Jianhua Tao, Ya Li, Shifeng Pan, "A Multiple Perception Model on Emotional Speech", The 3rd International Conference on Affective Computing and Intelligent Interaction, ACII09, Sep. 2009, Amsterdam, Netherlands

9. Xiaoying Xu, Ya Li, Liping Hu, Jianhua Tao, "Categorizing Terms’ Subjectivity and Polarity Manually for Opinion Mining in Chinese", The 3rd International Conference on Affective Computing and Intelligent Interaction, ACII09, Sep. 2009, Amsterdam, Netherlands

10. Hongjun Sun, Jianhua Tao, Huibin Jia, "Dimension Reducing of LSF parameters Based on Radial Basis Function Neural Network", INTERSPEECH 2009, Sep. 2009, Brighton, UK

11. Huibin Jia, Jianhua Tao, "Prosody Modeling for Mandarin Exclamatory Speech", 2009 IEEE International Conference on Multimedia and Expo ICME 2009, June 2009, New York, US

12. Jianhua Tao, Fang Zheng, Aijun Li, Ya Li, "Advances in Chinese Natural Language Processing and language resources", O-COCOSDA2009, Aug. 2009, Xinjiang, China

13. Meng Zhang, Jianhua Tao, Xia Wang, Jilei Tian, "Text-Independent Voice Conversion based on State Mapped Codebook", 33nd IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP2008, March 2008, Las Vegas, US, pp.4605-4608

14. Fangzhou Liu, Jianhua Tao, Qing Shi, "Tree-Guided Transformation-Based Homograph Disambiguation in Mandarin TTS System", 33nd IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP2008, March 2008, Las Vegas, US, pp.2657-4660

15. Jian Yu, Meng Zhang, Jianhua Tao, Xia Wang, "A novel hmm-based TTS system using both continuous HMMs and discrete HMMs", 32nd IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP2007, Hawaii

16. Jian Yu, Lixing Huang, Jianhua Tao, Xia Wang, "Modeling Incompletion Phenomenon in Mandarin Dialog Prosody", ICSLP 2007,August 2007, Antrewp

17. Le Xin, Jianhua Tao, Tieniu Tan, "Dynamic Audio-Visual Mapping using Fused Hidden Markov Model Inversion Method", IEEE International Conference on Image Processing, ICIP2007, Sep.2007, pp293-296

18. Jian Yu, Wanzhi Zhang and Jianhua Tao, "A new pitch generation model based on internal dependence of pitch contour for mandarin TTS system" , ICASSP 2006, Toulouse, France

19. Yongguo Kang, Jianhua Tao, Bo Xu, "Apply Pitch Target Model to Convert F0 Contour for Expressive Mandarin Speech Synthesis ",ICASSP 2006, Toulouse,France

20. Mingyu You, ChunChen, JiajunBu, JiaLiu, JianhuaTao, “Emotion recognition from noisy speech”, IEEE International Conference on Multimedia and Expo, ICME2006, Canada

21. Mingyu You, ChunChen, JiajunBu, JiaLiu, JianhuaTao, “Emotional Speech Analysis on onlinear Manifold”, International Conference on Pattern Recognition, ICPR2006, Hongkong

22. Le Xin,Qiang Wang, Jianhua Tao, "Automatic 3D Face Modeling from Video" ,Proc. of the Tenth IEEE International conference on computer vision (ICCV2005),Beijing China ,Vol.2

23. Honghui Dong, Jianhua Tao, Bo Xu,"Chinese Prosodic Phrasing with a Constraint-based Approach" ,INTERSPEECH 2005-EUROSPEECH,Lisbon, Portugal

24. Huibin Jia Jianhua Tao, Xia Wang, "Prosody Variation: Application to Automatic Prosody Evaluation of Mandarin Speech", Speech Prosody 2008, May. 2008, Campinas, Brazil

25. Jianhua Tao, Jian Yu, Lixing Huang, Fangzhou Liu, Huibin Jia, Meng Zhang, "The WISTON Text to Speech System for Blizzard 2008", The Blizzard Challenge 2008 workshop, Oct.2008

26. Jianhua Tao, Fangzhou Liu, Meng Zhang, Huibin Jia, "Design of Speech Corpus for Mandarin Text to Speech", The Blizzard Challenge 2008 workshop, Oct.2008

27. Meng Zhang, Jianhua Tao, Huibin Jia, Xia Wang, "Improving HMM Based Speech Synthesis by Reducing Over-Smoothing Problems", The 6th International Symposium on Chinese Spoken Language Processing, ISCSLP2008, Dec, 2008. Kunming, pp17-20

28. Yi Zhang, Jianhua Tao, "Prosody Modification on Mixed-Language Speech Synthesis", The 6th International Symposium on Chinese Spoken Language Processing, ISCSLP2008, Dec, 2008. Kunming, pp253-256

29. Fangzhou Liu, Huibin Jia, Jianhua Tao, "A Maximum Entropy Based Hierarchical Model for Automatic Prosodic Boundary Labeling In Mandarin" , The 6th International Symposium on Chinese Spoken Language Processing, ISCSLP2008, Dec, 2008. Kunming, pp257-260

30. Zhe Zhang, Lixing Huang, Jianhua Tao, "Unit Feature Based Pruning of Large-Scale Speech Corpus Using Decision Tree", International Conference on Signal Processing, ICSP2008, Oct.2008, Beijing, pp719-722

31. Xiaoyin Xu, Jianhua Tao, "Categorizing Emotional Vocabularies in Chinese Natural Language Communication", O-COCOSDA2008, Nov.2008, Nara, Japan

32. Huibin Jia Jianhua Tao, "Automatic Prosody Quality Evaluation of Mandarin Speech", O-COCOSDA2007, Dec. 2007, Hanoi, Vietnam

33. Xia Wang, Aijun Li, Jianhua Tao, "An Expressive Speech Corpus of Standard Chinese", O-COCOSDA2007, Dec. 2007, Hanoi, Vietnam

34. Panrong Yin, Liyue Zhao, Lixing Huang, Jianhua Tao, "Expressive Face Animation Synthesis based on Dynamic Mapping Method", the 2nd International Conference on Affective Computing and Intelligent Interaction, ACII2007, Sep.2007, Lisbon

35. Lixing Huang, Le Xin, Liyue Zhao, Mi Zhou, Jianhua Tao, "Combining Audio and Video by Dominance in Bimodal Emotion Recognition", the 2nd International Conference on Affective Computing and Intelligent Interaction, ACII2007, Sep.2007, Lisbon

36. Marc Schröder, Laurence Devillers, Kostas Karpouzis, Jean-Claude Martin, Catherine Pelachaud, Christian Peter, Hannes Pirker, Björn Schuller, Jianhua Tao, Ian Wilson, What Should a Generic Emotion Markup Language Be Able to Represent?, the 2nd International Conference on Affective Computing and Intelligent Interaction, ACII2007, Sep.2007, Lisbon

37. Liyue Zhao, Jianhua Tao, "Fast Facial Feature Tracking with Multi-Cue Particle Filter", Image and Vision Computing New Zealand, IVCNZ2007, Hamilton, New Zealand

38. Zhiming Wang, Jianhua Tao, Reconstruction of Partially Occluded Face by Fast Recursive PCA, International Conference on Computational Intelligence and Security, Dec. 2007, Harbin

39. Zhiming Wang, Jianhua Tao, "Remove Unknown Face Occlusion by Fuzzy Principal Component Analysis", CCPR2007, Beijing

40. Donghui Dong, Jianhua Tao, Bo Xu, “Prosodic Word Prediction using a Maximum Entropy Approach”, International Symposium on Chinese Spoken Language Processing, Lecture Notes of Computer Science, ISCSLP2006, Singapore

41. Jian Yu, Jianhua Tao, “Pitch Prediction for Mandarin TTS with Mutual Prosodic Constraint”, International Symposium on Chinese Spoken Language Processing, ISCSLP2006, Singapore

42. Jianhua Tao, Lixing Huang, Yongguo Kang, Jian Yu, “The Friendliness Perception of Dialogue Speech”, 2006 International Conference on Speech Prosody, May 2006, Germany

43. Min Chu, Honghui Dong, Jianhua Tao, "A Perceptual Study on Variability in Break Allocation within Chinese Sentences", 2006 International Conference on Speech Prosody, May 2006, Germany

44. Nick Campbell, Laurence Devillers, Ellen Douglas-Cowie, Veronique Auberge, Anton Batliner, and Jianhua Tao, “Resources for the Processing of Affect in Interactions”, LREC2006, May 2006, Italy

45. Yanhong Wu,Jianhua Tao, Jilun Lu, “The Design of Corpus for Interrogative Speech Synthesis”, The 2006 Oriental COCOSDA, December 2006, MALAYSIA

46. Wang Zhiming, Tao Jianhua, “A fast implementation of adaptive histogram equalization”, the 8th International Conference on Signal Processing, December 2006, Guilin, pp1330-1334

47. Jian Yu, Jianhua Tao, "The Pause Duration Prediction for Mandarin Text-to-Speech System" , 2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE 2005),Wuhan,China,pp.204-208,2005, LSBN:0-7803-9361-9

48. Panrong Yin, Jianhua Tao, "Dynamic mapping method based speech driven face animation system" , The First International Conference on Affective Computing & Intelligent Interaction (ACII2005),Beijing,China, pp.755-763,2005,ISSN 0302-9743

49. Yonglin Li, Jianhua Tao, "Personalized Facial Animation Based on 3D Model Fitting from Two Orthogonal Face Images" , the first International Conference on Affective Computing and Intelligent Interaction, Beijing,China,pp.996-1003,2005, ISSN 0302-9743

50. Yongguo Kang, Zhiwei Shuang ,Jianhua Tao, "A hybrid GMM and codebook mapping method for spectral conversion" ,The First International Conference on Affective Computing & Intelligent Interaction (ACII2005),Beijing,China,pp.303-310,2005, ISSN 0302-9743

51. Honghui Dong, Jianhua Tao,Bo Xu, "Prosodic Word Prediction Using the Lexical Information" ,2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering,Wuhan, China,pp.189-193,2005,LSBN:0-7803-9361-9

52. Honghui Dong, Jianhua Tao, "Length Optimized Chinese Prosodic Phrasing Model" , Proceedings of the International Conference on Chinese Computing 2005, pp.48-53,2005, Singapore

53. Jianhua Tao,Yongguo Kang, "Features Importance Analysis for Emotional Speech Classification", The First International Conference on Affective Computing & Intelligent Interaction (ACII2005), Beijing,China,pp.449-457,2005 ,ISSN 0302-9743

54. Jianhua Tao,Tieniu Tan, "Affective Computing: A review" , The First International Conference on Affective Computing & Intelligent Interaction (ACII2005),Beijing,China,pp.981-995,2005, ISSN 0302-9743

55. Jianhua Tao,jianyu Yongguo Kang, "An Expressive Mandarin Speech Corpus" ,The International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques, O-COCOSDA2005, Bali Island, Indonesia,2005

56. Jianhua Tao and Tieniu Tan, "Emotional Chinese Talking Head System" , ICMI 2004-10,pages:273-280

57. Jianhua Tao, "Context Based Emotion Detection from Text Input" , 8th International Conference on Spoken Language Processing, ICSLP2004, Jeju, 4-8,Oct.2004,pages:1337-1340

58. Jianhua Tao, "Rhymth Correlation of Speech Synthesis System" , ISCSLP2004, pages:221-224

59. Jianhua Tao, "Acoustic and Linguistic Information Based Chinese Prosodic Boundary Labelling" , Lecture Notes of Artificial Intelligence, Springer, 2004,9

60. Jianhua Tao and Yongguo Kang, "Multi-Source Based Acoustic Model for Speech Synthesis" , ICSP2004 Vol.I of III,pagese:621-625

61. Honghui Dong, Jianhua Tao , Bo Xu, "Grapheme-to-Phoneme Conversion in Chinese TTS System" ,ISCSLP2004,pages:165-168

62. Yongguo Kang, Jianhua Tao, Bo Xu, "A New Multicomponent AM-FM Demodulation with Predicting Frequency Boundaries and Its Application to Formant Estimation",Interspeech2004, Oct. 2004, Jeju, pp 1105-1108
Patents
   

Conferences

IEEE International Conference on Acoustics, Signal and Speech Processing
International Conference on Spoken Language Processing
European Conference Speech Processing (Eurospeech)
IEEE International Conference on multimedia expo
International Conference on Affective Computing and Intelligent Interaction
International Symposium of Chinese spoken language processing
International Conference on Pattern Recognition
International Conference on Computer Vision
National Conference on Man Machine Speech Communication
Phonetics Conference of China
International Conference on Multimodal Interface

Collaboration

Nokia, Siemens, Fujistu, Panasonic, China Mobile, China Unicom, etc.