
Professor in National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences.
Email: jliu@nlpr.ia.ac.cn
Telephone: 86-10-82544507
Address: No.95 Zhongguancun East Road, Haidian Dist., Beijing, China.
Postcode: 100190
Research Areas
Video&Image Analysis and Understanding
Vision and Language
Multimedia Analysis and Retrieval
Education
Pattern Recognition and Intelligence System
Institute of Automation, Chinese Academy of Sciences, P.R. China
Master, July, 2004
Pattern Recognition and Intelligence System, July, 2004.
Shandong University, P.R. China
Bachelor, July, 2001
Control Theory and Control Engineering
Shandong University, P.R. China
Professional Experience
Professor, Nov. 2015- Present
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, P.R. China.
Associate Professor, Nov. 2010- Oct.2015
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, P.R. China.
Assistant Professor, Jan, 2008- Oct. 2010
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, P.R. China.
Publications
(1) Contextual deconvolution network for semantic segmentation, Pattern Recognition, 2020
(2) Normalized and Geometry-Aware Self-Attention Network for Image Captioning, CVPR, 2020
(3) Show, Tell, and Polish: Ruminant Decoding for Image Captioning, IEEE Transactions on Multimedia, 2020
(4) Rankvqa: Answer Re-Ranking For Visual Question Answering, ICME, 2020
(5) Non-Autoregressive Image Captioning with Counterfactuals-Critical Multi-Agent Learning, IJCAI, 2020
(6) Improving visual question answering using dropout and enhanced question encoder, Pattern Recognition, 2019
(7) BTDP: Toward Sparse Fusion with Block Term Decomposition Pooling for Visual Question Answering, ACM Transactions on Multimedia Computing, Communications and Applications, 2019
(8) Show, Tell and Polish: Ruminant Decoding for Image Captioning., IEEE Transactions on Multimedia, 2019
(9) Dual Attention Network for Scene Segmentation, CVPR, 2019
(10) Multi-StyleGAN: Multi-Style Image Captioning from Non-Parallel Data using GANs and Back-Translation, CVPR, 2019
(11) Densely Connected Attention Flow for Visual Question Answering, IJCAI, 2019
(12) Enhancing Visual Question Answering Using Dropout, ACM Multimedia, 2018
(13) Answer Distillation for Visual Question Answering, Asian Conference on Computer Vision, 2018
(14) Collaborative Deconvolutional Neural Networks for Joint Depth Estimation and Semantic Segmentation, IEEE transactions on neural networks and learning systems, 2018
(15) Hierarchically Supervised Deconvolutional Network for Semantic Video Segmentation, Pattern Recognition, 2017
(16) Sketch-based Image Retrieval using Generative Adversarial Networks, ACM Multimedia, 2017
(17) Densely connected deconvolutional network for semantic segmentation, ICIP, 2017
(18) Objectness-aware Semantic Segmentation, ACM Multimedia, 2016
(19) Object-aware Deep Network for Commodity Image Retrieval, International Conference on Multimedia Retrieval, 2016
(20) Multimedia News Summarization in Search, ACM TIST, 2016
(21) Chat with illustration, Multimedia System, 2016
(22) Fine-grained image classification via low-rank sparse coding with general and class-specific codebooks, IEEE transactions on neural networks and learning systems, 2016
(23) Domain-Sensitive Recommendation with User-Item Subgroup Analysis, IEEE Transactions on Knowledge Data Engineering, 2016
(24) Object co-segmentation via salient and common regions discovery, Neurocomputing, 2016
(25) Partially Shared Latent Factor Learning with Multi-View Data, IEEE Transactions on Neural Networks and Learning Systems, 2015
(26) Detection guided deconvolutional network for hierarchical feature learning, Pattern Recognition, 2015
(27) Weakly Supervised RBM for Semantic Segmentation, International Joint Conference on Artificial Intelligence, 2015
(28) Color Names Learning Using Convolutional Neural Networks, International Conference on Image Processing, 2015
(29) Weakly-Supervised Image Semantic Segmentation via Joint Dual Clustering and Dictionary Learning, International Conference on Image Processing, 2015
(30) Exclusive Constrained Discriminative Learning for Weakly-Supervised Semantic Segmentation, ACM Multimedia, 2015
(31) Semi- and Weakly- Supervised Semantic Segmentation with Deep Convolutional Neural Networks, ACM Multimedia, 2015
(32) Robust Structured Subspace Learning for Data Representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
(33) Learning Representative and Discriminative Image Representation by Deep Appearance and Spatial Coding, Computer Vision and Image Understanding, 2015
(34) Object Co-segmentation via Salient and Common Regions Discovery, Neurocomputing, 2015
(35) Boosted MIML method for weakly-supervised image semantic segmentation, Multimedia Tools Application, 2015
(36) Personalized Geo-Specific Tag Recommendation for Photos on Social Websites, IEEE Transactions on Multimedia, 2014
(37) Learning a Representative and Discriminative Part Model with Deep Convolutional Features for Scene Recognition, ACCV, 2014
(38) Image Representation Learning by Deep Appearance and Spatial Coding, ACCV, 2014
(39) Learning Low-Rank Representations with Classwise Block-Diagonal Structure for Robust Face Recognition, AAAI, 2014
(40) Labeling Complicated Objects: Multi-View Multi-Instance Multi-Label Learning, AAAI, 2014
(41) Sparse semantic metric learning for image retrieval, Multimedia System, 2014
(42) Semi-supervised Unified Latent Factor learning with multi-view data, Machine Vision Application, 2014
(43) Learning Robust Face Representation With Classwise Block-Diagonal Structure, IEEE Transactions on Information Forensics and Security, 2014
(44) Clustering-Guided Sparse Structural Learning for Unsupervised Feature Selection, IEEE Transactions on Knowledge Data Engineering, 2014
(45) Adaptive spatial partition learning for image classification, Neurocomputing, 2014
(46) Projective Matrix Factorization with unified embedding for social image tagging, Computer Vision and Image Understanding, 2014
(47) Image classification by non-negative sparse coding, correlation constrained low-rank and sparse decomposition, Computer Vision and Image Understanding, 2014
(48) Key observation selection-based effective video synopsis for camera network, Machine Vision Application, 2014
(49) Sparse representation for robust abnormality detection in crowded scenes, Pattern Recognition, 2014
(50) Object Co-segmentation via Discriminative Low rank Matrix Recovery, ACM Multimedia, 2013
(51) Weakly-Supervised Dual Clustering for Image Semantic Segmentation, IEEE Computer Vision and Pattern Recognition, 2013
(52) Correlation Consistency Constrained Probabilistic Matrix Factorization for Social Tag Refinement, Neurocomputing, 2012
(53) User-aware Image Tag Refinement via Ternary Semantic Analysis, IEEE Transactions on Multimedia, 2012
(54) Boosting Sparsity Constrained Bi-Linear Model for Object Recognition, IEEE Multimedia, 2012
(55) Noisy Tag Alignment with Image Regions , IEEE International Conference on Multimedia and Expo., 2012
(56) Unsupervised Feature Selection Using Nonnegative Spectral Analysis , Association for the Advancement of Artificial Intelligence, 2012
(57) Correlation Mining for News Retrieval, Chapter 33 for the book titled as Social Networks: Computational Aspects and Mining, 2012
(58) Nonlinear Matrix Factorization with Unified Embedding for Social Tag Relevance Learning , Neurocomputing , 2012
(59) One Step Beyond Bags of Features: Visual Categorization Using Components, IEEE International Conference on Image Processing , 2011
(60) Boosted Exemplar Learning for Action Recognition and Annotation, IEEE Transactions on Circuits and Systems for Video Technology, 2011
(61) Image Classification by Non-Negative Sparse Coding, Low-Rank and Sparse Decomposition, IEEE Computer Vision and Pattern Recognition, 2011
(62) User-aware Image Tag Refinement via Ternary Analysis, ACM Multimedia Conference, 2011
(63) Descriptive Local Feature Groups for Image Classification, IEEE International Conference on Image Processing, 2011
(64) Cross-media retrieval: state-of-the-art and open issues, International Journal of Multimedia Intelligence and Security, 2010
(65) Image Annotation Using Multi-Correlation Probabilistic Matrix Factorization, ACM Multimedia Conference, 2010
(66) Multi-Modal Multi-Correlation Person-Centric News Retrieval, ACM Conference on Information and Knowledge Management, 2010
(67) Image Classification Using Spatial Pyramid Coding and Visual Word Reweighting, Asian Conference on Computer Vision, 2010
(68) A Graph-Based Image Annotation Framework, Pattern Recognition Letters, 2009
(69) Image Annotation via Multi-Graph Learning, Pattern Recognition, 2009
(70) Web Image Retrieval via Learning Semantics of Query Image, IEEE International Conference on Multimedia and Expo., 2009
(71) Category sensitive codebook construction for object category recognition, IEEE International Conference on Image Processing , 2009
More Information
See to my group homepage, personal homepage,and Google Scholar citations .