Our Team

location: Home > Our Team > Research Team > Professor > Content

Jingjing Liu  Principal Investigator/Guoqiang Professor

Dr. Jingjing Liu is Professor, Principal Investigator at Tsinghua University. Her current research interests span from Multimodal AI and Self-supervised Learning to Reinforcement Learning and AI for Science. Dr. Liu has published 90+ papers at top AI conferences and journals (NeurIPS, ICML, CVPR, ACL, etc.) with 10K+ citations, and has received the Best Student Paper Honorable Mention Awards at CVPR and WACV. Before joining Tsinghua University in 2021, Dr. Liu was Senior Principal Research Manager at Microsoft in Redmond, US, leading a research group on Vision+Language Multimodal AI. Prior to joining Microsoft Research, Dr. Liu was Research Scientist at MIT CSAIL in Cambridge, US, with the research focus on Spoken Dialogue Systems. Dr. Liu received the PhD degree in Computer Science from MIT EECS. She also holds an MBA degree from Judge Business School (JBS) at University of Cambridge in the UK.


Homepage:

LinkedIn

Google Scholar


Research Fields:

Multimodal AI, Self-supervised Learning, Reinforcement Learning


Selected Publications:

[1]Yanghao Li, Tongda Xu, Yan Wang, Jingjing Liu, and Ya-Qin Zhang, Idempotent Learned Image Compression with Right-Inverse, NeurIPS 2023.

[2]Bowen Gao, Bo Qiang, Haichuan Tan, Yinjun Jia, Minsi Ren, Minsi Lu, Jingjing Liu, Wei-Ying Ma, and Yanyan Lan, DrugCLIP: Contrasive Protein-Molecule Representation Learning for Virtual Screening, NeurIPS 2023.

[3] Hideaki Takahashi, Jingjing Liu, Yang Liu, Breaching FedMD: Image Recovery via Paired-Logits Inversion Attack, CVPR 2023. (arxiv/2304.11436)

[4] Tongda Xu, Han Gao, Yuanyuan Wang, Hongwei Qin, Yan Wang, Jingjing Liu, Ya-Qin Zhang, Correcting the Sub-optimal Bit Allocation, ICML 2023. (arxiv/2209.14575)

[5] Qiying Yu, Yang Liu, Yimu Wang, Ke Xu, and Jingjing Liu, Multimodal Federated Learning via Contrastive Representation Ensemble, ICLR 2023. (arxiv/2302.08888)

[6] Jianxiong Li, Xianyuan Zhan, Haoran Xu, Xiangyu Zhu, Jingjing Liu, and Ya-Qin Zhang, When Data Geometry Meets Deep Function: Generalizing Offline Reinforcement Learning, ICLR 2023. (arxiv/2205.11027)

[7] Jianxiong Li, Xiao Hu, Haoran Xu, Jingjing Liu, Xianyuan Zhan, Qing-Shan Jia, Ya-Qin Zhang, Mind the Gap: Offline Policy Optimization for Imperfect Rewards, ICLR 2023. (arxiv/2302.01667)

[8] Bu Jin, Xinyu Liu, Yupeng Zheng, Pengfei Li, Hao Zhao, Tong Zhang, Yuhang Zheng, Guyue Zhou, and Jingjing Liu, ADAPT: Action-aware Driving Caption Transformer, ICRA 2023. (arxiv:2302.00673)

[9] Qiying Yu, Jieming Lou, Xianyuan Zhan, Qizhang Li, Wangmeng Zuo, Yang Liu, and Jingjing Liu, Adversarial Contrastive Learning via Asymmetric InfoNCE, ECCV 2022. (arxiv:2207.08374)

[10] Tianlong Chen, Yu Cheng, Zhe Gan, Jianfeng Wang, Lijuan Wang, Jingjing Liu, and Zhangyang Wang, Adversarial Feature Augmentation and Normalization for Visual Recognition, Transactions on Machine Learning Research (TMLR), 2022. (arxiv:21Z03.12171)

[11] Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang and Zicheng Liu, Playing Lottery Tickets with Vision and Language, AAAI 2022.(arxiv:2104.11832)

[12] Jinghui Chen, Yu Cheng, Zhe Gan, Quanquan Gu, and Jingjing Liu, Efficient Robust Training via Backward Smoothing, AAAI 2022.(arxiv:2010.01278)

[13] Qiying Yu, Jieming Lou, Xianyuan Zhan, Qizhang Li, Wangmeng Zuo, Yang Liu, and Jingjing Liu, Adversarial Contrastive Learning via Asymmetric InfoNCE, ECCV 2022.(arxiv:2207.08374)

[14] Linjie Li, Jie Lei, Zhe Gan, and Jingjing Liu, Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models, ICCV 2021.(arxiv:2106.00245)

[15] Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang, The Elastic Lottery Ticket Hypothesis, NeurIPS 2021. (arxiv:2103.16547)

[16] Tianlong Chen, Yu Cheng, Zhe Gan, Jingjing Liu, Zhangyang Wang, Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective, NeurIPS 2021. (arxiv:2103.00397)

[17] Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara L. Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu, VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation, NeurIPS 2021. (arxiv:2106.04632)

[18] Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu, EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets, ACL 2021 (Oral). (arXiv:2101.00063)

[19] Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu, Cluster-Former: Clustering-based Sparse Transformer for Question Answering, Findings of ACL 2021. (arxiv/2009.06097)

[20] Chen Zhu, Yu Cheng, Zhe Gan, Furong Huang, Jingjing Liu, and Tom Goldstein, Adaptive Learning Rates with Maximum Variation Averaging, ECML 2021. (arXiv:2006.11918v1)

[21] Jie Lei*, Linjie Li*, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, and Jingjing Liu, Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling, CVPR 2021 (Oral). (arXiv:2102.06183)

[22] Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu, and Jingjing Liu, UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training, CVPR 2021. (arXiv:2104.00332)

[23] Liqun Chen*, Dong Wang*, Zhe Gan, Jingjing Liu, Ricardo Henao, and Lawrence Carin, Wasserstein Contrastive Representation Distillation, CVPR 2021. (arXiv:2012.08674).

[24] Shuyang Dai, Zhe Gan, Yu Cheng, Chenyang Tao, Lawrence Carin, and Jingjing Liu, APo-VAE: Text Generation in Hyperbolic Space, NAACL 2021. (arXiv:2005.00054)

[25] Siqi Sun, Yen-Chun Chen, Linjie Li, Shuohang Wang, Yuwei Fang, and Jingjing Liu, LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval, NAACL 2021. (arXiv:2103.08784)

[26] Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, and Jingjing Liu, InfoBERT: Improving Robustness of Language Models from an Information Theoretic Perspective, ICLR 2021. (arXiv:2010.02329)

[27] Yuwei Fang*, Shuohang Wang*, Zhe Gan, Siqi Sun, and Jingjing Liu, FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding, AAAI 2021. (arXiv:2009.05166)

[28] Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, and Jingjing Liu, Large-Scale Adversarial Training for Vision-and-Language Representation Learning, NeurIPS 2020 (Spotlight) (arXiv:2006.06195)

[29] Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, and Jingjing Liu, HERO: Hierarchical Encoder for Video Language Omni-representation Pre-training, EMNLP 2020. (arXiv:2005.00200)

[30] Siqi Sun, Zhe Gan, Yuwei Fang, Yu Cheng, Shuohang Wang, and Jingjing Liu, Contrastive Distillation on Intermediate Representations for Language Model Compression, EMNLP 2020. (arXiv:2009.14167)

[31] Shuohang Wang, Yuwei Fang, Siqi Sun, Zhe Gan, Yu Cheng, Jiang Jing, and Jingjing Liu, Cross-Thought for Sentence Encoder Pre-training, EMNLP 2020. (arXiv:2010.03652)

[32] Yuwei Fang, Siqi Sun, Zhe Gan, Rohit Pillai, Shuohang Wang, and Jingjing Liu, Hierarchical Graph Network for Multi-hop Question Answering, EMNLP 2020. (arXiv:1911.03631)

[33] Yue Dong, Shuohang Wang, Zhe Gan, Yu Cheng, Jackie Chi Kit Cheung, and Jingjing Liu, Multi-Fact Correction in Abstractive Text Summarization, EMNLP 2020. (arXiv:2010.02443)

[34] Yu Cheng, Yizhe Zhang, Oussama Elachqar, Zhe Gan, and Jingjing Liu, Contextual Text Style Transfer, EMNLP 2020 (Findings of EMNLP). (arXiv:2005.00136)

[35] Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu, UNITER: Learning UNiversal Image-TExt Representations, ECCV 2020. (arXiv:1909.11740)

[36] Jize Cao, Zhe Gan, Yu Cheng, Licheng Yu, Yen-Chun Chen, and Jingjing Liu, Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models, ECCV 2020 (Spotlight). (arXiv:2005.07310)

[37] Liqun Chen, Zhe Gan, Yu Cheng, Linjie Li, Lawrence Carin, and Jingjing Liu, Graph Optimal Transport for Cross-Domain Alignment, ICML 2020. (arXiv:2006.14744)

[38] Yen-Chun Chen, Zhe Gan, Yu Cheng, Jingzhou Liu, and Jingjing Liu, Distilling Knowledge Learned in BERT for Text Generation, ACL 2020. (arXiv:1911.03829)

[39] Jiacheng Xu, Zhe Gan, Yu Cheng, and Jingjing Liu, Discourse-Aware Neural Extractive Model for Text Summarization, ACL 2020. (arXiv:1910.14142)

[40] Yizhe Zhang Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and Bill Dolan, DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation, ACL 2020. (arXiv:1911.00536)

[41] Jingzhou Liu, Wenhu Chen, Yu Cheng, Zhe Gan, Licheng Yu, Yiming Yang, and Jingjing Liu, VIOLIN: A Large-Scale Dataset for Video-and-Language Inference, CVPR 2020. (arXiv:2003.11618)

[42] Yandong Li, Yu Cheng, Zhe Gan, Licheng Yu, Liqiang Wang, and Jingjing Liu, BachGAN: High-Resolution Image Synthesis from Salient Object Layout, CVPR 2020. (arXiv:2003.11690)

[43] Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein, and Jingjing Liu, FreeLB: Enhanced Adversarial Training for Language Understanding, ICLR 2020. (arXiv: 1909.11764)

[44] Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, and Jingjing Liu, Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching, AAAI 2020. (arXiv:2001.07234)

[45] Junjie Hu, Yu Cheng, Zhe Gan, Jingjing Liu, Jianfeng Gao, and Graham Neubig, What Makes A Good Story? Designing Composite Rewards for Visual Storytelling, AAAI 2020. (arXiv: 1909.05316)

[46] Zhe Gan, Yu Cheng, Ahmed EI Kholy, Linjie Li, Jingjing Liu, and Jianfeng Gao, Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog, ACL 2019. (arXiv: 1902.00579)

[47] Linjie Li, Zhe Gan, Yu Cheng, and Jingjing Liu, Relation-aware Graph Attention Network for Visual Question Answering, ICCV 2019. (arXiv: 1903.12314)

[48] Yitong Li, Zhe Gan, Yelong Shen, Jingjing Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, and Jianfeng Gao, StoryGAN: A Sequential Conditional GAN for Story Visualization, CVPR 2019. (arXiv: 1812.02784)

[49] Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, Jingjing Liu, Jianfeng Gao, Yejin Choi, and Siddhartha Srinivasa. Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation, CVPR 2019 (Oral). (arXiv: 1903.02547)

[50] Siqi Sun, Yu Cheng, Zhe Gan, and Jingjing Liu. Patient Knowledge Distillation for BERT Model Compression, EMNLP 2019. (arXiv: 1908.09355)


上一条:Yunxin Liu 下一条:Yanyan Lan

关闭

Email:Airoffice@air.tsinghua.edu.cn
Tel:(010)82151160  

Address:12 / F, block C, Qidi science and technology building, Tsinghua Science and Technology Park, Haidian District, Beijing

wechat

Jing ICP Bei No. 15006448 | all rights reserved@ Institute of intelligent industry, Tsinghua University