Zhaopeng Tu's Publications

Zhaopeng Tu

Principal Researcher
Tencent AI Lab
tuzhaopeng@gmail.com

Bio

Zhaopeng Tu is a principal researcher at Tencent AI Lab, whose research focuses on deep learning for natural language processing (NLP). He is currently working on neural machine translation (NMT) and Seq2Seq learning for other NLP tasks, such as dialogue and question answering. He has published over 50 papers in leading NLP/AI journals and conferences such as ICML, ACL, EMNLP, ICLR, and TACL. He served as Associate Editor of NeuroComputing, Area Chair or Senior PC Member of ACL, EMNLP, NAACL, AAAI, and IJCAI.

Publications

Google Scholar Citations

(* denotes corresponding author.)

2022

Liang Ding, Longyue Wang, Shuming Shi, Dacheng Tao, and Zhaopeng Tu*. Redistributing Low-Frequency Words: Making the Most of Monolingual Data in Non-Autoregressive Translation. ACL 2022.
Zhiwei He, Xing Wang, Rui Wang, Shuming Shi, and Zhaopeng Tu. Bridging the Data Gap between Training and Inference for Unsupervised Neural Machine Translation. ACL 2022.
Wenxuan Wang, Wenxiang Jiao, Yongchang Hao, Xing Wang, Shuming Shi, Zhaopeng Tu*, and Michael Lyu. Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation. ACL 2022.
Wenxiang Jiao, Xing Wang, Shilin He, Zhaopeng Tu, Irwin King, and Michael Lyu. Exploiting Inactive Examples for Natural Language Generation with Data Rejuvenation. Journal of TASLP, 2022.

2021

Cunxiao Du, Zhaopeng Tu*, and Jing Jiang. Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translation. ICML 2021 (Long Presentation, 3%).
Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, and Zhaopeng Tu. Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation. ACL 2021.
Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Shuming Shi, Michael R. Lyu, and Irwin King. Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation. ACL 2021.
Shuo Wang, Zhaopeng Tu, Zhixing Tan, Shuming Shi, Maosong Sun, Yang Liu. On the Language Coverage Bias for Neural Machine Translation. ACL 2021 (Findings).
Xuebo Liu, Longyue Wang, Derek F. Wong, Liang Ding, Lidia S. Chao, Shuming Shi, and Zhaopeng Tu. On the Copying Behaviors of Pre-Training for Neural Machine Translation. ACL 2021 (Findings).
Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, and Zhaopeng Tu. Progressive Multi-Granularity Training for Non-Autoregressive Translation. ACL 2021 (Findings, Short).
Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, and Zhaopeng Tu. Understanding and Improving Lexical Choice in Non-Autoregressive Translation. ICLR 2021.
Xuebo Liu, Longyue Wang, Derek F. Wong, Liang Ding, Lidia S. Chao, and Zhaopeng Tu. Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning. ICLR 2021.
Jie Hao, Linfeng Song, Liwei Wang, Kun Xu, Zhaopeng Tu, and Dong Yu. RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging. EMNLP 2021.
Xuebo Liu, Longyue Wang, Derek F Wong, Liang Ding, Lidia S Chao, Shuming Shi, and Zhaopeng Tu. On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation. EMNLP 2021 (Findings, Short).
Yongchang Hao, Shilin He, Wenxiang Jiao, Zhaopeng Tu, Michael Lyu, and Xing Wang. Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation. NAACL 2021 (Short).
Jian Li, Xing Wang, Zhaopeng Tu*, and Michael R Lyu. On the Diversity of Multi-Head Attention. Journal of Neurocomputing, 2021.
Baosong Yang, Longyue Wang, Derek F Wong, Shuming Shi, and Zhaopeng Tu*. Context-Aware Self-Attention Networks for Natural Language Processing. Journal of Neurocomputing, 2021.
Xintong Li, Lemao Liu, Zhaopeng Tu, Guanlin Li, Shuming Shi, Max Q-H Meng. Attending From Foresight: A Novel Attention Mechanism for Neural Machine Translation. Journal of TASLP, 2021.

2020

Shuo Wang, Zhaopeng Tu, Shuming Shi, and Yang Liu. On the Inference Calibration of Neural Machine Translation. ACL 2020.
Xinwei Geng, Longyue Wang, Xing Wang, Bing Qin, Ting Liu, and Zhaopeng Tu. How Does Selective Mechanism Improve Self-Attention Networks? ACL 2020.
Wenxiang Jiao, Xing Wang, Shilin He, Irwin King, Michael Lyu, and Zhaopeng Tu. Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation. EMNLP 2020.
Yilin Yang, Longyue Wang, Shuming Shi, Prasad Tadepalli, Stefan Lee, and Zhaopeng Tu. On the Sub-Layer Functionalities of Transformer Decoder. EMNLP 2020 (Findings).
Yong Wang, Longyue Wang, Victor O.K. Li, and Zhaopeng Tu. On the Sparsity of Neural Machine Translation Models. EMNLP 2020 (Short).
Wenxuan Wang and Zhaopeng Tu*. Rethinking the Value of Transformer Components. COLING 2020.
Deyu Zhou, Shuangzhi Wu, Qing Wang, Jun Xie, Zhaopeng Tu, and Mu Li. Emotion Classification by Jointly Learning to Lexiconize and Classify. COLING 2020.
Qintong Li, Hongshen Chen, Zhaochun Ren, Pengjie Ren, Zhaopeng Tu, and Zhumin Chen. EmpDG: Multi-resolution Interactive Empathetic Dialogue Generation. COLING 2020.
Liang Ding, Longyue Wang, Di Wu, Dacheng Tao, and Zhaopeng Tu. Context-Aware Cross-Attention for Non-Autoregressive Translation. COLING 2020 (Short).
Jian Li, Xing Wang, Baosong Yang, Shuming Shi, Michael R. Lyu, and Zhaopeng Tu*. Neuron Interaction Based Representation Composition for Neural Machine Translation. AAAI 2020.
Yong Wang, Longyue Wang, Shuming Shi, Victor O.K. Li, and Zhaopeng Tu. Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks. AAAI 2020.
Tianxiang Zhao, Lemao Liu, Guoping Huang, Zhaopeng Tu, Huayang Li, Yingling Liu, Guiquan Liu, and Shuming Shi. Balancing Quality and Human Involvement: An Effective Approach to Interactive Neural Machine Translation. AAAI 2020.
Yongquan He, Zhihan Wang, Peng Zhang, Zhaopeng Tu, and Zhaochun Ren. VN Network: Embedding Newly Emerging Entities with Virtual Neighbors. CIKM 2020.
Jinhuan Liu, Xuemeng Song, Zhaochun Ren, Liqiang Nie, Zhaopeng Tu, and Jun Ma. Auxiliary Template-Enhanced Generative Compatibility Modeling. IJCAI 2020.
Chuan Meng, Pengjie Ren, Zhumin Chen, Weiwei Sun, Zhaochun Ren, Zhaopeng Tu, and Maarten de Rijke. DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded Conversation. SIGIR 2020.

2019

Baosong Yang, Longyue Wang, Derek F. Wong, Lidia S. Chao, and Zhaopeng Tu*. Assessing the Ability of Self-Attention Networks to Learn Word Order. ACL 2019.
Xing Wang, Zhaopeng Tu, Longyue Wang, and Shuming Shi. Exploiting Sentential Context for Neural Machine Translation. ACL 2019 (Short).
Shilin He, Zhaopeng Tu*, Xing Wang, Longyue Wang, Michael R. Lyu, and Shuming Shi. Towards Understanding Neural Machine Translation with Word Importance. EMNLP 2019.
Longyue Wang, Zhaopeng Tu, Xing Wang, and Shuming Shi. One Model to Learn Both: Zero Pronoun Prediction and Translation. EMNLP 2019.
Jie Hao, Xing Wang, Shuming Shi, Jinfeng Zhang, and Zhaopeng Tu. Multi-Granularity Self-Attention for Neural Machine Translation. EMNLP 2019.
Zaixiang Zheng, Shujian Huang, Zhaopeng Tu, Xinyu Dai, and Jiajun Chen. Dynamic Past and Future for Neural Machine Translation. EMNLP 2019.
Deng Cai, Yan Wang, Wei Bi, Zhaopeng Tu, Xiaojiang Liu, and Shuming Shi. Retrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework. EMNLP 2019.
Xing Wang, Zhaopeng Tu, Longyue Wang, and Shuming Shi. Self-Attention Networks with Structural Position Encoding. EMNLP 2019 (Short).
Jie Hao, Xing Wang, Shuming Shi, Jinfeng Zhang, and Zhaopeng Tu. Towards Better Modeling Hierarchical Structure for Self-Attention with Ordered Neurons. EMNLP 2019 (Short).
Jian Li, Baosong Yang, Zi-Yi Dou, Xing Wang, Michael R. Lyu, and Zhaopeng Tu*. Information Aggregation for Multi-Head Attention with Routing-by-Agreement. NAACL 2019.
Jie Hao, Xing Wang, Baosong Yang, Longyue Wang, Jinfeng Zhang, and Zhaopeng Tu*. Modeling Recurrence for Transformer. NAACL 2019.
Deng Cai, Yan Wang, Wei Bi, Zhaopeng Tu, Xiaojiang Liu, Wai Lam, and Shuming Shi. Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memory. NAACL 2019.
Baosong Yang, Longyue Wang, Derek F. Wong, Lidia S. Chao, and Zhaopeng Tu*. Convolutional Self-Attention Networks. NAACL 2019 (Short).
Xiang Kong, Zhaopeng Tu*, Shuming Shi, Eduard Hovy, and Tong Zhang. Neural Machine Translation with Adequacy-Oriented Learning. AAAI 2019.
Zi-Yi Dou, Zhaopeng Tu*, Xing Wang, Longyue Wang, Shuming Shi, and Tong Zhang. Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreement. AAAI 2019.
Baosong Yang, Jian Li, Derek F. Wong, Lidia S. Chao, Xing Wang, and Zhaopeng Tu*. Context-Aware Self-Attention Networks. AAAI 2019.
Zi-Yi Dou, Xing Wang, Shuming Shi, and Zhaopeng Tu*. Exploiting Deep Representations for Natural Language Processing. Journal of NeuroComputing, 2019.

2018

Yong Cheng, Zhaopeng Tu, Fandong Meng, Junjie Zhai, and Yang Liu. Towards Robust Neural Machine Translation. ACL 2018.
Zi-Yi Dou, Zhaopeng Tu*, Xing Wang, Shuming Shi, and Tong Zhang. Exploiting Deep Representations for Neural Machine Translation. EMNLP 2018.
Baosong Yang, Zhaopeng Tu*, Derek F. Wong, Fandong Meng, Lidia S. Chao, and Tong Zhang. Modeling Localness for Self-Attention Networks. EMNLP 2018.
Jian Li, Zhaopeng Tu*, Baosong Yang, Michael R. Lyu, and Tong Zhang. Multi-Head Attention with Disagreement Regularization. EMNLP 2018 (Short).
Longyue Wang, Zhaopeng Tu*, Andy Way, and Qun Liu. Learning to Jointly Translate and Predict Dropped Pronouns with a Shared Reconstruction Mechanism. EMNLP 2018 (Short).
Fandong Meng, Zhaopeng Tu, Yong Cheng, Haiyang Wu, Junjie Zhai, Yuekui Yang, and Di Wang. Neural Machine Translation with Key-Value Memory-Augmented Attention. IJCAI 2018.
Longyue Wang, Zhaopeng Tu*, Shuming Shi, Tong Zhang, Yvette Graham, and Qun Liu. Translating Pro-Drop Languages with Reconstruction Models. AAAI 2018.
Xintong Li, Lemao Liu, Zhaopeng Tu, Shuming Shi, and Max Meng. Target Foresight Based Attention for Neural Machine Translation. NAACL 2018.
Zhaopeng Tu, Yang Liu, Shuming Shi, and Tong Zhang. Learning to Remember Translation History with a Continuous Cache. Transactions of the Association for Computational Linguistics (TACL), 2018.
Zaixiang Zheng, Hao Zhou, Shujian Huang, Lili Mou, Xinyu Dai, Jiajun Chen, and Zhaopeng Tu. Modeling Past and Future for Neural Machine Translation. Transactions of the Association for Computational Linguistics (TACL), 2018.
Xing Wang, Zhaopeng Tu, and Min Zhang. Incorporating Statistical Machine Translation Word Knowledge into Neural Machine Translation. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), 2018.
Zhaopeng Tu, Yong Jiang, Xiaojiang Liu, Lei Shu, and Shuming Shi. Generative Stock Question Answering. arXiv:1804.07942. [data]

2017

Junhui Li, Deyi Xiong, Zhaopeng Tu, Muhua Zhu, and Guodong Zhou. Modeling Source Syntax for Neural Machine Translation. ACL 2017.
Hao Zhou, Zhaopeng Tu, Shujian Huang, Xiaohua Liu, Hang Li, and Jiajun Chen. Chunk-Based Bi-Scale Decoder for Neural Machine Translation. ACL 2017 (Short).
Xing Wang, Zhaopeng Tu, Deyi Xiong, and Min Zhang. Translating Phrases in Neural Machine Translation. EMNLP 2017.
Longyue Wang, Zhaopeng Tu*, Andy Way, and Qun Liu. Exploiting Cross-Sentence Context for Neural Machine Translation. EMNLP 2017 (Short).
Zhaopeng Tu, Yang Liu, Lifeng Shang, Xiaohua Liu, and Hang Li. Neural Machine Translation with Reconstruction. AAAI 2017. [code]
Xing Wang, Zhengdong Lu, Zhaopeng Tu, Hang Li, Deyi Xiong, and Min Zhang. Neural Machine Translation Advised by Statistical Machine Translation. AAAI 2017.
Zhaopeng Tu, Yang Liu, Zhengdong Lu, Xiaohua Liu, and Hang Li. Context Gates for Neural Machine Translation. Transactions of the Association for Computational Linguistics (TACL), 2017. [code]

2016

Zhaopeng Tu, Zhengdong Lu, Yang Liu, Xiaohua Liu, and Hang Li. Modeling Coverage for Neural Machine Translation. ACL 2016. [code]
Longyue Wang, Zhaopeng Tu, Xiaojun Zhang, Hang Li, Andy Way, and Qun Liu. A Novel Approach for Dropped Pronoun Translation. NAACL 2016.
Longyue Wang, Xiaojun Zhang, Zhaopeng Tu, Hang Li, and Qun Liu. Dropped Pronoun Generation for Dialogue Machine Translation. ICASSP 2016.
Baishakhi Ray, Vincent Hellendoorn, Saheel Godhane, Zhaopeng Tu, Alberto Bacchelli, and Premkumar Devanbu. On the "Naturalness" of Buggy Code. ICSE 2016.
Anh Nguyen, Zhaopeng Tu, and Tien Nguyen. Do Contexts Help in Phrase-based, Statistical Source Code Migration? ICSME 2016.
Longyue Wang, Xiaojun Zhang, Zhaopeng Tu, Andy Way, and Qun Liu. The Automatic Construction of Discourse Corpus for Dialogue Translation. LREC 2016.
Longyue Wang, Zhaopeng Tu, Xiaojun Zhang, Siyou Liu, Hang Li, Andy Way, and Qun Liu. A Novel and Robust Approach for Pro-Drop Language Translation. Journal of Machine Translation, 2016.

2015

Zhaopeng Tu, Baotian Hu, Zhengdong Lu, and Hang Li. Context-Dependent Translation Selection Using Convolutional Neural Network. arXiv 2015. (Short version is accepted by ACL 2015 (Short))
Christine Franks, Zhaopeng Tu, Prem Devanbu, and Vincent Hellendoorn. CACHECA: A Cache Language Model Based Code Suggestion Tool. ICSE 2015 - Demonstration Track. (Demo of the "localness" work)
Fandong Meng, Zhengdong Lu, Zhaopeng Tu, Hang Li, and Qun Liu. A Deep Memory-based Architecture for Sequence-to-Sequence Learning. arXiv 2015.

2014

Zhaopeng Tu, Zhendong Su, and Prem Devanbu. On the Localness of Software. FSE 2014. [code] [data]

2010 ~ 2013

Qun Liu, Zhaopeng Tu, and Shouxun Lin. A Novel Graph-based Compact Representation of Word Alignment. ACL 2013 (Short).
Zhaopeng Tu, Yifan He, Jennifer Foster, Josef van Genabith, Qun Liu, and Shouxun Lin. Identifying High-Impact Sub-Structures for Convolution Kernels in Document-level Sentiment Classification. ACL 2012 (Short).
Junhui Li, Zhaopeng Tu, Guodong Zhou, and Josef van Genabith. Head-Driven Hierarchical Phrase-based Translation. ACL 2012 (Short).
Zhaopeng Tu, Yang Liu, Yifan He, Josef van Genabith, Qun Liu, and Shouxun Lin. Combining Multiple Alignments to Improve Machine Translation. COLING 2012. [data]
Junhui Li, Zhaopeng Tu, Guodong Zhou, and Josef van Genabith. Using Syntactic Head Information in Hierarchical Phrase-based Translation. WMT 2012.
Zhaopeng Tu, Wenbin Jiang, Qun Liu, and Shouxun Lin. Dependency Forest for Sentiment Analysis. NLP&CC 2012.
Zhaopeng Tu, Yang Liu, Qun Liu, and Shouxun Lin. Extracting Hierarchical Rules from a Weighted Alignment Matrix. IJCNLP 2011.
Zhaopeng Tu, Yang Liu, Young-Sook Hwang, Qun Liu, and Shouxun Lin. Dependency Forest for Statistical Machine Translation. COLING 2010.