Publications

You can also find my publications on Google Scholar.

Year 2023

• CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation
  Zineng Tang, Ziyi Yang*, Mahmoud Khademi, Yang Liu, Chenguang Zhu, Mohit Bansal*
  (*: Corresponding authors)
  Project Page

• Any-to-Any Generation via Composable Diffusion
  Zineng Tang, Ziyi Yang*, Chenguang Zhu, Michael Zeng, Mohit Bansal*
  Thirty-seventh Conference on Neural Information Processing Systems, (NeurIPS), New Orleans, USA, 2023.
  (*: Corresponding authors)
  Project Page

• i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  Project Page

• i-Code Studio: A Configurable and Composable Framework for Integrative AI
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  Project Page

• Adaptive Pre-training of Language Models for Better Logical Reasoning
  Soumya Sanyal, Yichong Xu, Shuohang Wang, Ziyi Yang, Reid Pryzant, Wenhao Yu, Chenguang Zhu, Xiang Ren
  The 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, Canada, 2023.
  

• UniSumm: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning
  Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang
  The 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, Canada, 2023.
  

• Global Contrastive Batch Sampling via Optimization on Sample Permutations
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  The Fortieth International Conference on Machine Learning (ICML), Hawaii, USA, 2023.
  

• Unifying Vision, Text, and Layout for Universal Document Processing
  Zineng Tang, Ziyi Yang*, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal*
  Highlight, Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, Canada, 2023.
  (*: Corresponding authors)
  Code & Model

• Anomaly Detection with Domain Adaptation
  Ziyi Yang, Iman Soltani Bozchalooi, Eric Darve
  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Vancouver, Canada, 2023.
  

• MACSum: Controllable Summarization with Mixed Attributes
  Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
  Transactions of the Association for Computational Linguistics (TACL), 2023.

• Real-Time Audio-Visual End-To-End Speech Enhancement
  Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Eskimez, Huaming Wang
  2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  (Fun Fact: Zirun and I were deskmate in high school.)

• i-Code: An Integrative and Composable Multimodal Learning Framework
  Ziyi Yang*, Yuwei Fang*, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  (*: Co-first authors)
  The 37th AAAI Conference on Artificial Intelligence (AAAI), Washington DC, USA, 2023

Year 2022

• Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
  Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang and Yizhou Sun
  Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022
  Best Paper Award at SoCalNLP 2022 Symposium

• Automatic Rule Induction for Efficient Semi-Supervised Learning
  Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022

• Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
  Conference on Neural Information Processing Systems (NeurIPS), New Orleans, Louisiana, USA, 2022

Year 2021

• Memory Augmented Generative Adversarial Networks for Anomaly Detection
  Ziyi Yang, Teng Zhang, Iman Soltani Bozchalooi, Eric Darve
  IEEE Transactions on Neural Networks and Learning Systems (Impact Factor: 8.793)

• A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations
  Ziyi Yang, Yinfei Yang, Daniel Cer, Eric Darve
  Empirical Methods in Natural Language Processing (EMNLP), 2021

• Universal Sentence Representation Learning with Conditional Masked Language Model
  Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
  Empirical Methods in Natural Language Processing (EMNLP), 2021

• Make Lead Bias in Your Favor: Zero-shot Abstractive News Summarization
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  International ACM SIGIR Conference (SIGIR) 2021.
  Demo

• Filtered Inner Product Projection for Multilingual Embedding Alignment
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  International Conference on Learning Representations (ICLR), 2021

Year 2020

• Multi-Constitutive Neural Network for Large Deformation Poromechanics Problem
  Qi Zhang*, Yilin Chen*, Ziyi Yang*, Eric Darve
  (*: Equal contribution)
  Neural Information Processing Systems, Machine Learning and the Physical Sciences (ML4PS), 2020

• TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
  Ziyi Yang*, Chenguang Zhu*, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
  (*: Equal contribution)
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Online, 2020
  Demo

• Regularized Cycle Consistent Generative Adversarial Network for Anomaly Detection
  Ziyi Yang, Iman Soltani Bozchalooi, Eric Darve
  European Conference on Artificial Intelligence (ECAI), Santiago de Compostela, Spain, 2020
  Oral Presentation

Year 2019

• Parameter-free Sentence Embedding via Orthogonal Basis
  Ziyi Yang, Chenguang Zhu, Weizhu Chen
  Oral Presentation, 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019
  Code

• Embedding Imputation with Grounded Language Information
  Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
  Association for Computational Linguistics (ACL), Florence, Italy, 2019
  Code

Year 2016

• Probing Carrier Transport and Structure-property Relationship of Highly Ordered Organic Semiconductors at Two-dimensional Limit
  Yuhan Zhang, Jingsi Qiao, Si Gao, Fengrui Hu, Daowei He, Bing Wu, Ziyi Yang, Bingchen Xu, Yun Li, Yi Shi, Wei Ji, Peng Wang, Xiaoyong Wang, Min Xiao, Hangxun Xu, Jian-Bin Xu, Xinran Wang
  Physical Review Letters, 116, 016602

• Precise, Self-Limited Epitaxy of Ultrathin Organic Semiconductors and Heterojunctions Tailored by van der Waals Interactions
  Bing Wu, Yinghe Zhao, Haiyan Nan, Ziyi Yang, Yuhan Zhang, Huijuan Zhao, Daowei He, Zonglin Jiang Xiaolong Liu, Yun Li, Yi Shi, Zhenhua Ni, Jinlan Wang, Jian-bin Xu, and Xinran Wang
  Nano Letters 16, 3754 (2016)

• Epitaxial Ultrathin Organic Crystals on Graphene for High‐Efficiency Phototransistors
  Xiaolong Liu, Xiaoguang Luo, Haiyan Nan, Hui Guo, Peng Wang, Linglong Zhang, Minmin Zhou, Ziyi Yang, Yi Shi, Weida Hu, Zhenhua Ni, Teng Qiu, Zongfu Yu, Jian-Bin Xu and Xinran Wang
  Advanced Materials 28, 5200 (2016)

• A van der Waals pn heterojunction with organic/inorganic semiconductors
  Daowei He, Yiming Pan, Haiyan Nan, Shuai Gu, Ziyi Yang, Bing Wu, Xiaoguang Luo, Bingchen Xu, Yuhan Zhang, Yun Li, Zhenhua Ni, Baigeng Wang, Jia Zhu, Yang Chai, Yi Shi and Xinran Wang
  Applied Physics Letters, 107, 183103