Publications

*: indicating equal contribution or alphabetic ordering.

2021

• Ph.D. Thesis: Cross-view Learning with Limited Supervision
  Yao-Hung Hubert Tsai.
  Committee members: Ruslan Salakhutdinov, Louis-Philippe Morency, Barnabas Poczos, Jimmy Ba.
  

• HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
  Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed.
  [Code]

• Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations
  Yao-Hung Hubert Tsai*, Martin Q. Ma*, Han Zhao, Kun Zhang, Louis-Philippe Morency, Ruslan Salakhutdinov.
  [Code coming soon]

• Integrating Auxiliary Information in Self-supervised Learning
  Yao-Hung Hubert Tsai*, Tianqin Li*, Weixin Liu, Peiyuan Liao, Ruslan Salakhutdinov, Louis-Philippe Morency.
  [Code coming soon]

• A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning
  Yao-Hung Hubert Tsai, Shaojie Bai, Louis-Philippe Morency, Ruslan Salakhutdinov.
  [Code]

• LSMI-Sinkhorn: Semi-supervised Squared-Loss Mutual Information Estimation with Optimal Transport
  Yanbin Liu*, Makoto Yamada*, Yao-Hung Hubert Tsai, Tam Le, Ruslan Salakhutdinov, Yi Yang.
  European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD) 2021.
  

• Self-supervised Representation Learning with Relative Predictive Coding
  Yao-Hung Hubert Tsai*, Martin Q. Ma*, Muqiao Yang, Han Zhao, Louis-Philippe Morency, Ruslan Salakhutdinov.
  International Conference on Learning Representations (ICLR) 2021.
  [Code coming soon]

• Self-supervised Learning from a Multi-view Perspective
  Yao-Hung Hubert Tsai, Yue Wu, Ruslan Salakhutdinov, Louis-Philippe Morency.
  International Conference on Learning Representations (ICLR) 2021.
  [Code (not yet organized)]

• HUBERT: How much can a bad teacher benefit ASR pre-training?
  Wei-Ning Hsu, Yao-Hung Hubert Tsai, Benjamin Bolte, Ruslan Salakhutdinov, Abdelrahman Mohamed.
  International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021.
  [Talk (by Wei-Ning)]

2020

• Unsupervised Domain Adaptation for Visual Navigation
  Shangda Li*, Devendra Singh Chaplot*, Yao-Hung Hubert Tsai, Yue Wu, Louis-Philippe Morency, Ruslan Salakhutdinov.
  Neural Information Processing Systems Deep Reinforcement Learning Workshop (NeurIPS DRL) 2020.
  

• Neural Methods for Point-wise Dependency Estimation
  Yao-Hung Hubert Tsai, Han Zhao, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov.
  Neural Information Processing Systems (NeurIPS) 2020 (Spotlight).
  [Code]

• Feature Robust Optimal Transport for High-dimensional Data
  Mathis Petrovich*, Chao Liang*, Yanbin Liu, Yao-Hung Hubert Tsai, Linchao Zhu, Yi Yang, Ruslan Salakhutdinov, Makoto Yamada.
  

• Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis
  Yao-Hung Hubert Tsai*, Martin Q. Ma*, Muqiao Yang*, Ruslan Salakhutdinov, Louis-Philippe Morency.
  Empirical Methods in Natural Language Processing (EMNLP) 2020.
  [Code]

• Complex Transformer: A Framework for Modeling Complex-Valued Sequence
  Muqiao Yang*, Martin Q. Ma*, Dongyu Li*, Yao-Hung Hubert Tsai, Ruslan Salakhutdinov.
  NeurIPS Science meets Engineering of Deep Learning Workshop (NeurIPS SEDL) 2019 (Oral).
  International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020.
  [Code]

• Capsules with Inverted Dot-Product Attention Routing
  Yao-Hung Hubert Tsai, Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov.
  International Conference on Learning Representations (ICLR) 2020.
  [Code (my maintained version)] [Code (Apple's version)] [ICLR Presentation]

2019

• Learning Neural Networks with Adaptive Regularization
  Han Zhao*, Yao-Hung Hubert Tsai*, Ruslan Salakhutdinov, Geoff Gordon.
  Neural Information Processing Systems (NeurIPS) 2019.
  [Code] [Talk] [Poster] [Slides]

• Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel
  Yao-Hung Hubert Tsai, Shaojie Bai, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov.
  Empirical Methods in Natural Language Processing (EMNLP) 2019.
  [Summary] [Slides]

• Multimodal Transformer for Unaligned Multimodal Language Sequences
  Yao-Hung Hubert Tsai*, Shaojie Bai*, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, Ruslan Salakhutdinov.
  Association for Computational Linguistics (ACL) 2019.
  [Code]

• Learning Representations from Imperfect Multimodal Time Series Data via Tensor Rank Regularization
  Paul Pu Liang*, Zhun Liu*, Yao-Hung Hubert Tsai, Qibin Zhao, Ruslan Salakhutdinov, Louis-Philippe Morency.
  Association for Computational Linguistics (ACL) 2019.

• Video Relationship Reasoning using Gated Spatio-Temporal Energy Graph
  Yao-Hung Hubert Tsai, Santosh Kumar Divvala, Louis-Philippe Morency, Ruslan Salakhutdinov, Ali Farhadi.
  Computer Vision and Pattern Recognition (CVPR) 2019.
  [Code]

• Strong and Simple Baselines for Multimodal Utterance Embeddings
  Paul Pu Liang*, Yao Chong Lim*, Yao-Hung Hubert Tsai, Ruslan Salakhutdinov, Louis-Philippe Morency.
  North American Chapter of the Association for Computational Linguistics (NAACL) 2019 (Oral).

• Learning Factorized Multimodal Representations
  Yao-Hung Hubert Tsai*, Paul Pu Liang*, Amir Zadeh, Louis-Philippe Morency, Ruslan Salakhutdinov.
  International Conference on Learning Representations (ICLR) 2019.

• Post Selection Inference with Incomplete Maximum Mean Discrepancy Estimator
  Makoto Yamada*, Denny Wu*, Yao-Hung Hubert Tsai, Hirofumi Ohta, Ruslan Salakhutdinov, Ichiro Takeuchi, Kenji Fukumizu.
  International Conference on Learning Representations (ICLR) 2019.

• Transfer Neural Trees: Semi-Supervised Heterogeneous Domain Adaptation and Beyond
  Wei-Yu Chen, Tzu-Ming Harry Hsu, Yao-Hung Hubert Tsai, Yu-Chiang Frank Wang, Ming-Syan Chen.
  Transactions on Image Processing (TIP) 2019.

2018

• Semi-Supervised Pairing via Basis-Sharing Wasserstein Matching Auto-Encoder
  Ziyin Liu, Yao-Hung Hubert Tsai*, Makoto Yamada, Ruslan Salakhutdinov.
  NeurIPS Bayesian Deep Learning Workshop (NeruIPS BDL) 2018.

• Selecting the Best in GANs Family: a Post Selection Inference Framework
  Yao-Hung Hubert Tsai*, Denny Wu*, Makoto Yamada*, Ruslan Salakhutdinov, Ichiro Takeuchi, Kenji Fukumizu.
  International Conference on Representation Learning Workshop (ICLR Workshop) 2018.

• Dependency Bottleneck in Auto-encoding Architectures: an Empirical Study
  Denny Wu*, Yixiu Zhao*, Yao-Hung Hubert Tsai*, Makoto Yamada, Ruslan Salakhutdinov.

2017

• Learning Robust Visual-Semantic Embeddings
  Yao-Hung Hubert Tsai, Liang-Kang Huang, Ruslan Salakhutdinov.
  International Conference on Computer Vision (ICCV) 2017.

• Improving One-Shot Learning through Fusing Side Information
  Yao-Hung Hubert Tsai, Ruslan Salakhutdinov.
  NeurIPS Learning with Limited Labeled Data: Weak Supervision and Beyond (NeurIPS LLD) 2017.
  Bay Area Machine Learning Symposium (BayLearn) 2017 (Best Poster).

• Learning Markov Chain in Unordered Dataset
  Yao-Hung Hubert Tsai, Han Zhao, Ruslan Salakhutdinov, Nebojsa Jojic.
  NeurIPS Time Series Workshop (NeurIPS TSW) 2017 (Oral).

2016

• Learning Cross-Domain Landmarks for Heterogeneous Domain Adaptation
  Yao-Hung Hubert Tsai, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  Computer Vision and Pattern Recognition (CVPR) 2016.
  [Supplementary] [Poster] [Code]

• Unsupervised Domain Adaptation With Label and Structural Consistency
  Cheng-An Hou, Yao-Hung Hubert Tsai, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  Transactions on Image Processing (TIP) 2016.

• Domain-Constraint Transfer Coding for Imbalanced Unsupervised Domain Adaptation
  Yao-Hung Hubert Tsai, Cheng-An Hou, Wei-Yu Chen, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  Association for the Advancement of Artificial Intelligence (AAAI) 2016.

• Transfer Neural Trees for Heterogeneous Domain Adaptation
  Wei-Yu Chen, Tzu-Ming Harry Hsu, Yao-Hung Hubert Tsai, Yu-Chiang Frank Wang, Ming-Syan Chen.
  European Conference on Computer Vision (ECCV) 2016.

• Heterogeneous Domain Adaptation with Label and Structure Consistency
  Yao-Hung Hubert Tsai, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2016.

• Recognizing Heterogeneous Cross-Domain Data via Generalized Joint Distribution Adaptation
  Yuan-Ting Hsieh*, Shi-Yen Tao*, Yao-Hung Hubert Tsai, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  International Conference on Multimedia and Expo (ICME) 2016 (Oral).
  [Slides]

2015

• Unsupervised Domain Adaptation with Imbalanced Cross-Domain Data
  Tzu-Ming Harry Hsu, Wei-Yu Chen, Cheng-An Hou, Yao-Hung Hubert Tsai, Yi-Ren Yeh, Yu-Chiang Frank Wang.
  International Conference on Computer Vision (ICCV) 2015.

2014

• Person-Specific Domain Adaptation with Applications to Heterogeneous Face Recognition
  Yao-Hung Tsai*, Hung-Ming Hsu*, Cheng-An Hou, Yu-Chiang Frank Wang.
  International Conference on Image Processing (ICIP) 2014.

• Stable Pose Tracking from a Planar Target with an Analytical Motion Model in Real-Time Applications
  Po-Chen Wu, Yao-Hung Tsai, Shao-Yi Chien.
  International Workshop on Multimedia Signal Processing (MMSP) 2014.