Adaptive Input Representations for Neural Language Modeling.
Alexei Baevski, Michael Auli: Adaptive Input Representations for Neural Language Modeling. CoRR abs/1809.10853 (2018)
View ArticleEffectiveness of self-supervised pre-training for speech recognition.
Alexei Baevski, Michael Auli, Abdelrahman Mohamed: Effectiveness of self-supervised pre-training for speech recognition. CoRR abs/1911.03912 (2019)
View Articlevq-wav2vec: Self-Supervised Learning of Discrete Speech Representations.
Alexei Baevski, Steffen Schneider, Michael Auli: vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations. CoRR abs/1910.05453 (2019)
View ArticleFacebook FAIR's WMT19 News Translation Task Submission.
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov: Facebook FAIR's WMT19 News Translation Task Submission. CoRR abs/1907.06616 (2019)
View Articlewav2vec: Unsupervised Pre-training for Speech Recognition.
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli: wav2vec: Unsupervised Pre-training for Speech Recognition. CoRR abs/1904.05862 (2019)
View Articlefairseq: A Fast, Extensible Toolkit for Sequence Modeling.
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli: fairseq: A Fast, Extensible Toolkit for Sequence Modeling. CoRR abs/1904.01038 (2019)
View ArticlePre-trained Language Model Representations for Language Generation.
Sergey Edunov, Alexei Baevski, Michael Auli: Pre-trained Language Model Representations for Language Generation. CoRR abs/1903.09722 (2019)
View ArticleCloze-driven Pretraining of Self-attention Networks.
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli: Cloze-driven Pretraining of Self-attention Networks. CoRR abs/1903.07785 (2019)
View ArticlePay Less Attention with Lightweight and Dynamic Convolutions.
Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli: Pay Less Attention with Lightweight and Dynamic Convolutions. CoRR abs/1901.10430 (2019)
View ArticleFacebook FAIR's WMT19 News Translation Task Submission.
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov: Facebook FAIR's WMT19 News Translation Task Submission. WMT (2) 2019: 314-319
View ArticlePre-trained language model representations for language generation.
Sergey Edunov, Alexei Baevski, Michael Auli: Pre-trained language model representations for language generation. NAACL-HLT (1) 2019: 4052-4059
View Articlefairseq: A Fast, Extensible Toolkit for Sequence Modeling.
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli: fairseq: A Fast, Extensible Toolkit for Sequence Modeling. NAACL-HLT (Demonstrations) 2019: 48-53
View Articlewav2vec: Unsupervised Pre-Training for Speech Recognition.
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli: wav2vec: Unsupervised Pre-Training for Speech Recognition. INTERSPEECH 2019: 3465-3469
View ArticlePay Less Attention with Lightweight and Dynamic Convolutions.
Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli: Pay Less Attention with Lightweight and Dynamic Convolutions. ICLR 2019
View ArticleAdaptive Input Representations for Neural Language Modeling.
Alexei Baevski, Michael Auli: Adaptive Input Representations for Neural Language Modeling. ICLR (Poster) 2019
View ArticleCloze-driven Pretraining of Self-attention Networks.
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli: Cloze-driven Pretraining of Self-attention Networks. EMNLP/IJCNLP (1) 2019: 5359-5368
View ArticleReservoir Transformer.
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela: Reservoir Transformer. CoRR abs/2012.15045 (2020)
View ArticleThe Zero Resource Speech Benchmark 2021: Metrics and baselines for...
Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux: The Zero Resource Speech Benchmark 2021: Metrics and baselines for...
View ArticleA Comparison of Discrete Latent Variable Models for Speech Representation...
Henry Zhou, Alexei Baevski, Michael Auli: A Comparison of Discrete Latent Variable Models for Speech Representation Learning. CoRR abs/2010.14230 (2020)
View ArticleSelf-training and Pre-training are Complementary for Speech Recognition.
Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli: Self-training and Pre-training are Complementary for Speech...
View Article