5,520,481 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

AudioPaLM: A Large Language Model That Can Speak and Listen

Research paper by Paul K. Rubenstein and collaborators. Published 2023-06-22. Topics: AudioPaLM, PaLM-2, AudioLM, multimodal architecture, paralinguistic information.

Resource information

Authors
Paul K. Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, Ankur Bapna, Zalán Borsos, Félix de Chaumont Quitry, Peter Chen, Dalia El Badawy, Wei Han, Hannah Muckenhirn, Dirk Padfield, James Qin, Danny Rozenberg, Tara Sainath, Johan Schalkwyk, Matt Sharifi, Michelle Tadmor Ramanovich, Marco Tagliasacchi, Alexandru Tudor, Mihajlo Velimirović, Damien Vincent, Jiahui Yu, Yongqiang Wang, Vicky Zayats, Neil Zeghidour, Yu Zhang, Zhishuai Zhang, Lukas Zilka, Christian Frank
Research topics
AudioPaLM, PaLM-2, AudioLM, multimodal architecture, paralinguistic information, speaker identity, intonation, speech recognition, speech-to-speech translation, zero-shot speech-to-text translation, audio language models, voice transfer
Publication date
2023-06-22
Publication
arXiv
Last record update
Nov 3, 2026