Phoster

Research and Development

Dialogue Systems and Information Retrieval

Dialogue Systems

LaMDA: Language Models for Dialog Applications by Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi and Quoc Le and PaLM: Scaling Language Modeling with Pathways by Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov and Noah Fiedel.

Information Retrieval

Extending Neural Generative Conversational Model Using External Knowledge Sources by Prasanna Parthasarathi and Joelle Pineau, Wizard of Wikipedia: Knowledge-powered Conversational Agents by Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli and Jason Weston, Reading Wikipedia to Answer Open-domain Questions by Danqi Chen, Adam Fisch, Jason Weston and Antoine Bordes, Latent Retrieval for Weakly Supervised Open Domain Question Answering by Kenton Lee, Ming-Wei Chang and Kristina Toutanova, Internet-augmented Dialogue Generation by Mojtaba Komeili, Kurt Shuster and Jason Weston and Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion by Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller, Arthur Szlam and Jason Weston.

Reasoning

Reason First, then Respond: Modular Generation for Knowledge-infused Dialogue by Leonard Adolphs, Kurt Shuster, Jack Urbanek, Arthur Szlam and Jason Weston and Chain of Thought Prompting Elicits Reasoning in Large Language Models by Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed Chi, Quoc Le and Denny Zhou.

Citing Sources

Teaching Language Models to Support Answers with Verified Quotes by Jacob Menick, Maja Trebacz, Vladimir Mikulik, John Aslanides, Francis Song, Martin Chadwick, Mia Glaese, Susannah Young, Lucy Campbell-Gillingam, Geoffrey Irving and Nat McAleese, In-context Retrieval-augmented Language Models by Ori Ram, Yoav Levine, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown and Yoav Shoham, Improving Wikipedia Verifiability with AI by Fabio Petroni, Samuel Broscheit, Aleksandra Piktus, Patrick Lewis, Gautier Izacard, Lucas Hosseini, Jane Dwivedi-Yu, Maria Lomeli, Timo Schick, Pierre-Emmanuel Mazaré, Armand Joulin, Edouard Grave and Sebastian Riedel, Citation Text Generation by Kelvin Luu, Rik Koncel-Kedziorski, Kyle Lo, Isabel Cachola and Noah A. Smith, Towards Generating Citation Sentences for Multiple References with Intent Control by Jia-Yan Wu, Alexander Te-Wei Shieh, Shih-Ju Hsu and Yun-Nung Chen and Intent-controllable Citation Text Generation by Shing-Yun Jung, Ting-Han Lin, Chia-Hung Liao, Shyan-Ming Yuan and Chuen-Tsai Sun.

Information Storage

Recent Advances in Neural Text Generation: A Task-agnostic Survey by Chen Tang, Frank Guerin, Yucheng Li and Chenghua Lin and Using Natural Language Generation to Bootstrap Missing Wikipedia Articles: A Human-centric Perspective by Lucie-Aimée Kaffee, Pavlos Vougiouklis and Elena Simperl.