A Survey of Large Language Models by Wayne X. Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, Peiyu Liu, Jian-Yun Nie and Ji-Rong Wen.

On the Effectiveness of Parameter-efficient Fine-tuning by Zihao Fu, Haoran Yang, Anthony Man-Cho So, Wai Lam, Lidong Bing and Nigel Collier and Parameter-efficient Fine-tuning of Large-scale Pre-trained Language Models by Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li and Maosong Sun.

A Survey for In-context Learning by Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu and Zhifang Sui and Rethinking the Role of Demonstrations: What Makes In-context Learning Work? by Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi and Luke Zettlemoyer.

Chain of Thought Prompting Elicits Reasoning in Large Language Models by Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed Chi, Quoc Le and Denny Zhou, Multimodal Chain-of-thought Reasoning in Language Models by Zhuosheng Zhang, Aston Zhang, Mu Li, Hai Zhao, George Karypis and Alex Smola, Self-consistency Improves Chain of Thought Reasoning in Language Models by Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery and Denny Zhou, Tree of Thoughts: Deliberate Problem Solving with Large Language Models by Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao and Karthik Narasimhan and Beyond Chain-of-thought, Effective Graph-of-thought Reasoning in Large Language Models by Yao Yao, Zuchao Li and Hai Zhao.

Augmenting Language Models with Long-term Memory by Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao and Furu Wei, MemoryBank: Enhancing Large Language Models with Long-term Memory by Wanjun Zhong, Lianghong Guo, Qiqi Gao and Yanlin Wang and Unleashing Infinite-length Input Capacity for Large-scale Language Models with Self-controlled Memory System by Xinnian Liang, Bing Wang, Hui Huang, Shuangzhi Wu, Peihao Wu, Lu Lu, Zejun Ma and Zhoujun Li.

Enabling Large Language Models to Generate Text with Citations by Tianyu Gao, Howard Yen, Jiatong Yu and Danqi Chen.

Let's Verify Step by Step by Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever and Karl Cobbe, Certified Reasoning with Language Models by Gabriel Poesia, Kanishk Gandhi, Eric Zelikman and Noah D. Goodman and Deductive Verification of Chain-of-thought Reasoning by Zhan Ling, Yunhao Fang, Xuanlin Li, Zhiao Huang, Mingu Lee, Roland Memisevic and Hao Su.

Emergent Abilities of Large Language Models by Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean and William Fedus.

Toolformer: Language Models Can Teach Themselves to Use Tools by Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda and Thomas Scialom and WebGPT: Browser-assisted Question-answering with Human Feedback by Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess and John Schulman.

Language Models Can Explain Neurons in Language Models by Steven Bills, Nick Cammarata, Dan Mossing, Henk Tillman, Leo Gao, Gabriel Goh, Ilya Sutskever, Jan Leike, Jeff Wu and William Saunders.

Alignment of Language Agents by Zachary Kenton, Tom Everitt, Laura Weidinger, Iason Gabriel, Vladimir Mikulik and Geoffrey Irving, A General Language Assistant as a Laboratory for Alignment by Amanda Askell, Yuntao Bai, Anna Chen, Dawn Drain, Deep Ganguli, Tom Henighan, Andy Jones, Nicholas Joseph, Ben Mann, Nova DasSarma, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Jackson Kernion, Kamal Ndousse, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah and Jared Kaplan, Training Language Models to Follow Instructions with Human Feedback by Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike and Ryan Lowe, Aligning Generative Language Models with Human Values by Ruibo Liu, Ge Zhang, Xinyu Feng and Soroush Vosoughi and In Conversation with Artificial Intelligence: Aligning Language Models with Human Values by Atoosa Kasirzadeh and Iason Gabriel.

The Measure of All Minds: Evaluating Natural and Artificial Intelligence by José Hernández-Orallo, A Survey of Evaluation Metrics Used for NLG Systems by Ananya B. Sai, Akash K. Mohankumar and Mitesh M. Khapra and Automatic Evaluation of Attribution by Large Language Models by Xiang Yue, Boshi Wang, Kai Zhang, Ziru Chen, Yu Su and Huan Sun.