Chapter 5From early models to today
Assistants for everyone
Trained to follow instructions and chat.
Notes (10)
- 1Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou, “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models,” in Advances in Neural Information Processing Systems 35 (2022), 24824–24837, https://doi.org/10.52202/068431-1800.
- 2Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, et al., “Training language models to follow instructions with human feedback,” in Advances in Neural Information Processing Systems 35 (2022), 27730–27744, https://doi.org/10.52202/068431-2011.
- 3Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao, “ReAct: Synergizing Reasoning and Acting in Language Models” (preprint, arXiv, October 6, 2022), https://doi.org/10.48550/arXiv.2210.03629.
- 4OpenAI, “ChatGPT: Optimizing language models for dialogue (now 'Introducing ChatGPT'),” November 30, 2022, https://openai.com/index/chatgpt/ (accessed October 26, 2026).
- 5Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, et al., “Constitutional AI: Harmlessness from AI Feedback” (preprint, arXiv, December 15, 2022), https://doi.org/10.48550/arXiv.2212.08073.
- 6OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, et al., “GPT-4 Technical Report” (preprint, arXiv, March 15, 2023), https://doi.org/10.48550/arXiv.2303.08774.
- 7Anthropic, “Introducing Claude,” March 14, 2023, https://www.anthropic.com/news/introducing-claude (accessed October 26, 2026).
- 8S. Pichai and D. Hassabis, “Introducing Gemini: our largest and most capable AI model,” Google, December 6, 2023, https://blog.google/technology/ai/google-gemini-ai/ (accessed October 26, 2026).
- 9Anthropic, “Introducing the next generation of Claude,” March 4, 2024, https://anthropic.com/news/claude-3-family (accessed October 26, 2026).
- 10OpenAI, “Hello GPT-4o,” May 13, 2024, https://openai.com/index/hello-gpt-4o/ (accessed October 26, 2026).
Chapter 5 · page 2 of 3
Turn pages with the ← and → keys.