Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Chapter 4: Implementing a GPT Model from Scratch To Generate Text#

Main Chapter Code#

  • ch04.ipynb contains all the code as it appears in the chapter

  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code#

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter

Contents