The Twitch streamer Vedal has created an AI called Neuro-Sama and at the end of the subathon they built a language model from scratch while following this tutorial from Andrej Karpathy: To watch Neuro&Vedal live:
Hide player controls
Hide resume playing