Build LLMs From Scratch - AiA

Join our event-series to learn how to build Large Language Models (LLMs) from scratch.

​This is our FIRST meeting.

​***

​Have you used LLMs but remain curious/dubious about how they work?

​You want to learn about LLMs but find it overwhelming?

​You see the potentials of LLMs but don't know where to start?

Join us to build your LLM from scratch! Learn by doing together with a supportive community.

​Full details: check out this page

https://dan-tran.notion.site/How-to-build-LLMs-from-scratch-AIA-10ad49a1a8f68091a03eebe942202b7b

​***

## ​What

​This is a hands-on learning bootcamp focusing on Large Language Models (LLMs), spanning several months. You will learn to design, pretrain, and fine-tune your own GPT-like model.

## ​Who

​The program is suitable for people with a quantitative background. Working knowledge of Python, Pytorch, and Machine Learning is a plus but not mandatory.

​Two main prerequisites are:

​- be comfortable with computers & maths (bachelor level)

​- willing to commit ~40h/month to focused learning

## ​How

​- Study: read/watch materials, run the code, and solve the exercises

​- Research: read papers, explore and experiment, try to break things

​- Group meeting: monthly meetings, summarize key insights, Q&A

​- Discord: discuss about anything, share resources, ask questions

## ​Wanna join?

​IMPORTANT:

​- Check out [program repo on Github] https://github.com/AiAnonymousPT/COURSE-LLMs-from-Scratch

​- Complete the [Meeting-0 materials] https://github.com/AiAnonymousPT/COURSE-LLMs-from-Scratch/blob/main/Meeting-0/README.md

​- Please fill [Google Form] to join WhatsApp & Discord group https://forms.gle/C7QZ3LyVt6iQEtJa9

​- Logistics: meetings are in-person, location & time will be updated in Discord & Meetup

​See you there! Dan, Mark & Hal