Build LLM from Scratch | Mega Playlist of 43 videos
Posted by OtherRaisin3426@reddit | LocalLLaMA | View on Reddit | 10 comments
Just like with machine learning, you will be a serious LLM engineer only if you truly understand how the nuts and bolts of a Large Language Model (LLM) work.
Very few people understand how an LLM exactly works. Even fewer can build an entire LLM from scratch.
Wouldn't it be great for you to build your own LLM from scratch?
Here is an awesome, playlist series on Youtube: Build your own LLM from scratch.
Playlist link: https://www.youtube.com/playlist?list=PLPTV0NXA_ZSgsLAr8YCgCwhPIJNNtexWu
It has become very popular on Youtube.
Everything is written on a whiteboard. From scratch.
43 lectures are released.
This lecture series is inspired from Sebastian Raschka's book "Build LLMs from scratch"
Hope you learn a lot :)
P.S: Attached GIF shows a small snippet of the notes accompanying this playlist
cesarean722@reddit
How does it compare with paid courses? I am planning to take some courses to learn more about what I am doing with my pc, but I don't have much free time...
Historical-Camera972@reddit
I paid for the Google course. Haven't learned anything, haven't done it. It opens up with boring corporate stuff, so my brain shuts off.
bornfree4ever@reddit
what google course?
Historical-Camera972@reddit
The one that's offered by Google official, but through Coursera. I'd love to complete it, seriously, but the first couple hours of content have been brain rot.
bornfree4ever@reddit
im sorry I have been out of the loop on it. has you a link or name to google?
-dysangel-@reddit
Even if you can code one from scratch (which is not that hard given the open source resources available), there's a whole lot more to understanding how they work. Anthropic are doing the best work on that so far https://www.anthropic.com/research/mapping-mind-language-model
GhostArchitect01@reddit
.... anyone tried making a notebook in NotebookLM with 43 YouTube sources?
I guess I'm about to
bornfree4ever@reddit
can you share it?
Elses_pels@reddit
Thanks!
DarkVoid42@reddit
nice. llm training needs hardware though.