top of page
Websites
Lillian's Blog - OpenAI researcher
Lillian Weng
X: @lilianweng
Lilian is blogging since 2017 - starting the fundamentals of Deep Learning. What I see in her blog's is evolution of a set of foundational technologies (RL w/ Human Feedback, Prompt Engineering, Reward Models). Someone has to have maths as their language to read so many diverse papers and then write up such concise summaries
OpenAI
Andrej Karpathy
Tutorial
We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get comfortable with the autoregressive language modeling framework and basics of tensors and PyTorch nn, which we take for granted in this video.
IEEE
Andrej Karpathy
Tutorial
Andrej has provided a very definitive fundamental course on neural networks over 5 sessions along with its code and exercises
Technology Posts
bottom of page