Together AI is creating innovations on scaling LLMs based on Llama series models

Lilian is blogging since 2017 - starting the fundamentals of Deep Learning. What I see in her blog's is evolution of a set of foundational technologies (RL w/ Human Feedback, Prompt Engineering, Reward Models). Someone has to have maths as their language to read so many diverse papers and then write up such concise summaries

The mission of Papers with Code is to create a free and open resource with Machine Learning papers, code, datasets, methods and evaluation tables

Research on disruptive technologies - Deep Learning, Robotics, BioTech, Genome Sequencing, Crypto tech, Energy Storage

LLM Compute, scaling trend articles

Discover pitch decks from the latest AI startups

Comprehensive site for AI Safety and Alignment research

We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get comfortable with the autoregressive language modeling framework and basics of tensors and PyTorch nn, which we take for granted in this video.

Andrej has provided a very definitive fundamental course on neural networks over 5 sessions along with its code and exercises