https://twitter.com/JackSoslow/status/1608876978232520704

https://docs.google.com/document/d/1bEQM1W-1fzSVWNbS4ne5PopB2b7j8zD4Jc3nm4rbK-U/edit

AI Reading List

Music Playlist

This is aimed towards the AI curious looking to go down the rabbit hole not the AI expert. It will be updated ~monthly. Recommendations are accepted via DM @JackSoslow

Blogs / Threads / Papers

S Tier (“Best of the Best”)

Tim Urban (2015) — The AI Revolution: The Road to Superintelligence

Andrej Karpathy (2017) — Software 2.0

Gwern (2020) — The Scaling Hypothesis

Wikipedia — The History of Artificial Intelligence

Google Research, Vaswani et al. (2017) — Attention Is All You Need

A Tier

Eliezer Yudkowsky (2001) — Creating Friendly AI Summary

Tim Urban (2015) — The AI Revolution: Our Immortality or Extinction

Deepmind (2017) — AlphaGo

Eliezer Yudkowsky (2017) — There’s no Fire Alarm for Artificial Intelligence

Jay Alammar (2018) — The Illustrated Transformer

OpenAI (2020) — Language Models are Few Shot Learners (GPT-3)

Deepmind (2020) — MuZero: Mastering Go, Chess, Shogi, and Atari without rules

OpenAI (2020) — AI and Efficiency

OpenAI (2021) — CLIP: Connecting Text and Images

Nostalgebraist (2022) — Chinchilla’s Wild Implications

Gwern (2022) —  It looks like you’re trying to take over the world

Best of the Rest

Scott Alexander (2016) — Superintelligence FAQ

OpenAI (2017) — Learning to Communicate

OpenAI (2017) — Evolution Strategies as an Alternative to Reinforcement Learning

OpenAI (2017) — Learning to Cooperate, Compete, and Communicate

OpenAI (2017) — Proximal Policy Optimization

OpenAI (2017) — Competitive Self-Play

OpenAI (2018) — AI and Compute

Deepmind (2019) — Capture the Flag: the emergence of complex cooperative agents

OpenAI (2019) — OpenAI Five defeats Dota 2 World Champions

OpenAI (2019) — Deep Double Descent

Jay Alammar (2020) — How GPT-3 Works: Visualizations and Animations

Evhub (2020) — 11 Proposals of for Building Safe Advanced AI

Deepmind (2022) — Discovering novel algorithms with AlphaTensor

Deepmind (2020) — Using JAX to accelerate our research’

Deepmind (2020) — AlphaFold: a solution to a 50-year-old grand challenge in biology

Leigh Marie Braswell (2021) — Startup Opportunities in Machine Learning Infrastructure

Meta AI (2021) — Teaching AI how to forget at scale

OpenAI (2021) — DALL-E: Creating Images from Text

OpenAI (2021) — Multimodal Neurons in Artificial Neural Networks

OpenAI (2021) — Improving Language Model Behavior by Training on a Curated Dataset

OpenAI (2021) — OpenAI Codex

OpenAI (2022) — Aligning Language Models to Follow Instructions

OpenAI (2022) — DALL-E 2

OpenAI (2022) — Learning to Play Minecraft with Video PreTraining

OpenAI (2022) — Introducing Whisper

OpenAI (2022) — ChatGPT: Optimizing Language Models for Dialog

Nature (2022) — What’s next for AlphaFold

Meta AI (2022) — CICERO: AN AI agent that negotiates, persuades, and cooperates with people

Yann Lecun (2022) — How to make AI systems learn and reason like animals and humans

Robert May (2022) — The Mental Model Most AI Investors Are Missing

Roon (2022) — Text is the Universal Interface

Jack Soslow (2022) — 2022 AI Research and Trends Round Up

Podcasts

S Tier (“Best of the Best”)

Sam Altman | Greymatter — AI for the Next Era

Connor Leahy | Machine Learning Street Talk — AI Alignment & AGI Fire Alarm

Demis Hassabis | Lex Fridman — Demis Hassabis: DeepMind

A Tier

George Hotz | Lex Fridman — Comma.ai, OpenPilot, and Autonomous Vehicles

Ilya Sutskever | Lex Fridman — Deep Learning

Emad Mostaque | Good Time Show — Founder of Stable Diffusion on AI ethics, religion, India’s AI future and open source

Ben Goertzel | Machine Learning Street Talk — Artificial General Intelligence

Andrej Karpathy | Lex Fridman — Tesla AI, Self-Driving, Optimus, Aliens, and AGI

Best of the Rest

a16z — GPT-3, Beyond the Hype

Stratechery — The AI Unbundling

Reading for your Life — The Singularity is Near by Ray Kurzweil

Yann Lecun | Lex Fridman — Dark Matter of Intelligence and Self-Supervised Learning

Jim Keller | Lex Fridman — The Future of Computing, AI, Life, and Consciousness

George Hotz | Lex Fridman — Hacking the Simulation & Learning to Drive with Neural Nets

Ben Goertzel | Lex Fridman — Artificial General Intelligence — Lex Fridman Podcast

Gary Marcus | Machine Learning Street Talk — Prof. Gary Marcus 3.0

Connor Leahy — GPT-3 as an AI Fire Alarm

Joscha Bach | Lex Fridman — Artificial Consciousness and the Nature of Reality

John Carmack | Lex Fridman — Doom, Quake, VR, AGI, Programming, Video Games, and Rockets

Videos / Video Podcasts / Video Essays

S Tier (“Best of the Best”)

Eliezer Yudkowsky (2007) —  Introducing the Singularity: Three Major Schools of Thought

Eliezer Yudkowsky (2017) — Difficulties of Artificial General Intelligence Alignment

Eric Elliott (2020) — What it’s like to be a Computer: An Interview with GPT-3

Ethan Caballero (2022) — Broken Neural Scaling Laws

A Tier

Yannic Kilcher (2017) — Attention is all you need

OpenAI (2019) — Multi Agent Hide and Seek

WSJ (2019) — How China is Using Artificial Intelligence in Classrooms

Yannic Kilcher (2020) — GPT-3: Language Models are Few Shot Learners (paper explained)

Best of the Rest

Eliezer Yudkowsky (2012) — Intelligence Explosion

OpenAI (2017) — Dota2

Fei Fei Li (2018) — How to make AI that’s good for people

George Hotz (2019) — Jailbreaking the Simulation with George Hotz

Lex Fridman (2019) — Deep Learning Basics: Introduction and Overview

Sam Altman (2020) — Sam Altman talks about AI at Big Compute 20 Tech Conference

Two Minute Papers (2020) — OpenAI GPT-3 - Good at Almost Everything

Jack Soslow (2020) — Two AIs talking to each other

Lex Fridman (2020) — GPT-3 vs Human Brain

Harrison Kinsley and Daniel Kukiela (2020) – Neural Networks from Scratch - p.3 The Dot Product

Lex Fridman (2020) — Deep Learning State of the Art

Bycloud (2020) — What Happens When AI Robots Design Themselves

Two Minute Papers (2020) — MuZero: DeepMind’s New AI Mastered More Than 50 Games

Mira Murati (2020) — Ensuring AGI benefits all of humanity

Two Minute Papers (2020) — Can an AI Design Our Tax Policy?

Neat AI (2021) — Lenia — Conway’s game of life arrives in the 21st century

Sam Altman (2021) — The Future of AI Research from DALL-E to GPT-3

Yannic Kilcher (2021) — How far can we scale up? Deep Learning’s Diminishing Returns (Article Review)

Two Minute Papers (2021) — Watch Tesla’s Self-Driving Car Learning in a Simulation

Ethan Caballero (2022) — Scale is all you need

Two Minute Papers (2022) — DeepMind AlphaFold A Gift to Humanity

OpenAI (2022) — Aligning AI Systems with Human Intent

NeatAI (2022) — AI Learns NEAT Pacman Solution

Yannic Kilcher (2022) — Grokking: Generalization beyond Overfitting on small algorithmic datasets (Paper Explained)

The Third Build (2022) — How an AI is Becoming the World’s Best Pokemon Player

Books

Deep Learning (2016)

Superintelligence (2014)

The Singularity is Near (2005)

Movies

AlphaGo (2017)

Her (2013)

2001: A Space Odyssey (1968)

List was inspired by The Index from Jeremy Nixon, which is more about worldly knowledge, and Aman’s Reading List, which is more about becoming technically up to speed. 

mark