Skip to main content
Learn AI Create the Future — with Pranay
  • Learn
  • Paths
  • Projects
  • Practice
  • Glossary
  • Errors
  • LeetCode
  • Main site

Main site →
Select language

Translation is unavailable right now. Your browser’s own “Translate page” usually works.

Machine translation by Google

Topics

  • 🧱 Foundations 2 sections
  • 🤖 Machine Learning 11 sections
  • 📊 Statistics and Experiments 4 sections
  • 🧭 Doing the Work 9 sections
  • 🧠 Deep Learning 11 sections
    • Deep Learning 13 lessons
    • PyTorch Tensors 10 lessons
    • Autograd in Depth 10 lessons
    • Building Models with nn.Module 11 lessons
    • Datasets and DataLoaders 10 lessons
    • Optimisers, Schedulers and the Training Loop 9 lessons
    • Debugging PyTorch 9 lessons
    • GPU Memory and Speed 10 lessons
    • Multi-GPU and Distributed Training 11 lessons
    • Checkpoints, Export and Inference 7 lessons
    • Reinforcement Learning 13 lessons
      • Overview
      • What is reinforcement learning?
      • Agents, environments and rewards
      • Markov decision processes
      • Exploration vs exploitation
      • Multi-armed bandits
      • Q-learning
      • Deep Q-networks (DQN)
      • Policy gradients
      • Actor-critic methods
      • PPO
      • Reward shaping
      • RLHF — learning from human feedback
      • Gymnasium and training environments
  • 🧰 Libraries and Frameworks 4 sections
  • 💬 Language and NLP 15 sections
  • 👁️ Computer Vision 13 sections
  • 🎙️ Speech, Forecasting and Recommenders 3 sections
  • ✨ Generative AI and LLMs 4 sections
  • 🔬 Inside a Transformer 11 sections
  • ⚙️ Production and MLOps 16 sections
  • 🌍 AI in the Real World 12 sections
  • ⚖️ Safety, Ethics and Law 2 sections

See all topics

  1. Home
  2. Learn
  3. Reinforcement Learning

🧠 Deep Learning · Section 036

🎮 Reinforcement Learning

How an AI learns by trying things and getting rewarded — the method behind game-playing AI and RLHF.

Every lesson in this section is written by Pranay Mahendrakar.

13 of 13 lessons published · Three reading levels on every lesson

Start with “What is reinforcement learning?”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. 01 What is reinforcement learning?
  2. 02 Agents, environments and rewards
  3. 03 Markov decision processes
  4. 04 Exploration vs exploitation
  5. 05 Multi-armed bandits
  6. 06 Q-learning
  7. 07 Deep Q-networks (DQN)
  8. 08 Policy gradients
  9. 09 Actor-critic methods
  10. 10 PPO
  11. 11 Reward shaping
  12. 12 RLHF — learning from human feedback
  13. 13 Gymnasium and training environments
Previous Checkpoints, Export and Inference Next scikit-learn Properly

Learn AI

Learn Artificial Intelligence the easy way.

Learn. Build. Ask. Share.

Free forever. No sign-up, no ads, no tracking.

Learn

  • All topics
  • Learning paths
  • Projects
  • Practice playground
  • AI glossary
  • Error database
  • LeetCode solutions

Start here

  • Python for AI
  • Mathematics for AI
  • Machine Learning
  • Classic Algorithms in Depth
  • Linear Models and Regularisation
  • Ensembles and Gradient Boosting

This site

  • Search
  • New lessons feed
  • Sitemap
  • About Pranay Mahendrakar
  • pranaymahendrakar.com

© 2026 Pranay Mahendrakar. Written for people who are starting from zero.

10 new lessons every day. If something here is wrong or confusing, that is worth fixing — say so.