Skip to main content
Learn AI Create the Future — with Pranay
  • Learn
  • Paths
  • Projects
  • Practice
  • Glossary
  • Errors
  • LeetCode
  • Main site

Main site →
Select language

Translation is unavailable right now. Your browser’s own “Translate page” usually works.

Machine translation by Google

Topics

  • 🧱 Foundations 2 sections
  • 🤖 Machine Learning 11 sections
  • 📊 Statistics and Experiments 4 sections
  • 🧭 Doing the Work 9 sections
  • 🧠 Deep Learning 11 sections
    • Deep Learning 13 lessons
    • PyTorch Tensors 10 lessons
      • Overview
      • Installing PyTorch with the right CUDA build
      • Creating tensors and choosing a dtype
      • Shapes and broadcasting
      • reshape, view, permute and contiguity
      • Reductions and the dim argument
      • Indexing and boolean masks
      • gather, scatter and index_select
      • einsum for tensor operations
      • Moving tensors between CPU and GPU
      • Seeds and reproducible runs
    • Autograd in Depth 10 lessons
    • Building Models with nn.Module 11 lessons
    • Datasets and DataLoaders 10 lessons
    • Optimisers, Schedulers and the Training Loop 9 lessons
    • Debugging PyTorch 9 lessons
    • GPU Memory and Speed 10 lessons
    • Multi-GPU and Distributed Training 11 lessons
    • Checkpoints, Export and Inference 7 lessons
    • Reinforcement Learning 13 lessons
  • 🧰 Libraries and Frameworks 4 sections
  • 💬 Language and NLP 15 sections
  • 👁️ Computer Vision 13 sections
  • 🎙️ Speech, Forecasting and Recommenders 3 sections
  • ✨ Generative AI and LLMs 4 sections
  • 🔬 Inside a Transformer 11 sections
  • ⚙️ Production and MLOps 16 sections
  • 🌍 AI in the Real World 12 sections
  • ⚖️ Safety, Ethics and Law 2 sections

See all topics

  1. Home
  2. Learn
  3. PyTorch Tensors

🧠 Deep Learning · Section 027

🔢 PyTorch Tensors

The one object every PyTorch program is made of, and the handful of shape tricks that stop most errors before they happen.

Every lesson in this section is written by Pranay Mahendrakar.

10 of 10 lessons published · Three reading levels on every lesson

Start with “Installing PyTorch with the right CUDA build”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. 01 Installing PyTorch with the right CUDA build
  2. 02 Creating tensors and choosing a dtype
  3. 03 Shapes and broadcasting
  4. 04 reshape, view, permute and contiguity
  5. 05 Reductions and the dim argument
  6. 06 Indexing and boolean masks
  7. 07 gather, scatter and index_select
  8. 08 einsum for tensor operations
  9. 09 Moving tensors between CPU and GPU
  10. 10 Seeds and reproducible runs
Previous Deep Learning Next Autograd in Depth

Learn AI

Learn Artificial Intelligence the easy way.

Learn. Build. Ask. Share.

Free forever. No sign-up, no ads, no tracking.

Learn

  • All topics
  • Learning paths
  • Projects
  • Practice playground
  • AI glossary
  • Error database
  • LeetCode solutions

Start here

  • Python for AI
  • Mathematics for AI
  • Machine Learning
  • Classic Algorithms in Depth
  • Linear Models and Regularisation
  • Ensembles and Gradient Boosting

This site

  • Search
  • New lessons feed
  • Sitemap
  • About Pranay Mahendrakar
  • pranaymahendrakar.com

© 2026 Pranay Mahendrakar. Written for people who are starting from zero.

10 new lessons every day. If something here is wrong or confusing, that is worth fixing — say so.