Skip to main content
Learn AI Create the Future — with Pranay
  • Learn
  • Paths
  • Projects
  • Practice
  • Glossary
  • Errors
  • LeetCode
  • Main site

Main site →
Select language

Translation is unavailable right now. Your browser’s own “Translate page” usually works.

Machine translation by Google

Topics

  • 🧱 Foundations 2 sections
  • 🤖 Machine Learning 11 sections
  • 📊 Statistics and Experiments 4 sections
  • 🧭 Doing the Work 9 sections
  • 🧠 Deep Learning 11 sections
  • 🧰 Libraries and Frameworks 4 sections
  • 💬 Language and NLP 15 sections
    • Natural Language Processing 8 lessons
    • Text Preprocessing 9 lessons
    • Classical NLP That Still Works 7 lessons
    • The Embedding Family 10 lessons
    • The BERT Family 10 lessons
    • Sequence Labelling and Structure 10 lessons
    • Topic Modelling and Text Clustering 9 lessons
    • Semantic Search and Reranking 11 lessons
    • Chunking and Long Documents 8 lessons
    • Question Answering 10 lessons
    • Summarisation 10 lessons
    • Sentiment, Opinion and Text Mining 9 lessons
    • Multilingual and Indic NLP 12 lessons
      • Overview
      • How neural machine translation works
      • Running translation models yourself
      • Translating a low-resource language
      • XLM-RoBERTa and multilingual encoders
      • Train in English, run in Hindi
      • Multilingual sentence embeddings
      • Question in Hindi, documents in English
      • Hinglish and code-mixed text
      • Transliteration between scripts
      • Normalising Indic scripts
      • The AI4Bharat and IndicNLP stack
      • Why Hindi costs three times more tokens than English
    • Messy Real-World Text 10 lessons
    • Evaluating Text Systems 7 lessons
  • 👁️ Computer Vision 13 sections
  • 🎙️ Speech, Forecasting and Recommenders 3 sections
  • ✨ Generative AI and LLMs 4 sections
  • 🔬 Inside a Transformer 11 sections
  • ⚙️ Production and MLOps 16 sections
  • 🌍 AI in the Real World 12 sections
  • ⚖️ Safety, Ethics and Law 2 sections

See all topics

  1. Home
  2. Learn
  3. Multilingual and Indic NLP

💬 Language and NLP · Section 053

🌏 Multilingual and Indic NLP

Making NLP work in Hindi, Marathi, Tamil and Hinglish — not only in English.

Every lesson in this section is written by Pranay Mahendrakar.

12 of 12 lessons published · Three reading levels on every lesson

Start with “How neural machine translation works”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. 01 How neural machine translation works
  2. 02 Running translation models yourself
  3. 03 Translating a low-resource language
  4. 04 XLM-RoBERTa and multilingual encoders
  5. 05 Train in English, run in Hindi
  6. 06 Multilingual sentence embeddings
  7. 07 Question in Hindi, documents in English
  8. 08 Hinglish and code-mixed text
  9. 09 Transliteration between scripts
  10. 10 Normalising Indic scripts
  11. 11 The AI4Bharat and IndicNLP stack
  12. 12 Why Hindi costs three times more tokens than English
Previous Sentiment, Opinion and Text Mining Next Messy Real-World Text

Learn AI

Learn Artificial Intelligence the easy way.

Learn. Build. Ask. Share.

Free forever. No sign-up, no ads, no tracking.

Learn

  • All topics
  • Learning paths
  • Projects
  • Practice playground
  • AI glossary
  • Error database
  • LeetCode solutions

Start here

  • Python for AI
  • Mathematics for AI
  • Machine Learning
  • Classic Algorithms in Depth
  • Linear Models and Regularisation
  • Ensembles and Gradient Boosting

This site

  • Search
  • New lessons feed
  • Sitemap
  • About Pranay Mahendrakar
  • pranaymahendrakar.com

© 2026 Pranay Mahendrakar. Written for people who are starting from zero.

10 new lessons every day. If something here is wrong or confusing, that is worth fixing — say so.