Language and NLP Section 043

Classical NLP That Still Works

The methods from before deep learning that still win on small data, small budgets and tight deadlines.

7 of 7 lessons published Three reading levels on every lesson

Start with “Bag of words”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. Bag of words
  2. TF-IDF
  3. N-gram language models and smoothing
  4. The baseline you must beat before reaching for BERT
  5. BM25
  6. Matching thousands of keywords at once
  7. Keyword and keyphrase extraction