Production and MLOps Section 101

Edge and On-device AI

Running models on phones, browsers and tiny boards, where there is no GPU and no cloud.

13 of 13 lessons published Three reading levels on every lesson

Start with “What is edge AI?”

Lessons in order

Work top to bottom. Each lesson assumes the one above it.

  1. What is edge AI?
  2. Why run a model on the device?
  3. Model compression
  4. Quantisation in practice
  5. Pruning
  6. Knowledge distillation
  7. ONNX
  8. TensorFlow Lite
  9. Core ML
  10. Running models in the browser
  11. AI on a Raspberry Pi
  12. Latency and throughput
  13. Power and thermal limits