Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Month 3 — Deep Learning

🎯 Goal of this month

By the end of the month you will be able to:

  • Understand what a neural network is and how it works
  • Build and train your own neural networks in PyTorch
  • Get familiar with TensorFlow/Keras
  • Do image classification with CNN
  • Process sequence data with RNN/LSTM
  • Apply transfer learning

Weekly breakdown

WeekTopicTime
Week 1Neural Network foundations + PyTorch10-12 hours
Week 2TensorFlow/Keras + Training techniques10-12 hours
Week 3CNN and Image Classification10-12 hours
Week 4RNN/LSTM + Transfer Learning10-12 hours

Chapter order

  1. Neural Network foundations — perceptron, backprop, intuition
  2. PyTorch foundations — tensor, autograd, nn.Module
  3. TensorFlow and Keras — alternative framework
  4. Training techniques — optimizers, regularization, callbacks
  5. CNN — Convolutional Networks — image classification
  6. RNN, LSTM, GRU — sequence data
  7. Exercises

What can you do by the end of the month?

  • Write nn.Module in PyTorch and build a training loop
  • Achieve 95%+ accuracy on datasets like MNIST, CIFAR-10
  • Fine-tune pretrained models (ResNet, EfficientNet)
  • GPU-powered prediction service via FastAPI
  • Ship ML models to production with torch.save / torch.jit

Tip for Backend Dev

DL = “Layered functions + Automatic differentiation”. You need two things:

  1. Model architecture — stacking layers (like LEGO)
  2. Training loop — for-each-batch: forward → loss → backward → optimizer

It looks complex at first, but after writing 2-3 examples you’ll feel the “pattern”.

About Hardware

DL is built not for CPU but for GPU. Options:

  1. Mac M1/M2/M3MPS backend (PyTorch 2.0+) — enough for small models
  2. Local NVIDIA GPU(RTX 3060+) — install CUDA + cuDNN
  3. Google Colab — free T4 GPU (12 hours/session) — RECOMMENDED
  4. Kaggle Notebooks — free P100 GPU (30 hours/week)
  5. **Paid:**Lambda Labs, vast.ai, RunPod — $0.20-2 per hour

**Advice:**for local exercises CPU/M-chip, for capstone — Colab/Kaggle GPU.

Start

Go to Neural Network foundations.