Search topics…
Tutorials
Explore
June 6 Offline Event →
GenAIWallah · 100 Days of Deep Learning

Master Deep Learning
in 100 Days

Complete 100 Days of Deep Learning curriculum — Perceptrons, MLPs, CNNs, RNNs, LSTMs, Attention, and Transformers. Free forever.

A structured DL curriculum — from Perceptrons and MLPs through CNNs, RNNs, Attention mechanisms, and modern Transformer architectures.

100Days / Lessons
9Core Modules
150+Code Examples
Free Forever
Beginner Guide

What is Deep Learning?

Deep Learning = Machine Learning ke bade bhai. Jaha complex patterns chhupi hain, wahan DL kaam aata hai.

🧠 Neural Networks: Computers Ka Dimag

Deep Learning is a subset of Machine Learning that uses neural networks with many layers (hence "deep") to learn complex patterns from large amounts of data.

Imagine the human brain: it has billions of neurons connected by synapses. A neural network is a simplified mathematical model of this. Each "neuron" takes inputs, applies weights, and passes the result forward.

☕ Chai Wala Analogy: ML = Chai wala ko 5 recipes deke sikhana. DL = Chai wale ke dimag mein 1000 taste bud neurons banake, jo automatically har ingredient ka importance samajh lein. Result? Vo bina recipe ke bhi perfect chai bana lega.

Why "Deep"? Because these networks have multiple hidden layers between input and output. Each layer extracts progressively more complex features:

Layer 1 → Detects edges and lines

Layer 2 → Combines edges into shapes

Layer 3 → Combines shapes into objects (ears, nose, eyes)

Layer 4+ → Recognizes full faces, expressions, or objects

Know the Difference

When to Use Deep Learning?

ML chalega? Ya DL chahiye? Decision mein confusion na ho.

Factor Use Machine Learning Use Deep Learning
Data Size Small to medium (hundreds to thousands) Large (tens of thousands to millions)
Data Type Structured data (tables, spreadsheets) Unstructured data (images, text, audio)
Hardware CPU is sufficient GPU strongly recommended
Training Time Minutes to hours Hours to days
Examples Price prediction, churn analysis, recommendation Image recognition, speech synthesis, translation
Interpretability Easy to explain decisions Black box — harder to explain
Real Impact

Deep Learning Everywhere

Har roz use karte ho, shayad pata nahi hota.

📱

Face ID on iPhone

CNNs (Convolutional Neural Networks) map your face to a mathematical representation and verify it in milliseconds. Over 1 billion devices use this technology daily.

Learn in Module 6 →
🗣️

Siri, Alexa, Google Assistant

RNNs and Transformers convert speech to text, understand context, and generate human-like responses. Deep learning powers every voice assistant.

Learn in Module 7 →
🚗

Self-Driving Cars

CNNs detect lanes, pedestrians, and traffic signs. LSTMs predict vehicle trajectories. Deep learning is the brain of Tesla Autopilot and Waymo.

Learn in Module 6 →
💬

ChatGPT & Language Models

The Transformer architecture (self-attention) powers GPT-4, Claude, and Gemini. These models read billions of text pages to generate human-like responses.

Learn in Module 9 →
🎨

Midjourney & DALL-E

Diffusion models (a type of deep learning) generate photorealistic images from text descriptions. The same tech creates art, product designs, and architectural visualizations.

Learn in Module 6 →
🏥

Cancer Detection

Deep learning models analyze medical images (X-rays, MRIs, CT scans) to detect tumors earlier than human radiologists. Saving millions of lives worldwide.

Learn in Module 6 →
Your Roadmap

Perceptron to Transformer

100 din mein tum khud AI models bana sakte ho. Ye hai vo raasta.

Foundational Research

Papers That Built Deep Learning

Ye papers ne AI ko aaj ki position tak pahunchaya. Interview mein poochte hain.

Paper

Perceptron (Rosenblatt, 1958)

The first learning algorithm for a neural network. Frank Rosenblatt proved a perceptron could learn to classify linearly separable data — the seed of modern AI.

📄 ResearchCovered in Module 1
Paper

Backpropagation (Rumelhart et al., 1986)

The algorithm that made training multi-layer neural networks possible. Uses chain rule from calculus to propagate errors backward and update weights.

📄 ResearchCovered in Module 2
Paper

AlexNet (Krizhevsky et al., 2012)

Won ImageNet by a massive margin using 8-layer CNNs and GPUs. This paper sparked the deep learning revolution. Before AlexNet, deep learning was considered a dead end.

📄 ResearchCovered in Module 6
Paper

Attention Is All You Need (Vaswani et al., 2017)

Introduced the Transformer architecture — replacing RNNs with self-attention. Powers GPT, BERT, and every modern LLM. The most cited paper in AI history.

📄 ResearchCovered in Module 9
Trending

ResNet: Deep Residual Networks (He et al., 2015)

Solved the vanishing gradient problem in very deep networks using skip connections. Enabled training of 100+ layer networks. Used in every modern vision system.

🔥 TrendingCovered in Module 6
New

Adam Optimizer (Kingma & Ba, 2014)

Adaptive moment estimation combines momentum and RMSProp. The default optimizer for nearly all deep learning models today. Our Module 5 covers all optimizers.

🚀 StandardCovered in Module 5
Curriculum Overview

9 Modules to DL Mastery

Each module builds on the previous — click any module to dive into detailed notes with code, theory, and exercises.

Module 1
Days 1–10

DL Foundations & Perceptrons

Understand the biological inspiration behind neural nets and the mathematical model of a single neuron.

  • Biological vs. artificial neural models
  • Rosenblatt Perceptron — weights, bias, step activation
  • Perceptron learning rule and convergence
  • Non-linear XOR problem and its limits
  • Binary linear separation and decision boundaries
Start Module 1 →
Module 2
Days 11–22

MLPs & Backpropagation

Build multi-layer networks and learn how gradients flow backward through the network during training.

  • Multi-Layer Perceptrons — architecture and notation
  • Forward propagation — matrix equations
  • Activation functions — Sigmoid, Tanh, ReLU
  • Backpropagation — chain rule derivation
  • Gradient descent weight updates
Start Module 2 →
Module 3
Days 23–33

Gradients, Optimizers & Tuning

Diagnose and fix training instabilities, and find the right optimizer and hyperparameters for your model.

  • Batch vs. SGD vs. Mini-batch gradient descent
  • Vanishing and exploding gradients
  • Gradient clipping and weight initialization
  • Learning rate schedules and warmup
  • Keras Tuner hyperparameter search
Start Module 3 →
Module 4
Days 34–44

Regularization & Performance

Prevent overfitting and improve model generalization with modern regularization and normalization techniques.

  • L1 and L2 weight decay regularization
  • Dropout — random neuron deactivation
  • Batch Normalization — internal covariate shift
  • Data augmentation strategies
  • ReLU, LeakyReLU, ELU activation variants
Start Module 4 →
Module 5
Days 45–55

Deep Learning Optimizers

Master the full optimizer zoo — from basic momentum to Adam — and know when to use each.

  • Momentum and Nesterov Accelerated Gradient
  • AdaGrad — per-parameter learning rate decay
  • RMSProp — moving average of squared gradients
  • Adam — adaptive moment estimation
  • AdamW, Lion, and modern optimizer variants
Start Module 5 →
Module 6
Days 56–67

CNNs & Computer Vision

Apply convolutional neural networks to image classification, detection, and transfer learning tasks.

  • Convolution operation — filters, padding, stride
  • MaxPooling and spatial dimension reduction
  • LeNet-5, AlexNet, VGG architectures
  • Keras Functional API for complex models
  • Transfer learning — ImageNet pre-trained models
Start Module 6 →
Module 7
Days 68–78

RNNs, LSTMs & GRUs

Model sequential data — text, time series, speech — with recurrent architectures and gating mechanisms.

  • Vanilla RNN — sequential loops and hidden states
  • Backpropagation Through Time (BPTT)
  • LSTM — forget, input, and output gates
  • GRU — simplified gating mechanism
  • Bidirectional RNNs and stacked architectures
Start Module 7 →
Module 8
Days 79–88

Seq2Seq, Attention & LLMs

Build encoder-decoder systems with attention — the foundation of modern language models.

  • Encoder-decoder translation architecture
  • Information bottleneck problem
  • Bahdanau soft-attention mechanism
  • Attention scores and alignment visualization
  • Evolution from RNNs to Transformers to ChatGPT
Start Module 8 →
Module 9
Days 89–100

Transformer Architectures

Understand the architecture that powers GPT, BERT, and every modern LLM — from scratch.

  • Scaled dot-product self-attention
  • Query, Key, Value projection matrices
  • Multi-Head Attention — parallel attention heads
  • Positional encodings and residual Add & Norm
  • Encoder-only (BERT) vs. decoder-only (GPT) variants
Start Module 9 →
Quick Navigation

Jump to Any Topic

All 100 DL topics mapped below — click to navigate directly.

What is DL? Biological Neurons Perceptron Model Step Activation Perceptron Learning Rule XOR Problem Linear Separability Decision Boundaries DL vs ML Keras & TensorFlow Setup MLP Architecture Forward Propagation Matrix Notation Sigmoid Activation Tanh Activation ReLU Activation Loss Functions Backpropagation Chain Rule Gradient Descent MLP in Keras MLP Project Batch vs SGD Mini-batch Training Vanishing Gradients Exploding Gradients Gradient Clipping Weight Initialization Learning Rate Schedules Keras Tuner Training Curves Hyperparameter Tuning Gradient Flow Project Overfitting in DL L2 Regularization L1 Regularization Dropout Batch Normalization Layer Normalization Data Augmentation ELU & LeakyReLU Early Stopping Regularization Project Model Comparison Momentum SGD Nesterov Momentum AdaGrad RMSProp Adam Optimizer AdamW Optimizer Comparison Warmup Schedules Optimizer Project Convolution Operation Filters & Feature Maps Padding & Stride MaxPooling LeNet-5 AlexNet VGG Network ResNet Skip Connections Keras Functional API Transfer Learning Fine-tuning Strategies CNN Project — Image Classifier Sequential Data Vanilla RNN Hidden States BPTT LSTM Gates LSTM Cell State GRU Bidirectional RNN Stacked LSTMs Time Series Forecasting Text Generation RNN Seq2Seq Architecture Encoder-Decoder Bottleneck Problem Bahdanau Attention Attention Scores Alignment Visualization Neural Machine Translation LLM Evolution History From RNNs to ChatGPT Transformer Overview Self-Attention Query Key Value Scaled Dot-Product Multi-Head Attention Positional Encoding Add & Norm Layers Feed-Forward Sublayer BERT Architecture GPT Architecture Fine-tuning BERT Hugging Face Transformers Transformer from Scratch Capstone Project Final Review 🎓

Ready to Start Your Deep Learning Journey?

Begin with Module 1 — no prior DL knowledge required. Solid ML fundamentals will help.

Start Day 1 → 100 Days of NLP All Generative AI Tutorials →

Frequently Asked Questions

Is this deep learning course free?

Yes. GenAIWallah's 100 Days of Deep Learning course is completely free — no signup, no paywall. It covers Perceptrons, MLPs, CNNs, RNNs, LSTMs, Attention, and Transformers in Hindi and English.

Do I need to know machine learning before deep learning?

It is recommended but not strictly required. A solid understanding of ML fundamentals (linear regression, gradient descent, loss functions) will help you learn deep learning faster. GenAIWallah recommends completing the 100 Days of Machine Learning course first before starting the Deep Learning track.

What deep learning topics are covered?

GenAIWallah's 100 Days of Deep Learning covers: Perceptrons and MLPs, backpropagation and gradient descent, regularization techniques, optimizers (Adam, RMSprop), CNNs for image recognition, RNNs and LSTMs for sequences, Attention mechanisms, and the full Transformer architecture from scratch. All explained in Hindi and English.

Best deep learning course in Hindi?

GenAIWallah's 100 Days of Deep Learning is India's best free deep learning course in Hindi and English. Created by Harsh Dhariwal (IIT Kanpur), it covers all major deep learning architectures from scratch — CNNs, RNNs, LSTMs, Attention, and Transformers — with practical code examples.

What is a Perceptron and why does it matter?

A Perceptron is the simplest neural network — a single neuron that takes weighted inputs, applies an activation function, and produces a binary output. It's the building block of every modern neural network. Understanding perceptrons is essential before learning MLPs, CNNs, and Transformers. We build one from scratch in Module 1.

What is backpropagation in simple terms?

Backpropagation is how neural networks learn. After making a prediction, the network calculates how wrong it was (loss), then propagates this error backward through each layer, adjusting weights to reduce the error. It's like a teacher correcting a student's mistakes — but the teacher is calculus. We derive backpropagation step-by-step in Module 2.

What is the difference between CNN and RNN?

CNNs (Convolutional Neural Networks) are designed for spatial data like images. They use sliding filters to detect edges, textures, and shapes. Powers face recognition, medical imaging, and self-driving cars.

RNNs (Recurrent Neural Networks) are designed for sequential data like text and time series. They have memory of previous inputs. Powers language translation, speech recognition, and stock prediction. Learn both in Module 6 and Module 7.

What is the Transformer and why is it revolutionary?

The Transformer (2017) replaced RNNs with a mechanism called self-attention. Instead of reading text word-by-word, it looks at all words simultaneously and decides which ones matter most for each prediction. This made training faster, models bigger, and results better. GPT-4, Claude, and Gemini are all Transformers. We build one from scratch in Module 9.

Do I need a GPU for deep learning?

For the first few modules (Perceptrons, MLPs), a CPU is sufficient. Once you reach CNNs and large models, a GPU significantly speeds up training (10-100x faster). Options: (1) Google Colab (free GPU), (2) Kaggle Notebooks (free GPU), (3) Rent GPU on cloud (Vast.ai, RunPod), (4) Buy a local GPU if serious. We cover all options in Module 2.