Course Outline
Introduction to Deep Learning
- Defining deep learning and its distinctions from traditional machine learning
- Real-world applications spanning computer vision, NLP, and other areas
- Overview of the deep learning ecosystem: TensorFlow 2.x, Keras, PyTorch
- Establishing a GPU-accelerated development environment
The Mechanics of Deep Learning
- Artificial neurons, activation functions, and network layers
- Forward propagation and calculating predictions
- Loss functions tailored for classification and regression tasks
- Gradient descent optimization and backpropagation mechanisms
- Training your initial neural network using the MNIST dataset
Convolutional Neural Networks for Computer Vision
- Comprehending convolution, filters, and feature maps
- Pooling layers and techniques for dimensionality reduction
- CNN architectures: Concepts behind LeNet, VGG, and ResNet
- Constructing and training a CNN for image classification
- Visualizing learned features and intermediate activations
Data Augmentation and Enhancing Model Accuracy
- Understanding how data augmentation mitigates overfitting and boosts generalization
- Image transformations: rotation, flipping, zooming, and cropping
- Implementing augmentation pipelines using Keras preprocessing layers
- Techniques such as dropout, batch normalization, and other regularization methods
- Tracking training progress via validation metrics and early stopping
Transfer Learning with Pre-Trained Models
- Concepts of transfer learning and the rationale behind its effectiveness
- Loading pre-trained models from Keras Applications (ResNet, EfficientNet, MobileNet)
- Feature extraction: freezing base layers while training new classifiers
- Fine-tuning: selectively unfreezing layers for domain adaptation
- Achieving high accuracy despite limited training data
Recurrent Networks and Sequence Modeling
- Introduction to sequential data and temporal dependencies
- Recurrent neural networks (RNNs) and the vanishing gradient challenge
- LSTM and GRU cells for capturing long-range dependencies
- Training a character-level text generation model
- Word embeddings and the Embedding layer within Keras
Natural Language Processing Fundamentals
- Text preprocessing steps: tokenization, padding, and vocabulary construction
- Developing a text classifier using RNNs and LSTMs
- Concepts of sequence-to-sequence models for machine translation
- Attention mechanisms and their significance in modern NLP
- Practical NLP implementation with TensorFlow 2.x text processing APIs
Final Project: Image Captioning
- Integrating computer vision and NLP in a multimodal architecture
- Extracting image features using a pre-trained CNN encoder
- Designing an LSTM-based decoder for caption generation
- Managing multiple input layers via the Keras functional API
- Training and evaluating the complete end-to-end captioning pipeline
Next Steps and Resources
- Deploying trained models using TensorFlow Serving
- Exploring transformer architectures and large language models
- NVIDIA DLI advanced workshops and certification pathways
- Community resources, datasets, and project ideas
Requirements
- Basic proficiency in Python programming (including functions, loops, dictionaries, and arrays)
- Familiarity with programming concepts such as variables, conditionals, and data structures
- No previous experience in deep learning or machine learning is necessary
Target Audience
- Software developers and engineers moving into the fields of AI and machine learning
- Data analysts and data scientists looking to acquire deep learning skills
- Technical professionals seeking to comprehend and apply neural network models
- Students and researchers initiating their exploration of deep learning
Testimonials (2)
The training was organized and well-planned out, and I come out of it with systematized knowledge and a good look at topics we looked at
Magdalena - Samsung Electronics Polska Sp. z o.o.
Course - Deep Learning with TensorFlow 2
I really liked the end where we took the time to play around with CHAT GPT. The room was not set up the best for this- instead of one large table a couple of small ones so we could get into small groups and brainstorm would have helped