Deep Learning: Model Optimization and Tuning (2022)
54mAdvanced2022-02-01
Authors

Kumaran Ponnambalam
Working with data for 20+ years
Course details
Deep Learning as a technology has grown leaps and bounds in the last few years. More and more AI solutions use Deep Learning as their foundational technology. Studying this technology, however, presents several challenges. IT professionals from varying backgrounds need a simplified resource to learn the concepts and build models quickly. In this course, instructor Kumaran Ponnambalam provides a simplified path to understand various optimization and tuning options available for deep learning models and shows you how to use these options to improve models. He begins by reviewing Deep Learning, including artificial neural networks and architectures. Next, Kumaran discusses the process of hyper parameter tuning. He examines the building blocks of neural networks and the levers available to tune them. Kumaran offers recommendations and best practices. Then he concludes with an end-to-end tuning example.
Skills covered
KerasTensorFlowNeural Networks and Deep LearningMachine LearningPythonGoogleArtificial Intelligence (AI)Open SourceDeep Dive (X:Y)
Concepts
Introduction
- Optimizing neural networks
- Prerequisites for the course
- Setting up exercise files
Introduction to Deep Learning Optimization
- What is deep learning
- Review of artificial neural networks
- An ANN model
- Model optimization and tuning
- The deep learning tuning process
- Experiment setups for the course
Tuning the Deep Learning Network
- Epoch and batch size tuning
- Epoch and batch size experiment
- Hidden layers tuning
- Determining nodes in a layer
- Choosing activation functions
- Initializing weights
Tuning Back Propagation
- Vanishing and exploding gradients
- Batch normalization
- Optimizers
- Optimizer experiment
- Learning rate
- Learning rate experiment
Overfitting Management
- Overfitting in ANNs
- Regularization
- Regularization experiment
- Dropouts
- Dropout experiment
Model Tuning Exercise
- Tuning exercise - Problem statement
- Acquire and process data
- Tuning the network
- Tuning backpropagation
- Avoiding overfitting
- Building the final model
Conclusion
- Continuing your deep learning journey
Related courses
- Deep Learning: Model Optimization and Tuning
- PyTorch Essential Training: Working with Images
- Deep Learning with Python: Optimizing Deep Learning Models
- Hands-On Introduction to Transformers for Computer Vision
- Full-Stack Deep Learning with Python
- Hugging Face Transformers: Introduction to Pretrained Models
- Foundational Math for Generative AI: Understanding LLMs and Transformers through Practical Applications
- Excel: Market Research Strategies
Related learn paths
- Advance Your Skills in Deep Learning and Neural Networks
- Advance Your Skills in AI and Machine Learning
- Advance Your Skills as a Machine Learning Specialist
- Master SQL for Data Science
- Develop Your Skills with the OpenAI API
- Master SQL Development
- Working with Data: Collecting, Processing, and Storing Data for AI
- AI Essentials for Sales Professionals