TensorFlow: Working with NLP
41mIntermediate2022-02-02
Authors
Jonathan Fernandes
Consultant focusing on data science, AI, and big data
Course details
TensorFlow 2.0 is quickly becoming one of the most popular deep learning frameworks and a must-have skill in your artificial intelligence toolkit. Using a hands-on approach, Jonathan Fernandes covers the key aspects of working with transformers in natural language processing, all in TensorFlow. He goes over the basics of working with text data, and explores transfer learning, fine-tuning BERT, and understanding the transformer model architecture. He also includes challenge/solution sets and assessment questions to help you optimize retention of the material.
Skills covered
TensorFlowNeural Networks and Deep LearningNatural Language Processing (NLP)PythonGoogleArtificial Intelligence (AI)Open SourceDeep Dive (X:Y)
Concepts
0. Introduction
- 01 - Why TensorFlow
- 02 - What you should know
- 03 - What is TensorFlow
1. NLP and Transformers
- 04 - What is NLP
- 05 - Transformers, their use, and history
- 06 - Transformers for NLP
- 07 - Challenge - NLP model size
- 08 - Solution - NLP model size
2. BERT and Transfer Learning
- 09 - Bias in BERT and GPT
- 10 - How was BERT trained
- 11 - Transfer learning
3. Transformers and BERT
- 12 - Transformer - Architecture overview
- 13 - BERT model and tokenization
- 14 - Tokenizers
- 15 - Self-attention
- 16 - Multi-head attention and feedforward network
- 17 - Fine-tuning BERT
Conclusion
- 18 - Next steps
Related courses
- TensorFlow 2.0: Working with Images
- Learning TensorFlow with JavaScript
- TensorFlow 2: Working with Neural Networks
- PyTorch Essential Training: Working with Images
- Building Recommender Systems with Machine Learning and AI
- Building Deep Learning Applications with Keras 2.0 (2017)
- Deep Learning: Model Optimization and Tuning (2022)
- Building and Deploying Deep Learning Applications with TensorFlow
Related learn paths
- Advance Your Skills in AI and Machine Learning
- Advance Your Skills in Natural Language Processing
- Advance Your Skills in Deep Learning and Neural Networks
- Develop Your Skills with Large Language Models
- Getting Started with AI and Machine Learning
- Fundamentals to Become a Machine Learning Engineer
- Become an AI Engineer
- Prepare for the Google Cloud Digital Leader Certification