Generative AI and Open Source Models: Hands-On Practice with Hugging Face Models
1h 52mIntermediate2024-09-26
Authors

Harpreet Sahota
Course details
Large language models (LLMs) are becoming increasingly crucial in various industries. This course with instructor Harpreet Sahota offers a deep dive into the inner workings of text generation using LLMs. Learn about the importance of tokenization, special tokens, and chat templates in text generation. Explore how to manipulate the next selected token and gain a technical and intuitive understanding of generation parameters such as temperature, top-p, top-k, repetition penalty, length penalty, and bad words list. Discover how these parameters can be combined to form powerful decoding strategies, including greedy search, multinomial sampling, beam search, and contrastive search. Gain hands-on experience using the Hugging Face text generation API and get a sneak peek into interacting with the NVIDIA NIM API to explore larger models. By the end of this course, you'll have a solid foundation in controlling text generation with LLMs, enabling you to apply these skills in real-world scenarios.
Skills covered
JupyterHugging FaceCross-Platform DevelopmentMobile DevelopmentGenerative AIPythonArtificial Intelligence (AI)Open SourceOne-Off
Concepts
0. Introduction
- 01 - Fine-tune your AI - Hands-on practice with Hugging Face models
1. Getting Started
- 02 - How do LLMs generate text
- 03 - Overview of the Hugging Face platform
- 04 - Accessing GPUs
2. Tokenizer
- 05 - What is tokenization
- 06 - Inspecting a tokenizer
- 07 - Encoding and decoding text
- 08 - Tokenizer chat template
3. Exploring Generation Parameters
- 09 - First generation with a local model
- 10 - Pipelines
- 11 - Introduction to generation parameters
- 12 - Temperature
- 13 - Top-k
- 14 - Top-p
- 15 - Other generation parameters
- 16 - Hugging Face Inference API
4. Decoding Strategies
- 17 - Greedy search
- 18 - Multinomial sampling
- 19 - Beam search
- 20 - Beam search with multinomial
- 21 - Contrastive search
Conclusion
- 22 - Interesting technical resources
- 23 - NVIDIA NIM API
Related courses
- Build with AI: LLM-Powered Applications with Streamlit
- Oracle Cloud Infrastructure Generative AI Professional
- GraphRAG Essential Training
- Artificial Intelligence Foundations: Neural Networks
- Fine-Tuning LLMs for Cybersecurity: Mistral, Llama, AutoTrain, AutoGen, and LLM Agents
- Hands-On Generative AI with Diffusion Models: Building Real-World Applications
- Enhancing Your Notebook Workflow with Jupyter AI
- LLaMa for Developers
Related learn paths
- Build AI Products Using Azure AI Services in Your Development Lifecycle
- Develop Your Skills with Large Language Models
- MLOps Essentials for Developers and AI Engineers: Tools, Pipelines, Security
- Advance Your Skills in Deep Learning and Neural Networks
- Getting Started with AI and Machine Learning
- Building AI Agents: Advanced Techniques for Developers
- A Developer's Guide to Google Gemini
- Building Trust, Competence, and Collaboration for Global Success