Special offers now — see discounted courses.
day
:
hour
:
min
:
sec
See special offers
Generative AI and Open Source Models: Hands-On Practice with Hugging Face Models

Generative AI and Open Source Models: Hands-On Practice with Hugging Face Models

1h 52mIntermediate2024-09-26

Authors

Harpreet Sahota

Harpreet Sahota

Course details

Large language models (LLMs) are becoming increasingly crucial in various industries. This course with instructor Harpreet Sahota offers a deep dive into the inner workings of text generation using LLMs. Learn about the importance of tokenization, special tokens, and chat templates in text generation. Explore how to manipulate the next selected token and gain a technical and intuitive understanding of generation parameters such as temperature, top-p, top-k, repetition penalty, length penalty, and bad words list. Discover how these parameters can be combined to form powerful decoding strategies, including greedy search, multinomial sampling, beam search, and contrastive search. Gain hands-on experience using the Hugging Face text generation API and get a sneak peek into interacting with the NVIDIA NIM API to explore larger models. By the end of this course, you'll have a solid foundation in controlling text generation with LLMs, enabling you to apply these skills in real-world scenarios.

Skills covered

JupyterHugging FaceCross-Platform DevelopmentMobile DevelopmentGenerative AIPythonArtificial Intelligence (AI)Open SourceOne-Off

Concepts

0. Introduction

  • 01 - Fine-tune your AI - Hands-on practice with Hugging Face models

1. Getting Started

  • 02 - How do LLMs generate text
  • 03 - Overview of the Hugging Face platform
  • 04 - Accessing GPUs

2. Tokenizer

  • 05 - What is tokenization
  • 06 - Inspecting a tokenizer
  • 07 - Encoding and decoding text
  • 08 - Tokenizer chat template

3. Exploring Generation Parameters

  • 09 - First generation with a local model
  • 10 - Pipelines
  • 11 - Introduction to generation parameters
  • 12 - Temperature
  • 13 - Top-k
  • 14 - Top-p
  • 15 - Other generation parameters
  • 16 - Hugging Face Inference API

4. Decoding Strategies

  • 17 - Greedy search
  • 18 - Multinomial sampling
  • 19 - Beam search
  • 20 - Beam search with multinomial
  • 21 - Contrastive search

Conclusion

  • 22 - Interesting technical resources
  • 23 - NVIDIA NIM API

Related courses

Related learn paths

About us

LyndaKade is a leading learning platform that helps people learn business, software, technology, and creative skills to achieve personal and professional goals.

Phone numberAparat ChannelTelegram SupportTelegram ChannelInstagram Page

All rights to this site belong to LyndaKade.

Terms of Service|Privacy Policy

نماد الکترونیک enamad در صورت اتصال با آی‌پی داخل کشور، نمایش داده خواهد شد.
logo-samandehi - لوگو ساماندهی
zarinpal
zibal