Rust LLMOps

Course details

In this course, MLOps expert Noah Gift covers the Rust language through live coding. Discover an iterative approach to understand and master the language, particularly focusing on its applications in MLOps. After going over the tools and methodologies that you will use in this course, dive into infrastructure as code, monitoring and logging, and auditing networks. Explore several key topics around security, permissions, and privacy. Find out how software like Candle, Codespaces, and Starcoder can enhance your experience with Rust. Learn about serverless inference, as well as Rust CLI inference and Rust chat inference. Explore Rust-BERT, Rust-PyTorch, ONNX, and more. Explore several AI services and how you can leverage them with Rust. Plus, explore several live coding sessions with Rust Cargo Lambda.

Concepts

0. Introduction

01 - Overview

1. Rust LLMOps

02 - Function - The essence of programming
03 - Operationalizing microservices
04 - Continuous integration for microservices
05 - What is a Makefile and how do you use it
06 - What is DevOps
07 - Kaizen methodology
08 - Infrastructure as code for continuous delivery
09 - Responding to compromised resources and workloads
10 - Monitoring and logging
11 - Auditing networks
12 - Rust - Secure by design
13 - Preventing data races with the Rust compiler
14 - AWS config for security
15 - Demo - AWS Security Hub
16 - Securing accounts with 2FA
17 - Access permissions overview
18 - Repository permission levels
19 - Repository privacy settings
20 - Key concepts in the GitHub ecosystem
21 - Demo - GitHub Actions
22 - Demo - Codespaces
23 - Demo - Copilot
24 - Candle framework in Rust
25 - GitHub Codespaces with GPU
26 - VS Code SSH to AWS accelerated
27 - Candle hello world
28 - Exploring StarCoder in Rust
29 - Whisper Candle transcriber
30 - Exploring remote development on AWS
31 - Rust for large language models (LLMs)
32 - Serverless inference
33 - Rust CLI inference
34 - Rust chat inference
35 - The continuous build binary
36 - The chat loop with StarCoder
37 - Invoke an LLM on an AWS G5 instance, part 1
38 - Invoke an LLM on an AWS G5 instance, part 2
39 - Rust-BERT introduction
40 - Installing and setting up Rust-BERT
41 - Basic syntax and model loading in Rust-BERT
42 - Rust sentiment analysis in the CLI
43 - Rust-PyTorch introduction
44 - Rust-PyTorch hello world
45 - PyTorch pretrained models
46 - Running pretrained PyTorch models in Rust
47 - Introduction to ONNX
48 - ONNX conversions
49 - Extending Google Bard
50 - Exploring Google Colab with Bard
51 - Exploring the Colab AI
52 - Exploring the Google Cloud Generative AI App Builder
53 - AWS Bedrock for responsible AI
54 - AWS Bedrock with Claude
55 - Summarizing text with Claude
56 - Using the AWS Bedrock API

2. Live Coding - Rust Cargo Lambda

57 - Rust Cargo Lambda, part 1
58 - Rust Cargo Lambda, part 2
59 - Rust Cargo Lambda, part 3

Rust LLMOps

Authors

Noah Gift

Course details

Skills covered

Concepts

0. Introduction

1. Rust LLMOps

2. Live Coding - Rust Cargo Lambda

Related courses

Related learn paths