EFK Stack - Enterprise-Grade Logging and Monitoring

Course details

Unlock the full potential of the EFK Stack—Elasticsearch, Fluent Bit, and Kibana—in this comprehensive course, designed for developers, system administrators, and DevOps professionals. Gain hands-on experience and practical, in-demand skills to implement and optimize an end-to-end enterprise-grade logging and monitoring solution. Along the way, explore each component of the EFK stack and how to deploy these technologies in a Kubernetes environment.

Concepts

Introduction

Introduction

What Is Logging and Elasticsearch

What is logging, and why does it matter
Elasticsearch and its evolution

Mastering Elasticsearch Fundamentals

Mastering fundamentals of Elasticsearch
Nodes and cluster in Elasticsearch
Node roles in Elasticsearch
Documents in Elasticsearch
Inverted index in Elasticsearch
Index in Elasticsearch
Shards and replicas in Elasticsearch
Mapping in Elasticsearch
Dynamic and explicit mapping in Elasticsearch
CRUD operations on Elasticsearch
Elasticsearch CRUD commands
Difference between POST and PUT operations
Cluster information - Elasticsearch CRUD commands

Understanding Kibana

Introduction to Kibana
Kibana visualizations and dashboards
Kibana Query Language (KQL) - Understanding the syntax and capabilities of KQL for advanced data querying
KQL demo
Building our first dashboard using Kibana
Building dashboard maps with Kibana
Interactive dashboards with drilldowns in Kibana

Fluent Bit

Introduction to Fluent Bit
Logstash's role within the ELK Stack
Logstash vs. Fluentd
Fluentd vs. Fluent Bit
Fluent Bit's role as a lightweight log shipper
Input, filter, and output plugins in Fluent Bit

Elasticsearch and Kibana Deployment on Kubernetes

Deploying Elasticsearch as a cluster within Kubernetes
Deploy Elasticsearch on Kubernetes
Deployments for Kibana instances
Scaling Elasticsearch and Kibana
Security considerations for production Kubernetes deployment
Scaling Elasticsearch nodes

Deploying Mock Ecommerce Application on K8s

Deploying mock ecommerce application on K8s
Setting up Event Generator app
Setting up Fluent Bit to monitor application logs
Exploring application logs in Kibana
Dashboarding with KQL in Kibana
Conditional appearance on Kibana dashboards

Instrumenting a Simple Python App for Logging

Deploying a simple Python application for logging
Deploying and validating the login app on Kubernetes
Configuring Fluent Bit to collect Python application logs
Building Kibana dashboards to visualize our application - Part 1
Building Kibana dashboards to visualize our application - Part 2
Building Kibana dashboards to visualize our application - Part 3
Building Kibana dashboards to visualize our application - Part 4

Elastic Cloud

Elastic Cloud and its offering
Setting up free Elastic Cloud account
Setting up Kubernetes monitoring in Elastic Cloud