AWK Essential Training
2h 2mBeginner2022-11-15
Authors

David D. Levine
Making technology better for people
Course details
So you've got a large data set. New information is always coming in, and it's messy and inconsistent. Text files, Excel spreadsheets, web forms, email messages, and so on. You'd like to find a way to format it into something clean and consistent you can use in a database, and you'd like to automate that process as much as possible. Enter AWK, a command-line tool for Mac, Unix, and Linux that allows you to manipulate data in powerful ways.
In this course, award-winning author and teacher David D. Levine shows you how to use AWK to read and write data in a variety of formats, produce reports, and automate repetitive tasks. He reviews the nuts and bolts of the language, such as field separators, pattern matching, variables, operators, expressions, and control structures; functions available for manipulating data; and integration with other programs like Excel.
Learning objectives
Determine what AWK is.
Recognize how to write an AWK program.
Determine how to use AWK command-line flags.
Identify how to specify field and record separators with variables.
Distinguish how to change a CVS file to a tab-separated one.
Break down how to work with operators and arrays.
Discover how to format output.
Interpret how to string data with functions.
In this course, award-winning author and teacher David D. Levine shows you how to use AWK to read and write data in a variety of formats, produce reports, and automate repetitive tasks. He reviews the nuts and bolts of the language, such as field separators, pattern matching, variables, operators, expressions, and control structures; functions available for manipulating data; and integration with other programs like Excel.
Learning objectives
Determine what AWK is.
Recognize how to write an AWK program.
Determine how to use AWK command-line flags.
Identify how to specify field and record separators with variables.
Distinguish how to change a CVS file to a tab-separated one.
Break down how to work with operators and arrays.
Discover how to format output.
Interpret how to string data with functions.
Skills covered
LinuxNetwork AdministrationEssential TrainingNetwork and System AdministrationOpen Source
Concepts
0. Introduction
- 01 - Welcome
- 02 - What you should know before watching this course
- 03 - Using the exercise files
1. What Is AWK
- 04 - What is awk
2. Awk Command Line Basics
- 05 - Writing an AWK program
- 06 - Working with records, fields, patterns, and actions
- 07 - Using AWK command line flags
3. Understanding Records and Fields
- 08 - Exploring basic input field separators
- 09 - Specifying field and record separators with variables
- 10 - Challenge - Change a CSV file to a tab-separated one
- 11 - Solution - Change a CSV file to a tab-separated one
4. Understanding Variables and Operators
- 12 - Using built-in variables
- 13 - Creating user-defined variables
- 14 - Working with operators and arrays
5. A Quick Introduction to Regular Expressions
- 15 - Regular expression basics
- 16 - Working with character classes and quantifiers
6. Using Control Structures
- 17 - Building control structures
- 18 - Creating an HTML table
- 19 - Challenge - Print only those lines consisting of a complete HTML entity
- 20 - Solution - Print only those lines consisting of a complete HTML entity
7. Formatting the Output
- 21 - Formatting output with printf()
- 22 - Formatting output with width and precision specifiers
8. Functions and Arrays
- 23 - Manipulating strings
- 24 - Using associative arrays
- 25 - Introducing awk's math functions
9. Combining AWK with Other Tools
- 26 - Using pipes
- 27 - Parsing Excel CSV files - line endings and quoting
- 28 - Parsing Excel CSV files - commas and newlines
- 29 - Scripting with AWK
- 30 - Challenge - Perform a join
- 31 - Solution - Perform a join
Conclusion
- 32 - Conclusion