Linux Commands for day to day usage and basics of Shell Scripting with Case Studies.
What You’ll Learn
- Setup Ubuntu Linux on Windows using wsl
- Getting Started with Linux Shell Commands using commands such as pwd
- help
- etc
- Listing files and folders in Linux File System using ls
- Filtering files and folders in Linux File System using commands such as find
- Processing Data in Files using Linux Commands using commands such cat
- tail
- head
- more
- cut
- sort
- uniq
- etc
- Understanding File and Folder Properties and also commands to change the ownership as well as permissions
- Managing Files and Folders in Linux using commands such as cp
- mv
- rm
- etc along with awk for the automation
- Basic System Commands in Linux such as lscpu
- free
- df
- du
- etc to get CPU
- memory
- free or available as well as used storage respectively
- Comparing Files and Folders in Linux using diff
- Variables and Environment Variables in Linux including commands such as env and concepts related to PATH Environment Variable
- Getting Started with AWS to provision EC2 Instances to explore SSH
- networking concepts
- scp
- etc
- Overview of SSH to interact with remote servers which includes all key concepts such as sshd
- configuration files
- running commands remotely
- etc
- Basic Networking Concepts such as different ip addresses
- ports using Linux including telnet command to troubleshoot networking issues
- Copy Files and Folders between Multiple Systems using scp including fine tuning the performance of scp
- Troubleshooting Application issues using find and grep in Linux
- Monitoring and Managing Linux Servers using System Commands such as uptime
- ps
- lost
- top
- etc
- Overview of Developer Tools for Linux using Windows - notepad++
- winscp
- visual studio code
- etc
- Overview of Ansible for Server Automation - Running Commands
- Playbooks
- Variables
- Profiles
- etc
- Overview of Automation using Python on Linux - using os
- subprocess
- modules
Requirements
- PC or Macintosh with nice design
- Something like 8 GB Smash
- i5 or comparable processor
- Computer processor with double center or with higher design
Description
As a component of this course, you will learn a large portion of the significant Linux orders that can prove to be useful while working in Linux-based conditions.
Here are the significant level subtleties of the Linux Orders that are covered as a component of this involved course.
You will begin by having a proper climate to rehearse. Windows clients can set up Ubuntu 20.04 utilizing wsl.
When the climate is prepared, you will comprehend how to get everything rolling with essential Linux Orders.
The most generally involved order in Linux is ls. Posting the files is utilized. We will see various varieties of ls by going through every one of the significant contentions.
One of the strong Linux orders and furthermore my most loved is "find". It assists us with separating the documents and catalogs in view of name, type, changed time, and so forth. You will figure out how to utilize the find order successfully according to the viewpoint of finding the documents in light of the rules.
As we comprehend how to get subtleties connected with records and organizers in Linux, we will go through the subtleties connected with seeing the information in documents utilizing significant Linux orders like feline, tail, more, and so on. Likewise, we will audit Linux orders like cut, sort, uniq to handle the information. This large number of orders are regularly utilized against text records.
In the wake of going through subtleties connected with ls, find orders as well as orders connected with handling information in records, we will walk you through the subtleties connected with document and organizer properties in Linux. You will get an outline of orders, for example, useradd, userdel, chmod, and so on which are normally connected with record authorizations.
One of the key angles connected with records and envelopes is to successfully oversee them. We will go through the insights concerning overseeing documents and envelopes utilizing Linux orders, for example, cp for duplicate, mv for move or rename, rm for erase or eliminate, tar to construct uncompressed as well as packed tar balls. Likewise, you will experience the awk order to mechanize a portion of the normal errands, for example, redesigning the documents in view of examples.
The center parts of a PC are only computer processor, Memory, and Capacity. In this part or module, you will learn Linux orders, for example, lscpu to get computer processor subtleties, allowed to get memory subtleties, and afterward df and du to get capacity subtleties.
On occasion, we want to ensure the information is in documents as well as codebase to investigate the creation issues or bugs in QA. In this segment, you will figure out how to utilize the Linux order called diff to analyze documents and envelopes and audit the distinctions.
Climate Factors are the ones that can affect the meetings signed in by clients in Linux. As a feature of this part, you will learn subtleties connected with Factors, Climate Factors. Likewise, you will comprehend how to list all the Climate Factors utilizing Linux orders such env, and how to get a worth of a Variable or Climate Variable utilizing the Linux order reverberation. On top of these things, you will likewise realize exceptionally significant perspectives connected with one of the main Climate Factors called Way.
As we gain a good measure of information connected with Linux orders utilizing a solitary server, it is the ideal opportunity for us to investigate other significant orders, for example, ssh, scp, pssh, pscp, and so on which require more than one Linux Framework or Server. Likewise, we want to go through essential systems administration ideas. To learn orders to interface between the servers as well as to comprehend essential systems administration ideas, we will begin with AWS to arrangement Ubuntu-based virtual machines. These Virtual Machines will be utilized in the resulting segments to gain proficiency with the ideas referenced before as a feature of this list item.
When we go through the insights concerning getting everything rolling with AWS, we will zero in on realizing all key ideas connected with SSH, for example, sshd daemon, refreshing ssh config records, and restarting sshd utilizing systemctl or administration order. Additionally, we will go through the subtleties connected with passwordless login and furthermore capacity to run orders remotely by means of ssh. We will likewise comprehend how to set up equal ssh and afterward run orders on various Linux frameworks in equal.
To be OK with learning in a Linux climate, one genuinely must comprehend key ideas, for example, various sorts of IP Locations, Port Numbers, connections among applications and data sets with ports, and so on. In this part, we will go through exceptionally significant systems administration ideas utilizing apache2, MongoDB, and so forth.
When we are alright with SSH, it is the ideal opportunity for us to utilize devices, for example, scp which utilizes ssh in the engine to duplicate documents and envelopes between the Linux Frameworks. We will likewise investigate equal scp to duplicate documents in lined up with different objective frameworks from one source framework. Additionally, we will go through the subtleties connected with accelerating the duplicate utilizing various procedures which incorporate presenting different scp orders utilizing nohup.
One of the significant perspectives for any IT Architect is to investigate the application issues sent in Linux by assessing logs produced by applications. In the wake of going through scp, you will figure out how to investigate issues by utilizing grep and find against log records of the applications sent on the Linux Server.
To guarantee that we can screen and oversee Linux Servers, we not just have to comprehend how to oversee applications and data sets in Linux yet additionally need to grasp the exhibition of the applications. For overseeing applications and information bases on a Linux server, one ought to be know about orders, for example, able to introduce applications and systemctl or administration to deal with the existence pattern of uses and data sets. To screen, one ought to be know all about orders like ps, lsof, top, and so on. You will figure out how to screen and oversee applications as well as data sets utilizing models, for example, ssh, apache2, mongodb, jupyterlab, and so on.
As we advanced many orders and apparatuses on Linux, presently it is the ideal opportunity for us to deal with expanding efficiency by utilizing fitting instruments, particularly for Windows clients. You will see the pertinence and furthermore how to arrangement apparatuses, for example, notepad++, winscp, visual studio code with far off improvement expansion, git instruments for Windows, and so on.
Associations will wind up having many servers to help their applications. Nonetheless, these many servers need to follow a modest bunch of formats. Utilizing Server Mechanization instruments like Ansible, we ought to have the option to computerize the method involved with designing an enormous number of servers utilizing a modest bunch of formats. You will get an outline of Ansible covering a portion of the center ideas of Ansible like running orders, stock, playbooks, factors, jobs, and so on.
Additionally, you will comprehend how to utilize programming dialects like Python to deal with computerization by utilizing modules like os, glob, subprocess, and so forth.
Basic Linux Commands
Basic Linux Commands
Running the first command on Linux
Getting usage of Linux commands using the help
Overview of Files and Folders
Fully Qualified or Absolute Paths and Relative Paths of Files and Folders
Listing files and folders in Linux File System using ls
Overview of ls command to list files and folders in Linux
Setup Files and Folders from GitHub Account to learn Shell Commands
Setup Jupyter Lab to go through help on linux commands
Getting the properties of files and folders using the ls command in Linux
Sorting ls output while listing files in Linux
List files and folders in Linux sorted by time
List files and folders in Linux sorted by size
Overview of Hidden Folders and Files
Listing Hidden Files and Folders in Linux
Listing the files and folders recursively in Linux
Exploring Control Arguments while listing files in Linux
Overview of representation of file sizes
Overview of alias command and ll to list files and folders
Filtering files and folders in Linux File System
Introduction to the filtering files and folders on Linux File System
Accessing Windows Files and Folders from Linux setup using wsl
Overview of grep command
Few basic examples using grep and piping
Overview of Piping while running shell commands
Overview of Basic Pattern Matching
Deep Dive into the wc command to get word count or line count
Overview of the find command to filter files and folders
Understand the behavior of the simplest form of find command in Linux
Using Linux find command to find directories or folders
Using Linux find command to find files by type and pattern
Overview of Standard Directories in Linux
Get the list of files based on the modified time using the Linux find command
Get the list of files based on size using the Linux find command
Processing Data in Files using Linux Commands
Introduction to commands used for processing data in files using Linux
Overview of Different File Formats
Get file format or type using file command in Linux
Preview the data in the text file using head command in Linux
Preview the data in the text file using tail command
Install apache web server on Ubuntu Linux
Generate Apache Logs every second using shell script and nohup
Monitoring Logs using tail command in Linux
Preview the data in the text file using more command
Extract data from files in Linux using cut command
Sort data in files in Linux using sort command
Sort data in files in Linux using sort command based on key and delimiter
Extract Information and Redirect to a file in Linux
Getting Unique Records from File using sort in Linux
Using uniq to get unique values in Linux
Understanding File and Folder Properties
Introduction to Properties of Files and Folders
Understand File and Folder Properties provided by ls command
Understanding Owner of the Files in Linux
Overview of groups associated with files and folders in Linux
Creating Groups in Linux using groupadd
Create users in Linux using useradd command
Specifying bash as the default shell while creating users in Linux
Create Users with Group in Linux
Add users to supplementary or secondary groups in Linux
Overview of File Permissions in Linux
Overview of umask for default permissions on Files and Folders
Permissions on Home Folders for different Linux Users
File and Folder Permissions for Groups and Others
Conclusion for File and Folder Properties using Linux
Managing Files and Folders in Linux
Introduction to Managing Files and Folders in Linux
Generate empty files in Linux using touch command
Creating Directories in Linux using mkdir command
Overview of awk command in Linux
Overview of cp command to copy files in Linux
Using cp command to copy files in Linux
Create multiple folders at once using awk in Linux
Copy files using Patterns in Linux
Automate file copy using awk and cp in linux
Copying folders recursively using cp command in Linux
Copying files using cp while preserving properties in Linux
Moving Files in linux using mv command
Automate file move using awk and mv in linux
Overview of tar command to take the backups
Create backup of files and folders using tar command in linux
Restoring Files and Folders using tar command in Linux
Moving Folders in Linux using mv command
Overview of rm command to remove files from Linux File System
Delete files from Linux File System using rm command
Use alias to delete files interactively from Linux File System
Delete folders from Linux File System using rm command
Restore Data Folder from the tar ball
Delete files using find and rm from Linux file system based on name
Delete files using find and awk from Linux file system based on name
Generate log files for multiple years using touch with patterns
Update timestamp of files based on names in Linux using touch
Delete files using find and rm based on modified time in Linux
Renaming the files and folders in Linux
Basic System Commands in Linux
Introduction to Basic System Commands in Linux
Overview of core components of a computer
Get CPU Details using lscpu command in Linux
Get Memory Details using free on Linux
Get Storage Details using df in Linux
Get Disk Usage Details using du in Linux
Get largest folders and files using du and sort on Linux
Understand Storage Details of Directories using du on Windows
Get storage use of folders and files
Get Storage Details of larger files using find and du
Comparing Files and Folders in Linux using diff
Introduction to comparing files and folders in Linux using diff
Overview of the diff command
Prepare Dataset to explore diff command in Linux
Understand the output of the diff command in Linux
Compare Files Ignoring Blank Lines and White Spaces using diff in Linux
Compare Files Ignoring case using diff in Linux
Unified and Side By Side Comparison using diff in Linux
Compare Folders in Linux using the diff command
Variables and Environment Variables in Linux
Creating and Printing Variables using echo in Linux
Overview of Environment Variables in Linux and env command
Overview of Environment Variables in Windows
Review some of the standard environment variables in Linux
Get the location of commands in linux using which
Review PATH and unset PATH in Linux
Relevance of PATH Environment Variable while running Linux Commands
Overview of Profile and rc in Linux
Create a simple shell script and grant execute permissions in Linux
Update PATH with parent folders of custom applications
Update PATH in profile with parent folders of custom applications
Getting Started with AWS
Introduction to Getting Started with AWS
Signing up for AWS
Overview of AWS Web Console
Overview of AWS EC2 Console or Dashboard
Create AWS EC2 Key Pair using AWS EC2 Console
Create our first AWS EC2 Instance using Ubuntu 20
Login into AWS EC2 Instance using Key Pair
Overview of AWS Free Tier and Pricing
Overview of AWS Web Console Cloud Shell
Overview of AWS EC2 Instance Concepts
Managing AWS EC2 Instances
Overview of SSH to interact with remote servers
Introduction to Overview of SSH to interact with Remote Servers
Create Multiple AWS EC2 Instances
Different Modes of SSH Login to Remote Servers
Understanding Password less login to Remote Server
Overview of SSH Daemons on Remote Servers
Understand SSH Properties Files and Properties
Enabling Password login on Remote Server
Run Commands on Remote Servers using SSH
Connect to Remote Servers from Windows using Powershell as well as wsl
Setup pssh or parallel-ssh on Mac as well as Ubuntu Linux
Run Commands on multiple servers using parallel-ssh or pssh
Run Commands on multiple servers using pssh using the hosts file
Enable Password less login using ssh keys and the ssh-copy-id command
Terminate AWS EC2 Instances used for demo
Basic Networking Concepts using Linux
Introduction to Basic Networking Concepts using Linux
Provision EC2 Instance from AWS
Overview of AWS Security Groups
Overview of Different Types of IP Addresses
Install Apache Webserver on Ubuntu
Update Security Group to access Apache Web Application
Overview of Daemon or Background Processes and Ports
Understanding Structure of IP Address
Overview of DNS Aliases for IP Addresses
Install Jupyter Lab on Ubuntu
Run Jupyter Lab using Localhost
Update Security Group to access Jupyter Lab
Setup Mongo DB on AWS EC2 Instance
Run MongoDB on Universal IP Address
Update Security Group to access Mongo DB
Cleanup AWS EC2 Instance used to demo networking concepts
Copy Files and Folders between Multiple Systems using scp
Introduction to Copying Files and Folders between multiple Linux Systems using scp
Provision of multiple EC2 Instances from AWS
Connect to EC2 Instances using Windows Powershell
Connect to EC2 Instances from Linux on Windows
Prepare Data Sets to explore Copying Files
Overview of scp for secure copy between Multiple Systems
Copy Files using scp between Multiple Systems
Copy Folders using scp between Multiple Systems
Copy Tar Ball or Zip File using scp between Linux Servers
Setup parallel-scp or pscp to copy files to multiple systems
Prepare Target Systems by recreating folders using pssh
Copy Files onto remote machines in parallel using pscp
Copy Folders onto remote machines in parallel using pscp
Overview of Copying Files and Folders between two systems in parallel
Submit Long-Running Applications or Commands in the Background using nohup
Run multiple scp commands in parallel using nohup in Linux
Stop or Terminate AWS EC2 Instances used for the tasks
Troubleshooting Application issues using find and grep in Linux
Introduction to Troubleshooting Applicatin Issues using find and grep in Linux
Review Standard Location for Application Logs on Linux
Setup Log Files to explore grep and find to troubleshoot the issues
Overview of Standard Log Message Format
Quick Review of find command to get log file names based on criteria
Getting help or official documentation or man page on Linux grep command
Overview of Standard Input, output and error
Redirect Linux Command or Program Results to a file
Overview of Null Device in Linux
Redirect stanard output and error to files and null device in Linux
Overview of Case Sensitivity in Linux
Search for error lines from files in Linux using find and grep
Get File Names with errors using grep and find in Linux
Perform Whole Word Search using Grep Command
Search for multiple patterns in the files using find and grep in Linux
Get number of lines with pattern using find and grep in linux
Get line number and output line using grep in Linux
Get additional lines along with error or exception lines using grep in Linux
Monitoring and Managing Linux Servers using System Commands
Introduction to Monitoring and Managing Linux Servers using System Commands
Setup EC2 Instance on AWS using Ubuntu 2
Overview of Managing Softwares on Ubuntu using apt
Install Apache Web Server and Mongodb on Ubuntu
Manage Applications and Databases using systemctl or service command
Start Apache Web Server and Mongodb using systemctl
Overview of Service and its components
Recap of commands to get Linux Server Details
Get CPU or Load Average of Linux Server using uptime command
Overview of ps command to get details about processes on Linux Server
Get details of all the processes running on Linux Server using ps
Get list of processes owned by user on Linux Server using ps
Customize the output of ps command for specific details of processes
Number of processes on Linux Server owned by each user using ps
Get Process Details for a service on Linux Server using ps command
Overview of lsof command to get list of open files on Linux
Get open file details using lsof for a given process id
Get open file details using lsof for a given port number
Get Process Details using lsof command for a given file
Troubleshoot Port Usage on Linux using lsof command
Overview of top command in Linux to get system performance details
Getting help or man page of top command in Linux
Using Command Line Options of top command in LInux
Customize top interactive interface in Linux
Switching between groups in top interactive interface in Linux
Kill Processes using top interactive interface in Linux
Terminate AWS EC2 Instance setup to practice Linux system management commands
Overview of Developer Tools for Linux using Windows
Introduction to Developer Tools for Linux on Windows
Install Notepad++ on Windows
Install WinScp on Windows to access files on remote Linux Servers or Sites
Add Site to WinScp for Password Login into Remote Linux Server
Add Site to WinScp for Passwordless Login into Remote Linux Server
Copying Files between Windows and Remote Linux Systems using WinScp
Opening Files on Remote Machines using WinScp and Notepad++ Locally on Windows
Overview of Advanced Editing Capabilities of Notepad++
Overview of Visual Studio Code on Windows for Remote Development
Install Visual Studio Code on Windows
Install Remote Development Extension Kit for Visual Studio Code
Setup Project on remote machine for remote development using Visual Studio Code
Open Remote Project via SSH using Visual Studio Code
Open Project via WSL using Visual Studio Code
Access Configuration Files on Remote Machines using Visual Studio Code
Install Git and Git Bash on Windows
Install Beyond Compare on Windows
Setup Repository using Git to explore Beyond Compare
Quick Demo of Beyond Compare to compare code base
Overview of Ansible for Server Automation
Introduction to Overview of Ansible for Server Automation
Setup Ansible on Ubuntu 20
Provision EC2 Instances to learn Ansible
Run first command using Ansible on Multiple Instances using inline inventory
Run first command using Ansible on Multiple Instances using inventory file
Update Ansible Hosts Files on AWS EC2 Reboots
Overview of Ansible help, man page and official documentation
Add User and Group Manually in Linux
Add Group on remote instances using ansible
Adding User using Ansible user module on remote servers
Add Folder on remote systems using Ansible file module
Copy authorized keys using Ansible copy module
Setup Project Structure for Ansible Playbooks using Visual Studio Code
Create and Run first ansible playbook
Define Variables for Credentials to run Ansible Playbooks
Develop Ansible Playbook to Mange Users
Getting Started with Developing Ansible Roles
Develop and Validate Ansible Playbook with Role
Adding more tasks to the Ansible Role and Troubleshooting the issues
Create Ansible Playbook with Variables
Using Lists and Loops in Ansible Playbooks
Using Tags to run specific tasks from Playbooks
Update Ansible Role and Playbook with variables and tags
Add Variables under vars folder of Ansible Role
Terminate AWS EC2 Instances used for Ansible Tasks for Server Automation
Conclusion of Overview of Server Automation using Ansible
Overview of Automation using Python on Linux
Introduction to Overview of Automation using Python on Linux
Validate Python and Python Modules such as pip on Ubuntu
Setup and Validate Jupyter Lab on Ubuntu
Create Folder for Notebooks using Jupyter Lab
Overview of getpass module to get username
Running Linux Shell Commands from Jupyter Notebooks
Overview of Python os module
Setup Data Sets for Python and Linux Integration
Overview of Python glob module
Overview of running Linux Commands using subprocess
Sort all files in Linux File System by size using Python
Uncompress all Compressed Files using Python on Linux
Overview of Python Multiprocessing Module
Uncompress Files in Parallel using Python multiprocessing
Add Extension to Files using Python
Overview of Copying Files using Python and scp
Run Commands on Remote Machines using Python and ssh
Copy Files to multiple systems in parallel using Python and scp
Desired Audience
Here is the desired audience for this advanced course.
Experienced application developers to gain expertise related to Linux shell commands
Experienced Data Engineers to gain enough skills related to Linux shell commands
Testers to improve their testing capabilities by using Linux shell commands effectively
Prerequisites
Logistics
Computer with decent configuration (At least 4 GB RAM, however 8 GB is highly desired)
Dual Core is required and Quad-Core is highly desired
Chrome Browser
High-Speed Internet.
Who this course is for:
- Understudies who need to learn Linux orders by involved practice
- Freshers and passage level IT experts who need to acquire the information on Linux orders
- Any Product engineers like Python
- Java
- and so forth who might want to acquire capability of Linux Orders
- Any Product Analyzers who might want to acquire capability connected with Linux Orders
- This course is intended for that multitude of IT Experts who regularly work on Linux based Climate
- Framework Overseers
- Network Overseers
- DevOps Designers
- and so forth