Everything You Need to Start Text Processing in UNIX and Linux!
This tutorial covers everything that you must know to get started performing data analysis or text processing in Linux or UNIX. UNIX was created as a simple system that allowed users to build pipelines of commands to achieve enormous tasks. In this lesson, we cover the most commonly used data analysis tools.
The Commands used in this video:
---------------------------------
File Operations:
mv
System Operations:
alias
Data Analysis:
vi
cat
grep
awk
sed
sort
uniq
Special Conventions:
Backslash Escape = \
Beginning of a line = ^
End of a line = $
Range of Numbers = [0-9] or [0-3]
Tab = \t
Column Reference in Awk = $1 $2 $3, et cetera...
The Command History used in this video:
---------------------------------------
vim today.txt
cat today.txt
mv today.txt today.csv
alias grep
cat today.csv | grep New
cat today.csv
cat today.csv | grep -v New
cat today.csv | grep -v ew
cat today.csv | grep ew
cat today.csv | grep w
cat today.csv | grep y
cat today.csv | grep Y
cat today.csv | grep -i y
cat today.csv | grep "^ $"
cat today.csv | grep -v "^ $"
cat today.csv | grep -v "^$"
cat today.csv | grep "^$"
vi today.csv
cat today.csv | grep -i "s"
cat today.csv | grep -i "^s"
cat today.csv | grep -i "Jose"
cat today.csv | grep -i "se"
cat today.csv | grep -i "5"
cat today.csv | grep -i "3"
cat today.csv | awk '{ print $1 }'
cat today.csv | awk -F"," '{ print $1 }'
cat today.csv | awk -F"," '{ print $2 }'
cat today.csv | grep "[3-2]*"
cat today.csv | grep "[3..2]*"
cat today.csv | grep "[0..3]*"
cat today.csv | grep "[0-3]*"
cat today.csv | grep ",[0-3]"
cat today.csv | grep ",[0-3]" | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }'
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }'
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/ //g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "//g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/\ //g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/" "/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/:" "/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/:" "/g | uniq
vim file.list
cat file.list | sort
cat file.list | sort | grep -v "^$"
cat file.list | grep -v "^$"
cat file.list | grep -v "^$" | sort
cat file.list | grep -v "^$" | uniq
cat file.list | grep -v "^$" | sort
cat file.list | grep -v "^$" | sort | uniq
cat file.list | grep -v "^$" | sort | uniq -c
cat file.list | grep -v "^$" | sort | uniq -c | sort -n
cat file.list | sort | uniq -c | sort -n
The Files used in the video:
----------------------------
File 01: today.csv
San Francisco,43
San Jose,56
New York,23
Pittsburgh,30
Abu Dhabi,78
File 02: file.list
3
3
7
7
7
3
3
4
5
7
6
4
6
66
7
9
2
9
9
9
-----------------------
Thank you for dropping by!
Please join me:
/ paulwpoteete
/ paulwpoteete
/ paulwpoteete
CC by Paul W. Poteete
In questa pagina del sito puoi guardare il video online Everything You Need to Start Text Processing in UNIX and Linux! della durata di ore minuti seconda in buona qualità , che l'utente ha caricato The Expat Professor 08 febbraio 2023, condividi il link con amici e conoscenti, su youtube questo video è già stato visto 1,479 volte e gli è piaciuto like spettatori. Buona visione!
