Everything You Need to Start Text Processing in UNIX and Linux!
This tutorial covers everything that you must know to get started performing data analysis or text processing in Linux or UNIX. UNIX was created as a simple system that allowed users to build pipelines of commands to achieve enormous tasks. In this lesson, we cover the most commonly used data analysis tools.
The Commands used in this video:
---------------------------------
File Operations:
mv
System Operations:
alias
Data Analysis:
vi
cat
grep
awk
sed
sort
uniq
Special Conventions:
Backslash Escape = \
Beginning of a line = ^
End of a line = $
Range of Numbers = [0-9] or [0-3]
Tab = \t
Column Reference in Awk = $1 $2 $3, et cetera...
The Command History used in this video:
---------------------------------------
vim today.txt
cat today.txt
mv today.txt today.csv
alias grep
cat today.csv | grep New
cat today.csv
cat today.csv | grep -v New
cat today.csv | grep -v ew
cat today.csv | grep ew
cat today.csv | grep w
cat today.csv | grep y
cat today.csv | grep Y
cat today.csv | grep -i y
cat today.csv | grep "^ $"
cat today.csv | grep -v "^ $"
cat today.csv | grep -v "^$"
cat today.csv | grep "^$"
vi today.csv
cat today.csv | grep -i "s"
cat today.csv | grep -i "^s"
cat today.csv | grep -i "Jose"
cat today.csv | grep -i "se"
cat today.csv | grep -i "5"
cat today.csv | grep -i "3"
cat today.csv | awk '{ print $1 }'
cat today.csv | awk -F"," '{ print $1 }'
cat today.csv | awk -F"," '{ print $2 }'
cat today.csv | grep "[3-2]*"
cat today.csv | grep "[3..2]*"
cat today.csv | grep "[0..3]*"
cat today.csv | grep "[0-3]*"
cat today.csv | grep ",[0-3]"
cat today.csv | grep ",[0-3]" | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }'
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }'
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/ //g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "//g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/\ //g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/" "/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/:" "/g
cat today.csv | awk -F"," '{ print "Temp: " $2 "\tCity: " $1 }' | sort -n | sed s/" "/_/g | sed s/:_/:" "/g | uniq
vim file.list
cat file.list | sort
cat file.list | sort | grep -v "^$"
cat file.list | grep -v "^$"
cat file.list | grep -v "^$" | sort
cat file.list | grep -v "^$" | uniq
cat file.list | grep -v "^$" | sort
cat file.list | grep -v "^$" | sort | uniq
cat file.list | grep -v "^$" | sort | uniq -c
cat file.list | grep -v "^$" | sort | uniq -c | sort -n
cat file.list | sort | uniq -c | sort -n
The Files used in the video:
----------------------------
File 01: today.csv
San Francisco,43
San Jose,56
New York,23
Pittsburgh,30
Abu Dhabi,78
File 02: file.list
3
3
7
7
7
3
3
4
5
7
6
4
6
66
7
9
2
9
9
9
-----------------------
Thank you for dropping by!
Please join me:
/ paulwpoteete
/ paulwpoteete
/ paulwpoteete
CC by Paul W. Poteete
En esta página del sitio puede ver el video en línea Everything You Need to Start Text Processing in UNIX and Linux! de Duración hora minuto segunda en buena calidad , que subió el usuario The Expat Professor 08 febrero 2023, comparta el enlace con amigos y conocidos, en youtube este video ya ha sido visto 1,479 veces y le gustó like a los espectadores. Disfruta viendo!
