lecture 01 of the system administration and administrator.pdf
Obaid49
125 views
101 slides
May 09, 2024
Slide 1 of 101
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
About This Presentation
System administration
Size: 3.05 MB
Language: en
Added: May 09, 2024
Slides: 101 pages
Slide Content
CS615 - System Administration Slide 1
CS615-SystemAdministration
Department of Computer Science
Stevens Institute of Technology
Jan Schaumann [email protected]
https://stevens.netmeister.org/615/
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 2
New Rules
Closeyourlaptops! (Silencephonesetc.)
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 3
New Rules
Closeyourlaptops! (Silencephonesetc.)
Openyoureyes!
(Mind, too.)
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 4
The Job of a System AdministratorWhatexactlydoes aSystem Administratordo?Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 5
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 6
The Job of a System AdministratorWhatexactlydoes aSystem Administratordo? https://is.gd/8vKPhlLecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 7
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 8
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 9
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 10
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 11
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 12
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 13
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 14
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 15
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 16
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 17
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 18
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 19
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 20
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 21
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 22
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 23
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 24
The Job of a System Administrator
http://www.opte.org/maps/
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 25
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 26
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 27
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 28
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 29
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 30
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 31
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 32
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 33
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 34
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 35
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 36
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 37
The Job of a System Administrator
See also:http://is.gd/WUezLL
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 38
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 39
The Job of a System Administrator
https://www.netmeister.org/blog/duct-tape-and-wd40.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 40
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 41
The Job of a System AdministratorWhatexactlydoes aSystem Administratordo?Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 42
The Job of a System AdministratorWhatexactlydoes aSystem Administratordo?
no precise job descriptionoften learned by experience“makes things run”work behind the scenesoften known as Operator, Network Administrator, System
Programmer, System Manager, Service Engineer, Site Reliability
Engineer etc.
system administrator n.:
one who, as a primary job function, manages computer and network
systems on behalf of another, such as an employer or client.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 43
A rose by any other name... Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 44
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 45
So what is aSystem?“A group of interacting, interrelated, or interdependent elements that
together form a complex whole.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 46
So what is aSystem?“A group of interacting, interrelated, or interdependent elements that
together form a complex whole.”
In the context of this class, we generally considercomputer-human
systemsconsisting of
the computer(s)the networkthe user(s)the organization’s goals and policies
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 47
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 48
The Job of a System Administrator Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 49
The Job of a System Administrator
Computering,atitsheart,
isapeopleproblem.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 50
Choose sides!
https://stevens.netmeister.org/615/teams.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 51
... andAdministration?Merriam Webster:
administer, v:to manage or supervise the execution, use, or
conduct of
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 52
... andAdministration?Merriam Webster:
administer, v:to manage or supervise the execution, use, or
conduct of
SystemAdministration frequently also includes other tasks such as
system design and architecturereliability studiesresource managementsystem fault diagnosis...
...all of which my involve a fair amount ofsoftware development,
programmingandscripting.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 53
Learning System AdministrationSystem Administration is a profession with no fixed career path.
few degree granting programsheavy reliance on practical experiencespecializations in many different areas possiblebreadth of expertise as necessary as depth in some areasbackground knowledge and requirements vary
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 54
Learning System AdministrationBreadth of knowledge:
operating system conceptsTCP/IP networkingprogrammingcloud computing...
Depth of knowledge:
certain OS flavorspecific service (DNS, E-Mail, Databases, Content-Delivery, ...)specific implementation/vendor (Oracle, Hadoop, Apache, Cisco, ...)specific are of expertise (security, storage, network, datacenter, ...)...
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 55
People think the internet looks like this. Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 56
Or like this.
http://www.opte.org/maps/
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 57
SysAdmins know it looks like this. Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 58
SyllabusDates and Topics subject to change:
01/27: Introduction, UNIX history and basics02/03: Filesystems and Disks02/10: Software Installation Concepts02/17: Multi-user basics02/24 - 03/02: Networking03/09 - 03/23: DNS, SMTP, HTTP, HTTPS03/30: Writing System Tools04/06: Monitoring, Backup and Disaster Recovery04/13: Configuration Management04/20: System Security04/27: Ethics and Social Responsibility
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 59
GradingYou are responsible for your work.
Know when assignments are due!
Grading:
course participation, questionnaires, course notesteam missionhomework assignmentsgroup project(s)
Team missions, discussions, announcements etc.:
https://lists.stevens.edu/mailman/listinfo/cs615asa
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 60
GradingYou are responsible for your work.
There are no make-up assignments, no extra credit work at theend of
the semester.
Allocate your time wisely. If medical or family emergenciesarise, contact
meASAP, as late submissions are otherwise not allowed.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 61
Course Notes
create a git repository with a single text file for each lecturebefore each lecture, note:
what you readwhat questions you have
after each lecture:
answers you’ve found, or especially interesting new thingsyou
learned
what questions remainwhat new questions arosewhat additional reading might be relevant
at the end of the semester, submit all your notes
https://stevens.netmeister.org/615/course-notes.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 62
Course NotesLet’s set upgitreal quick...
https://stevens.netmeister.org/615/git.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 63
Hooray!
5MinuteBreak
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 64
Computer Science Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 65
Three Pillars of Exceptional System DesignWe will give particular attention to these three core features:
ScalabilitySecuritySimplicity
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 66
Three Pillars of Exceptional System Design: Scalability
System Overload
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 67
Three Pillars of Exceptional System Design: Scalability
Scaling Vertically
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 68
Three Pillars of Exceptional System Design: Scalability
Scaling Horizontally
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 69
Three Pillars of Exceptional System Design: Scalability
Scaling Down
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 70
Three Pillars of Exceptional System Design: Security Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 71
Three Pillars of Exceptional System Design: Security Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 72
Three Pillars of Exceptional System Design: Security
https://www.netmeister.org/blog/infosec-basics.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 73
Three Pillars of Exceptional System Design: Simplicity Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 74
Three Pillars of Exceptional System Design: Simplicity Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 75
Three Pillars of Exceptional System Design: Simplicity Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 76
Learning is criticalKnow how to find answers:
knowhowto ask questionsknowwhereto ask questionsread criticallyknow what you don’t know (Dunning-Kruger effect)understandwhatyou’re doingunderstandwhyyou’re doing itseek information exchange
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 77
Learning is critical
“ComputerScienceprojectsareopportunities,
notassignments.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 78
Learning is criticalKnow how to find answers:
knowhowto ask questionsknowwhereto ask questionsread criticallyknow what you don’t know (Dunning-Kruger effect)understandwhatyou’re doingunderstandwhyyou’re doing itseek information exchange
https://stevens.netmeister.org/615/meetup.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 79
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 80
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 81
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Hanlon’s Razor:
“Never attribute to malice that which can be adequately
explained by stupidity.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 82
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Hanlon’s Razor:
“Never attribute to malice that which can be adequately
explained by stupidity.”
Pareto’s Principle:
“80% of consequences stem from 20% of the causes.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 83
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Hanlon’s Razor:
“Never attribute to malice that which can be adequately
explained by stupidity.”
Pareto’s Principle:
“80% of consequences stem from 20% of the causes.”
Sturgeon’s Law:
“90% of everything is crud.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 84
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Hanlon’s Razor:
“Never attribute to malice that which can be adequately
explained by stupidity.”
Pareto’s Principle:
“80% of consequences stem from 20% of the causes.”
Sturgeon’s Law:
“90% of everything is crud.”
Murphy’s Law:
“If it can happen, it will happen.”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 85
SysAdmins’ favorite LawsOckham’s Razor:
“Of two equivalent theories or explanations, all other things
being equal, the simpler one is to be preferred.”
2nd Law of Thermodynamics:
“The entropy of an isolated system always increases with time.”
Hanlon’s Razor:
“Never attribute to malice that which can be adequately
explained by stupidity.”
Pareto’s Principle:
“80% of consequences stem from 20% of the causes.”
Sturgeon’s Law:
“90% of everything is crud.”
Murphy’s Law:
“If it can happen, it will happen.”
Throw in some philosophy for good measure:
Causality: For every effect, there must be a cause.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 86
UNIXHistory
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 87
UNIX historyhttps://is.gd/TUOAB2
Originally developed in 1969 at Bell Labs by Ken Thompson and
Dennis Ritchie.
1973, Rewritten in C. This made it portable and changed the history
of OS
1974: Thompson, Joy, Haley and students at Berkeley developthe
BerkeleySoftwareDistribution (BSD) of UNIX
two main directions emerge: BSD and what was to become “System
V”
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 88
Notable dates in UNIX history
1984 4.2BSD released (TCP/IP), 1986 4.3BSD released (NFS)1991 Linus Torvalds starts working on the Linux kernel1993 Settlement of USL vs. BSDi; NetBSD, then FreeBSD are
created
1994 Single UNIX Specification introduced1995 4.4BSD-Lite Release 2 (last CSRG release); OpenBSD forked
off NetBSD
2000 Darwin created (derived from NeXT, FreeBSD, NetBSD)2003 Xen; SELinux2005 Hadoop; DTrace; ZFS; Solaris Containers2006 AWS (”Cloud Computing” comes full circle)2007 iOS; KVM appears in Linux2008 Android; Solaris open sourced as OpenSolaris
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 89
Notable dates in UNIX history
2010 Systemd2011 Chrome OS; rise of Microservices2013 Docker2014 Kubernetes2016 Windows Subsystem for Linux...
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 90
Some UNIX versionsMore UNIX (some generic, some trademark, some just unix-like):
1BSD 2BSD 3BSD 4BSD 4.4BSD Lite 1
4.4BSD Lite 2 386 BSD A/UX Acorn RISC iX AIX
AIX PS/2 AIX/370 AIX/6000 AIX/ESA AIX/RT
AMiX AOS Lite AOS Reno ArchBSD ASV
Atari Unix BOS BRL Unix BSD Net/1 BSD Net/2
BSD/386 BSD/OS CB Unix Chorus Chorus/MiX
Coherent CTIX Darwin Debian GNU/Hurd DEC OSF/1 ACP
Digital Unix DragonFly BSD Dynix Dynix/ptx ekkoBSD
FreeBSD GNU GNU-Darwin HPBSD HP-UX
HP-UX BLS IBM AOS IBM IX/370 Interactive 386/ix Interactive IS
IRIX Linux Lites LSX Mac OS X
Mac OS X Server Mach MERT MicroBSD Mini Unix
Minix Minix-VMD MIPS OS MirBSD Mk Linux
Monterey more/BSD mt Xinu MVS/ESA OpenEdition NetBSD
NeXTSTEP NonStop-UX Open Desktop Open UNIX OpenBSD
OpenServer OPENSTEP OS/390 OpenEdition OS/390 Unix OSF/1
PC/IX Plan 9 PWB PWB/UNIX QNX
QNX RTOS QNX/Neutrino QUNIX ReliantUnix Rhapsody
RISC iX RT SCO UNIX SCO UnixWare SCO Xenix
SCO Xenix System V/386 Security-Enhanced Linux Sinix Sinix ReliantUnix Solaris
SPIX SunOS Tru64 Unix Trusted IRIX/B Trusted Solaris
Trusted Xenix TS UCLA Locus UCLA Secure Unix Ultrix
Ultrix 32M Ultrix-11 Unicos Unicos/mk Unicox-max
UNICS UNIX 32V UNIX Interactive UNIX System III UNIX System I V
UNIX System V UNIX System V Release 2 UNIX System V Release 3 UN IX System V Release 4 UNIX System V/286
UNIX System V/386 UNIX Time-Sharing System UnixWare UNSW US G
Venix Wollogong Xenix OS Xinu xMach
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 91
UNIX Everywhere
Today,yourdesktop,server,cloud,TV,phone,
watch,stereo,carnavigationsystem,thermostat,
doorlock,etc. allrunaUnix-likeOS...
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 92
UNIX Everywhere
Today,yourdesktop,server,cloud,TV,phone,
watch,stereo,carnavigationsystem,thermostat,
doorlock,etc. allrunaUnix-likeOS...
...withalltherisksthatentails.
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 93
UNIXBasics
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 94
UNIX BasicsThe OS is divided into
kernelshelltools & applications
Basic UNIX features:
multitaskingmultiuserportabilitynetworking capabilities
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 95
UNIX BasicsThese features necessitate/result in:
multi-user concepts
user privilegesfile permissionsprocess ownership and prioritiesdisk quotas
security considerations
protect users’ dataprotect communicationprotect superuser account
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 96
UNIX Basics: PipelinesWhat is the longest word found on the ten most frequently retrieved
English Wikipedia pages?
for f in $(curl -L http://is.gd/c6F2fs | zgrep -i "^en " |
sort -k3 -n | tail -10 |
sed -e ’s/en \(.*\) [0-9]* [0-9]*/\1/’); do
links -dump http://en.wikipedia.org/wiki/${f}
done |
tr ’[:punct:]’ ’ ’ |
tr ’[:space:]’ ’\n’ |
tr ’[:upper:]’ ’[:lower:]’ |
egrep ’^[a-z]+$’ |
awk ’{ print length() " " $0; }’ |
sort | uniq | sort -n |
tail -1
See also:https://blog.jessfraz.com/post/for-the-love-of-pipes/
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 97
Program Designhttps://en.wikipedia.org/wiki/Unix_philosophy
UNIX programs...
...are simple...follow the element of least surprise...accept input fromstdin...generate output tostdout...generate meaningful error messages tostderr...have meaningful exit codes...have a manual page
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 98
HWMake sure you have:
an account onlinux-lab.cs.stevens.eduan AWS accountbookmarked the course websitesubscribed to the class mailing liststarted your course notesknow your team and understood your team mission
https://stevens.netmeister.org/615/course-notes.html
https://stevens.netmeister.org/615/s19-hw1.html
https://stevens.netmeister.org/cgi-bin/CS615-02.cgi
https://stevens.netmeister.org/615/filesystems-exercise.html
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 99
TheEnd
Hooray!
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 100
ReadingMiscellaneous:
http://www.opsschool.org/https://archive.is/Akjauhttp://linuxcommand.org/lc3_learning_the_shell.phphttps://is.gd/NNAIIm
UNIX history:
https://www.bell-labs.com/usr/dmr/www/https://www.bell-labs.com/usr/dmr/www/hist.htmlhttp://www.futuretech.blinkenlights.nl/admin/day1a.htmlhttp://www.levenez.com/unix/https://en.wikipedia.org/wiki/Operating_system
Lecture 01: Introduction January 27, 2020
CS615 - System Administration Slide 101
ReadingUNIX basics:
chmod(1), chown(1), ls(1)intro(1), login(1), passwd(5)su(1), sudo(8)
Lecture 01: Introduction January 27, 2020