AWS DevOps Guide and Best Practices Presentation.pdf

Arslan594776 87 views 177 slides Aug 19, 2024
Slide 1
Slide 1 of 177
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62
Slide 63
63
Slide 64
64
Slide 65
65
Slide 66
66
Slide 67
67
Slide 68
68
Slide 69
69
Slide 70
70
Slide 71
71
Slide 72
72
Slide 73
73
Slide 74
74
Slide 75
75
Slide 76
76
Slide 77
77
Slide 78
78
Slide 79
79
Slide 80
80
Slide 81
81
Slide 82
82
Slide 83
83
Slide 84
84
Slide 85
85
Slide 86
86
Slide 87
87
Slide 88
88
Slide 89
89
Slide 90
90
Slide 91
91
Slide 92
92
Slide 93
93
Slide 94
94
Slide 95
95
Slide 96
96
Slide 97
97
Slide 98
98
Slide 99
99
Slide 100
100
Slide 101
101
Slide 102
102
Slide 103
103
Slide 104
104
Slide 105
105
Slide 106
106
Slide 107
107
Slide 108
108
Slide 109
109
Slide 110
110
Slide 111
111
Slide 112
112
Slide 113
113
Slide 114
114
Slide 115
115
Slide 116
116
Slide 117
117
Slide 118
118
Slide 119
119
Slide 120
120
Slide 121
121
Slide 122
122
Slide 123
123
Slide 124
124
Slide 125
125
Slide 126
126
Slide 127
127
Slide 128
128
Slide 129
129
Slide 130
130
Slide 131
131
Slide 132
132
Slide 133
133
Slide 134
134
Slide 135
135
Slide 136
136
Slide 137
137
Slide 138
138
Slide 139
139
Slide 140
140
Slide 141
141
Slide 142
142
Slide 143
143
Slide 144
144
Slide 145
145
Slide 146
146
Slide 147
147
Slide 148
148
Slide 149
149
Slide 150
150
Slide 151
151
Slide 152
152
Slide 153
153
Slide 154
154
Slide 155
155
Slide 156
156
Slide 157
157
Slide 158
158
Slide 159
159
Slide 160
160
Slide 161
161
Slide 162
162
Slide 163
163
Slide 164
164
Slide 165
165
Slide 166
166
Slide 167
167
Slide 168
168
Slide 169
169
Slide 170
170
Slide 171
171
Slide 172
172
Slide 173
173
Slide 174
174
Slide 175
175
Slide 176
176
Slide 177
177

About This Presentation

This document is all about DevOps in AWS. It briefs the best practices of DevOps in AWS. This document will help understand DevOps best practices followed by industry experts


Slide Content

DEVOPSDEVOPS

DevOps is the combination of cultural philosophies,
practices, and tools that increases an organization’s
ability to deliver applications and services at high
velocity
Amazon Web Services(AWS)

DevOps is a collaborative and multidisciplinary effort
within an organization to automate continuous
delivery of new soware versions, while guaranteeing
their correctness and reliability
A Survey of DevOps Concepts and
Challenges - L Leite

DevOps is the outcome of applying the most trusted
principles from the domain of physical manufacturing
and leadership to the IT value stream.
The DevOps Handbook - Gene Kim ,
Patrick Debois, Et al.

DevOps relies on bodies of knowledge from Lean,
Theory of Constraints, the Toyota Production System,
resilience engineering, learning organizations, safety
culture, human factors, and many others.
The DevOps Handbook - Gene Kim ,
Patrick Debois, Et al.

The result is world-class reliability, stability, and
security at ever lower cost and effort; and accelerated
flow and reliability through the technology value
stream, including Product Management,
Development, QA, IT Operations, and Infosec.
The DevOps Handbook - Gene Kim ,
Patrick Debois, Et al.

EVOLUTION TOEVOLUTION TO
DEVOPSDEVOPS

WATERFALLWATERFALL

Waterfall

3 KEYS3 KEYS
TOTO
GREAT SOFTWAREGREAT SOFTWARE

ENHANCED COMMUNICATIONENHANCED COMMUNICATION

Teams

Waterfall

AUTOMATIONAUTOMATION

QUICK FEEDBACKQUICK FEEDBACK

AGILEAGILE

Agile - One Team

Agile - Short Iterations

Agile - Each Iteration

Enhanced Communication

Agile - One Team

Automation

Agile Automation

Quick Feedback

Agile - Retrospectives

Continuous Integration

NEW CHALLENGESNEW CHALLENGES

Microservices

DEVOPSDEVOPS

DevOps - Bring Teams Together

Each Iteration

AUTOMATIONAUTOMATION

Continuous Deployment

Continuous Delivery

IAC - Automate Operations

QUICK FEEDBACKQUICK FEEDBACK

AGILE AND DEVOPSAGILE AND DEVOPS

DEVOPSDEVOPS
Bring Down the Wall

CI CD CDCI CD CD

Continuous Integration

Continuous Deployment

Continuous Delivery

INFRASTRUCTURE ASINFRASTRUCTURE AS
CODECODE

Manual Approach

Microservices

Infrastructure as Code

ADVANTAGESADVANTAGES

Enable Self Provisioning

Infra Team can focus on Value Added
Work

Consistent Servers

Less Errors

Quick Recovery From Failures

CONTAINERIZATIONCONTAINERIZATION

Microservices

Containers

Infrastructure as Code

Infrastructure as Code - Containers

6 DEVOPS TOOLS6 DEVOPS TOOLS
Ā Ā 
Ā Ā 

2 Example DevOps Use Cases

DEVOPSDEVOPS
Multiple DevOps Tools
3 Clouds
Constant Evolution
No Perfect Tool Set

IAC BEST PRACTICESIAC BEST PRACTICES
Self Provisioning
Treat Servers as Disposable
Do not do anything manually
Version Your Infrastructure Code
Do incremental changes
Zero Downtime Upgrades

DOCKERDOCKER
Master DevOps

Traditional Deployment

Deployments using Virtual Machines

Deployments using Docker

Docker Architecture

DOCKER ANDDOCKER AND
DEVOPSDEVOPS
Standardized Communication
More Successful Deployments
No More - "It works in my Local!"
Infrastructure Standardization
Container Orchestration - Kubernetes or AWS ECS
Fargate

NEXT STEPSNEXT STEPS
Explore Docker from Operations Perspective
Pre Built Images
REST API
Web Application talking with MySQL
Docker Compose
Separate Section for Building Docker Images

YOUTUBE, GOOGLE MAPS ANDYOUTUBE, GOOGLE MAPS AND
GOOGLE SEARCHGOOGLE SEARCH
Google Kubernetes Engine (GKE) on
Google Cloud Platform (GCP)!

Go Declarative - Go YAML
Use Helm
Stay Cloud Neutral
Kubernetes Best
Pracises

Naming Server
Load Balancing
Distributed Tracing
Spring Cloud - A Couple Of Years Ago

spring-cloud-starter-kubernetes
spring-cloud-gcp-starter-trace
spring-cloud-gcp-starter-logging
Spring Cloud - In the Cloud World

Update the step referring to Docker to refer to
Appendix Section on Docker.

Google Console Keyboard Shortcuts

Debugging Problems in K8s

Billing

NodePort Example
https://cloud.google.com/kubernetes-
engine/docs/how-to/exposing-
apps#access_your_service

KUBERNETES - FUN FACTSKUBERNETES - FUN FACTS
K8S
KOO - BER - NET - EEZ
Logo - Helmsman
Kubernetes on Cloud
AKS, Amazon EKS and GKE

Kubernetes Architecture

Kubernetes Architecture

Kubernetes Architecture

Kubernetes Architecture

Kubernete Deployments

Kubernete Deployments

Kubernete Deployments

Kubernete Service

Traditional Deployment

Deployments using Virtual Machines

Deployments using Docker

Docker Architecture

MICROSERVICESMICROSERVICES

Microservices Overview

DOCKER ANDDOCKER AND
MICROSERVICESMICROSERVICES

Microservices Chain

EASIER DEVELOPMENTEASIER DEVELOPMENT
Adopt New Technology Faster
Zero worry about deployment procedures
Fewer Environment Issues
No more - "It works in my Local"

EASIER OPERATIONSEASIER OPERATIONS
Consistent Deployment Automation
Across Different Environments and
Different Technologies

KUBERNETES ANDKUBERNETES AND
MICROSERVICESMICROSERVICES

EASIER DEVELOPMENTEASIER DEVELOPMENT
Adopt New Technology Faster
Zero worry about deployment procedures
Fewer Environment Issues
No more - "It works in my Local"

EASIER OPERATIONSEASIER OPERATIONS
Consistent Deployment Automation
Across Different Environments and
Different Technologies

Microservices Multiple Instances

Currency Conversion Service

Currency Exchange Service

TERRAFORMTERRAFORM

PREREQUISITESPREREQUISITES
AWS Account
Visual Studio Code
Terraform Installation

ANSIBLEANSIBLE

PREREQUISITESPREREQUISITES
AWS Account
Visual Studio Code
Ansible Installation
Python 2.7 or 3.4 Installed

ANSIBLE FOR WINDOWSANSIBLE FOR WINDOWS

ANSIBLE DYNAMICANSIBLE DYNAMIC
INVENTORYINVENTORY
Install boto3 and botocore

AZURE DEVOPSAZURE DEVOPS

Continuous Delivery

PREREQUISITESPREREQUISITES
Azure Account
Visual Studio Code
Section : Docker

AZURE DEVOPSAZURE DEVOPS
AZURE AKSAZURE AKS
WITH TERRAFORMWITH TERRAFORM

Azure K8S with Terraform

PREREQUISITESPREREQUISITES
Azure Account
Visual Studio Code
Section : Azure DevOps
Section : Docker
Section : Kubernetes
Section : Terraform

AZURE DEVOPSAZURE DEVOPS
AWS EKSAWS EKS
WITH TERRAFORMWITH TERRAFORM

AWS EKS (Kubernetes) with Terraform

PREREQUISITESPREREQUISITES
WARNING! NOT AWS FREE TIER!
Azure Account
AWS Account
Visual Studio Code
Section : Azure DevOps
Section : Docker
Section : Kubernetes
Section : Terraform

JENKINSJENKINS

Continuous Integration

PREREQUISITESPREREQUISITES
Visual Studio Code
Section : Docker
Docker Compose

IMMUTABLEIMMUTABLE
SERVERSSERVERS

AZURE DEVOPSAZURE DEVOPS
PIPELINESPIPELINES
01-first-azure-pipeline
02-understanding-stages
03-playing-with-environment-deployment
04-build-and-push-docker-image
05-azure-kubernetes-cluster-iaac-pipeline
06-azure-kubernetes-code-ci-cd-pipeline
07-aws-kubernetes-cluster-iaac-pipeline
08-aws-kubernetes-code-ci-cd-pipeline

AZURE DEVOPSAZURE DEVOPS
PIPELINESPIPELINES
07-aws-kubernetes-cluster-iaac-pipeline
08-aws-kubernetes-code-ci-cd-pipeline

Kubernetes Clusters with Terraform

DEVOPS - CAMSDEVOPS - CAMS
Culture
Automation
Measurement
Sharing

DEVOPS METRICSDEVOPS METRICS
Deployment Frequency
Time To Market
Failure Rate of New Releases
Lead Time to Fixes
Mean Time to Recovery

DEVOPS BEST PRACTICESDEVOPS BEST PRACTICES
Standardization
Teams with Cross Function Skills
Focus on Culture
Automate, Automate and ..
Immutable Infrastructure
Dev Prod Parity
Version Control Everything
Self Provisioning

DEVOPS CULTUREDEVOPS CULTURE
What would you do if something is difficult?
Focus on the End Goal
Continuous Improvements
Culture of Learning and Sharing
Local Discoveries > Global Improvements

DEVOPS - 7Cs

DEVOPS MATURITYDEVOPS MATURITY
ASSESSMENTSASSESSMENTS

DEVOPS MATURITY SIGNALSDEVOPS MATURITY SIGNALS
Development
Does every commit trigger automated tests and
automated code quality checks?
Is your code continuously delivered to
production?
Do you use pair programming?
Do you use TDD and BDD?
Do you have a lot of re-usable modules?
Can development teams self provision
environments?
How long does it take to deliver a quick fix to
production?

DEVOPS MATURITY SIGNALSDEVOPS MATURITY SIGNALS
Test
Are your tests full automated with high quality
production like test data?
Does your builds fail when your automated tests
fail?
Are your testing cycles small?
Do you have automated NFR tests?

DEVOPS MATURITY SIGNALSDEVOPS MATURITY SIGNALS
Deployment
Do you have Dev Prod Parity?
Do you use A/B Testing?
Do you use canary deployments?
Can you deploy at the click of a button?
Can you rollback at the click of a button?
Can you provision and release infrastructure at
the click of a button?
Do you use IAC and version control your
infrastructure?

DEVOPS MATURITY SIGNALSDEVOPS MATURITY SIGNALS
Monitoring
Does the team use a centralized monitoring
system?
Can development team get access to logs at the
click of a button?
Does the team get an automated alert if
something goes wrong in production?

DEVOPS MATURITY SIGNALSDEVOPS MATURITY SIGNALS
Teams and Processes
Is the team looking to continuously improve?
Does the team have all the skills it needs from
Business, Development and Operations?
Does the team track the key devops metrics and
improve on them?
Do you have the culture of take Local Discoveries
and using them to make Global Improvements?

DEVOPS TRANSFORMATIONSDEVOPS TRANSFORMATIONS
Leadership Buy-in is Critical
Involves Upfront Costs
Setup COEs to help teams
Choose the right application and team

DEVOPS TRANSFORMATIONSDEVOPS TRANSFORMATIONS
Start Small
Sharing Learings (Newsletters, Communication,
COEs)
Encourage People with Exploration and Automation
Mindset
Recognize DevOps Teams

QUESTIONSQUESTIONS