Intro to Amazon Web Services (AWS) and Gen AI

ortussolutions 1,148 views 139 slides Jul 02, 2024
Slide 1
Slide 1 of 139
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62
Slide 63
63
Slide 64
64
Slide 65
65
Slide 66
66
Slide 67
67
Slide 68
68
Slide 69
69
Slide 70
70
Slide 71
71
Slide 72
72
Slide 73
73
Slide 74
74
Slide 75
75
Slide 76
76
Slide 77
77
Slide 78
78
Slide 79
79
Slide 80
80
Slide 81
81
Slide 82
82
Slide 83
83
Slide 84
84
Slide 85
85
Slide 86
86
Slide 87
87
Slide 88
88
Slide 89
89
Slide 90
90
Slide 91
91
Slide 92
92
Slide 93
93
Slide 94
94
Slide 95
95
Slide 96
96
Slide 97
97
Slide 98
98
Slide 99
99
Slide 100
100
Slide 101
101
Slide 102
102
Slide 103
103
Slide 104
104
Slide 105
105
Slide 106
106
Slide 107
107
Slide 108
108
Slide 109
109
Slide 110
110
Slide 111
111
Slide 112
112
Slide 113
113
Slide 114
114
Slide 115
115
Slide 116
116
Slide 117
117
Slide 118
118
Slide 119
119
Slide 120
120
Slide 121
121
Slide 122
122
Slide 123
123
Slide 124
124
Slide 125
125
Slide 126
126
Slide 127
127
Slide 128
128
Slide 129
129
Slide 130
130
Slide 131
131
Slide 132
132
Slide 133
133
Slide 134
134
Slide 135
135
Slide 136
136
Slide 137
137
Slide 138
138
Slide 139
139

About This Presentation

Sami provided a beginner-friendly introduction to Amazon Web Services (AWS), covering essential terms, products, and services for cloud deployment. Participants explored AWS' latest Gen AI offerings, making it accessible for those starting their cloud journey or integrating AI into coding practi...


Slide Content

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Intro to AWS + Generative AI
Sami Hoda
Senior Solutions Architect, Federal Partners
AWS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcomes
Build and validate an overall understandingof the AWS Cloud and
key terminology, and help advance your AWS Cloud skills
Learn about the foundationsof getting started using AWS Cloud
infrastructure and services in the compute, storage, database,
networking, andsecuritycategories
Understand AWS’s approach to Generative AI

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
What is the cloud? Why AWS?
Understanding AWS global infrastructure
Key services overview
Generative AI

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is the cloud? Why AWS?

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is the cloud?
Cloud computing lets you stop thinking of infrastructure as hardware,
and instead think of it (and use it) as software
Programmable
resources
Pay as
you go
Dynamic
abilities

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is the cloud?
“Cloud computing is the on-demanddelivery of
IT resources over the Internet withpay-as-you-go
pricing.Instead of buying, owning, and maintaining
physical data centers and servers, you can access
technology services, such as computing power,
storage, and databases, on an as-needed basis
from a cloud provider.”

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why customers choose AWS
7
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why customers choose AWS
8
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS 17 Years of Innovation on Behalf of Customers
Customer Obsession is a healthy, long term business strategy
9
200+ Fully featured services, 90% is driven by customers,10% we’ve invented on their behalf
Pioneers
of Customers and Partners. Millions of customers, and more than 100,000 Partners
Largest and most dynamic community
2011
80
New significant
services and
features released
per year
2012
160
2014
516
2015
722
2016
1,017
2017
1,430
2018
1,957
2019
2,345
2020
2,757
2021
3,084
2013
280
2022
3,332
Customer-Focused and Long-Term oriented. We’ve lowered our prices 134 times since 2006
Unusually
2023
3,410

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gartner does not endorse any vendor, product or service depicted in its research publications and does not advise technology users to select only those vendors with the highest ratings or
other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not beconstrued as statements of fact. Gartner disclaims all warranties,
expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. GARTNER is a registered trademark and service mark of
Gartner and Magic Quadrant is a registered trademark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and are used herein with permission. All rights reserved. This graphic
was published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from
AWS.
Longest-running Magic
Quadrant Leader –
Gartner names AWS a Leader
for the 13th consecutive year.
10

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Source: IDC Worldwide Semiannual Public Cloud Services Tracker-Foundational Services, 2H, 2022
41%
21%
6%
5%
2%
25%
Amazon Web Services MicrosoftGoogle Alibaba Group IBM Others
$169.1B
State of Cloud -2022
Market share analysis by analysts, Gartner and IDC
Source: Gartner: Worldwide IaaS Public Cloud Services Market Share, 2022
40%
22%
7%
8%
23%
Amazon Web Services MicrosoftGoogleAlibaba GroupOthers
$120.3B
Gartner IDC
11

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why customers choose AWS
12
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community…
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The AWS Cloud spans 105 Availability Zones within 33
geographic regions around the world, with announced
plans for 18 more Availability Zones and 6 more AWS
Regions in Malaysia, Mexico, New Zealand, the Kingdom
of Saudi Arabia, Thailand, and the AWS European
Sovereign Cloud.
With AWS Local Zones, you can easily run highly-
demanding applications that require single-digit
millisecond latencies to your end-users.
Amazon CloudFront uses a global network of 600+
Points of Presence (400+ Edge locations and 13 regional
caches) in 90+ cities across 48 countries.
And If your data lives off this planet, you can use AWS
Ground Station, which provides satellite antennas in
close proximity to AWS infrastructure Regions
A secure, extensive, sustainable, and
reliable Global Cloud Infrastructure
See interactive map
200+ fully featured services from
data centers globally
Amazon is on a path to powering its
operations with 100% renewable
energy by 2025—five years ahead
of its original target of 2030
13

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Region design
14
AWS Regions are comprised of multiple AZs for high availability,
highscalability, andhigh fault tolerance. Applications and data are
replicated in real time and consistent inthe different AZs.
REGION A V A I L A B I L I T Y Z O N E
(AZ)
Data centers
12
N
12
N
12
N
AVAILABILIT
Y
ZONE (AZ)
Distance ensures high
availability
Low latency ensures real-
time data replication

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
15
1.43k
5.41k
28.38k
92k
0.00k 20.00k 40.00k 60.00k 80.00k 100.00k
AWS
Next provider
Next provider
Next provider
AWS Next providerNext providerNext provider
Higher Downtime & Security incidents
haver bigger impact on customers’ costs
Source: IDC: Annual Fortume 1000 application downtime costs Study
PonemonInstitute: Cost of Data Center Outages, ; updates and stats
* Sources: Public Status Pages for Cloud Providers
AWS Cloud Infrastructure Designed to Scale with Highest Availability
AWS Investments on Underlying Higher Resilient Infrastructure translates into lower costs to customers
Global Service Disruption Hours (Public) by Provider in 2023
Service disruption hours published = Downtime hours published * Regions Impacted * Services Impacted

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
16
AWS supports more security standards and compliance certifications than
any other offering, including PCI-DSS, HIPAA/HITECH, FedRAMP, GDPR,
FIPS 140-2, and NIST 800-171, helping satisfy compliance requirements for
virtually every regulatory agency around the globe.
All AWS services that store customer data offer the ability to encrypt that
data.
Security and Compliance

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why do customers choose AWS
17
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community…
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
High volume / low margin businesses are in our core DNA
Trade capital
expense for
variable expense
Our economies of
scale provide us
with lower costs
134 price
reductions
since 2006
Pricing model
choice to support
variable and
stable workloads
On-demand
Savings Plans
Reserved Instances
Spot
Save more money as
you grow bigger
Tiered pricing
Volume discounts
Custom pricing
Pay for what
you use
Pricing Philosophy
18

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic
Container Service
(Amazon ECS)
Amazon
EMR
AWS
CloudFormation
AWS Batch Amazon EC2
Auto Scaling
Amazon Elastic
Kubernetes Service
(Amazon EKS)
EC2 Fleet AWS
Thinkbox
AWS services make this easy and efficient
S C A L E U S I N G S P O T
F O R F L E X I B L E ,
F A U L T-T O L E R A N T
W O R K L O A D S
S C A L E U S I N G ON-D E M A N D
F O R N E W O R S T A T E F U L
S P I K Y W O R K L O A D S
U S E R I s A N DS A V I N G S P L A N S
F O R K N O W N /
S T E A D Y-S T A T E W O R K L O A D S
Simplifying capacity and cost optimization
19

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PlanSave RunSee
Planning and
forecasting
Cost
optimization
Cloud financial
operations
Measurement and
accountability
https://aws.amazon.com/aws-cost-management
AWS Budgets, AWS Organizations,
AWS Cost Tags, Compute Optimizer
AWS IAM ,Billing Console,
AWS Anomaly Detection,
AWS Cost Profiler, AWS
Instance Scheduler , EC2
Auto Scaling
AWS Cost Explorer, AWS Cost &
Usage Reports, AWS Cost
Categories, AWS Credits, AWS
Billing Conductor
Savings Plans, Reserved
Instances, Spot Instances,
Right Sizing, AWS Free tier
AWS Cloud Financial Management (CFM) -FinOps
Manage, optimize, and plan AWS cost and usage
20

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why do customers choose AWS
21
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community…
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do we organize for innovation?
22
»Culture
Customer obsession, hire builders, let them build, support
them with a beliefsystem
»Mechanisms
Encoded behaviors that facilitate innovative thinking
»Architecture
Structure that supports rapid growth and change
»Organization
Small, empowered teams that own what they create

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hire and
Develop the
Best
Frugality
Deliver
Results
Are Right, A Lot
Dive Deep
Earn Trust
Ownership
Think Big
Have Backbone;
Disagree and
Commit
Invent and
Simplify
Bias for Action
Insist on the
Highest Standards
Customer
Obsession
Learn and
Be Curious
Strive to be Earth’s
Best Employer
Success and Scale
Bring Broad
Responsibility
https://www.amazon.
jobs/en/principles
Our Leadership Principles
23

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why do customers choose AWS
24
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community…
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
429
266
257
316
512
389
380
103
192
317
204 207
238
419
295
207
56
136
247
87
171 171
302
204
195
29
45
0
100
200
300
400
500
600
Compute Storage Networking &
CDN
Security,
Identity,
Compliance
Databases Analytics AI/ML Migration IoT
Number of Total Cloud Features by Cloud Provider
AWS Next ProviderNext Provider2
Breadth and Depth of Cloud Services
Source: AWS Functionality Matrix (as of August 2023)
25

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Right compute for the right application and workload
Intel
®
Xeon
®
Scalable
(Skylake) processor
AMD EPYC processorNVIDIA V100
Tensor Core GPUs
FPGAs for custom
hardware acceleration
AWS Graviton
Processor (arm)
Choose your processor and architecture
26

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
27
Analytics
Analytics
Data Exchange
Data Lake
Data Pipelines
Data Warehouse
Elasticsearch
Streaming
ETL
Hadoop / Spark
Interactive SQL Queries
Visualizations
Business Applications
Contact Center
Sharing & Collaboration
Online Meetings & Chat
Voice-Enabled Workplace
Unified Communications
Mobile & Web Apps Without
Programming
Blockchain
Blockchain Templates
Ledger Database
Managed Blockchain
Security, Identity, and Compliance
Access Control
Assessment & Reporting
Configuration Compliance
Data Protection
DDOS Protection
Identity Management
Key Management & Storage
Monitoring & Logging
Resource Management
Threat Detection
Web Application Firewall
Storage
Archive Storage
Backup & Restore
Block Storage
Data Transfer
Edge Processing & Computing
File Storage
High-Performance File System
Hybrid Cloud Storage
Object Storage
Unified Communications
Windows File System
Database
Aurora, a high-performance,
relational database Built
for the Cloud
Managed SQL Server
Managed MariaDB
Managed MySQL
Managed Oracle
Managed PostgreSQL
Document Database
Graph Database
In-Memory Caching
Key-Value Store Database
Ledger Database
Time Series Database
Development Tools
Analyze and Debug
Application Lifecycle
Management
Authoring
Build & Test
Containers
DevOps Resource
Management
One-Click App Development
Patching
Pipeline Orchestration
Resource Templates
Triggers
Compute
Compute
Auto-Scaling
Batch Jobs
Event-Driven Serverless
Computing
Instance Types
Managed Virtual Private Servers
Managed Repository for
Serverless Apps
Run & Manage Web Apps
Serverless Compute
Virtual Servers
Containers
Container Service
Managed Kubernetes
Store & Retrieve Docker Images
Media Services
Live Video Transport
Media Storage
Transcoding
Video Origination & Packaging
Video Personalization &
Monetization
Video Processing & Delivery
Video Streaming Analysis
Hybrid Architecture
AWS Services on Premises
Data Integration
Integrated Devices & Edge
Systems
Integrated Identity & Access
Integrated Networking
Integrated Resource &
Deployment Management
VMWare Cloud on AWS
Integrated SG
Internet of Things (IOT)
Rules Engine
Device Analytics
Device Gateway
Device SDK
Device Shadows
Event Detection & Response
Local Compute
Local Data Collection
Management & Security
Microcontroller Operating
System
Registry
Visual Applications
Development
Machine Learning (ML)
ML Frameworks
Deep Learning AMIs &
Containers
Hardware Acceleration
ML at the Edge
TensorFlow, PyTorch, MXNet
Sagemaker
Automatic Model Tuning
Data Labeling
Hosted Notebooks
ML Marketplace
Model Hosting
Model Optimization
Model Training
Pre-Built Algorithms
Topic Modeling
Deep Learning Models
Reinforcement Learning
Spot Instances
Batch Predictions
Real-Time Predictions
AI Services
Chatbots
Entity Extraction
Face Analytics
Face Search Forecasting
Image Labeling
Natural Language Processing
Personalization &
Recommendation
Sentiment Analysis
Speech Translation
Text & Data Extraction
Text to Speech Translation
Video & Image Analysis
Content Moderation
Breadth and Depth of Services: 200+ fully featured services

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why do customers choose AWS
28
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community…
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
29
The AWS Partner Network (APN) is a global
community of partners that leverages programs,
expertise, and resources to build, market, and sell
customer offerings.
The AWS Partner Network has more than
100,000 Partners from more than 150 countries,
with almost 70% headquartered outside of the
United States.
Quick Starts are built by Amazon Web Services
(AWS) solutions architects and partners to help
you deploy popular technologies on AWS, based
on AWS best practices for security and high
availability. There are more than 350 Quick Starts
published.
AWS Marketplace is a digital catalog with thousands of
software listings from independent software vendors that
make it easy to find, test, buy, and deploy software that runs
on AWS.
partner
network
Community of customers and partners

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
30
Global portfolio of customers in 190 countries

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More than 100,000 customersuse AWS for ML
31

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS positioned as a Leader in the Gartner Magic Quadrant for Cloud
Infrastructure as a Service, WorldwideEnterprise Leader
Helping millions of customers since 2006. Best availability track record.
Running a wide variety of use cases at greater scale than any cloud provider.
Most Proven Operational Experience
Continuous improvement. Culture of cost reductions and passing savings to
customers. 134 Price reductions since 2006
Long-Term Value
200+ fully featured services to support any cloud workload.
Unique silicon to power off-load compute, networking and I/O. Best price/
performance ratio with Graviton.
Breadth & Depth
AWS has millions of active customers every month.
The AWS Partner Network has more than 100,000 Partners from more than
150 countries, with almost 70% headquartered outside of the United States.
Largest and most diverse Community
of Customers and Partners
Recognized as the most innovative public cloud provider. Fastest pace of
innovation
Culture of Innovation
What Sets AWS Apart
32

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The economics of cloud
Lost opportunity
Key
Predicted demand
Traditional hardware
Actual demand
AWS
Time
Infrastructure cost ($)
Large capital expenditure
Opportunity cost

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cost savings (TCO)
20% reduction in IT
infrastructure costs as a
percentage of revenue
What is it?
Infrastructure cost
savings/ avoidance from
moving to the cloud
Tactical impact Strategic impact
Staff productivity
66% increase in VMs
managed per server
admin
What is it?
Efficiency improvement
byfunction on a task-by-
taskbasis
Operational resilience
69% reduction in
unplanned downtime
What is it?
Benefit of improving
SLAsand reducing
unplanned outage
Business agility
43% reduction in time-
to-market for new
application features
What is it?
Deploying new features/
applications faster and
reducing errors
Sustainability
88% reduction in
workload carbon
footprint
What is it?
Minimizing
environmental impact
of operations
AWS has been helping enterprises for 14+ years

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS reduces IT investment risk
Using AWS is a two-way door decision
Investing in a data center
tends to be an irreversible,
one-way door decision
Leveraging AWS
represents a reversible,
two-way door decision

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Innovate with AWS
On-premises
20%
80%
New technology Keeping the lights on
AWS Cloud
20%
40%
40%
Keeping the lights on Transformation Savings

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Questions to consider when
evaluating cloud vendors
G L O B A L
I N F R A S T R U C T U R E
What is the underlying
architecture and design of
this to enable High
Availability and
synchronous replication?
S E C U R I T Y
How many third-party
attestations and security
features do the vendors
have?
Do they have
international customers
that can attest to this?
I N N O V A T I O N
Is the vendor investing for
the long term and have
demonstrated capability
with reference customers
taking advantage of
innovative services?
C O S T
What is the philosophy of
the company when it comes
to cost? Is it economies of
scale driven for long term or
is it undercutting the market
or credits for the short term?
Have you evaluated price to
features across vendors?

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why customers choose AWS
E X P E R I E N C E
18 years
helping millions
of customers
G L O B A L R E A C H
33 Regions
spanning 105
Availability Zones and over
135 Direct Connect
locations
S E C U R I T Y
300+
security features
I N N O V A T I O N
200+
service offerings
A W S I N F R A S T R U C T U R E
3.6x+
energy efficient than the
median of surveyed U.S.
enterprise data centers
TCO
134
price reductions
since 2006
E C O S Y S T E M
12,000
software listings from
2,000ISVs
Source: AWS Approved Public Stats

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Understanding the AWS Global Infrastructure
REGION
A physical location where we
cluster data centers. Each
Region consists of a minimum
of three isolated, and
physically separate AZ’s.
A V A I L A B I L I T Y Z O N E
(AZ)
One or more discrete data
centers with redundant power,
networking, and connectivity
in an AWS Region.
L O C A L Z O N E S
AWS Local Zones place
compute, storage, database,
and other AWS services closer
to end-users so you can run
latency-sensitive applications
and meet data residency
requirements in more locations
P O I N T S O F P R E S E N C E
Reduce latency by delivering
data through 600+ globally
dispersed Points of Presence
(PoPs) with automated
network mapping and
intelligent routing using
Amazon CloudFront.
W A V E L E N G T H Z O N E S
AWS infrastructure
deployments that embed AWS
services within
telecommunications providers’
data centers at the edge of the
5G network.
D I R E C T C O N N E C T
L O C A T I O N S
The Direct Connect service
establishes a private, physical
network connection between
AWS and your data centeror
office environment –
bypassing the public internet.
O U T P O S T S
AWS Outposts are a family of
fully managed solutions
delivering AWS infrastructure
and services to virtually any
on-premises or edge location
for a truly consistent
hybrid experience.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Regional Expansion
33 total regions with 4 coming soon
2006-2011
8 New Regions
N. AMERICA
Northern Virginia
Northern California
Oregon
GovCloud US-West
S. AMERICA
São Paulo
EUROPE
Ireland
ASIA PACIFIC
Singapore
Tokyo
2012-2017
10 New Regions
N. AMERICA
Ohio
Canada Central
EUROPE
Frankfurt
London
Paris
ASIA PACIFIC
Seoul
Mumbai
*Beijing
*Ningxia
AUSTRALIA &
NEW ZEALAND
Sydney
2018-2023
15 New Regions
N. AMERICA
GovCloud US-East
Canada West
EUROPE
Stockholm
Milan
Zurich
Spain
MIDDLE EAST
Bahrain
UAE
Tel Aviv
ASIA PACIFIC
Hong Kong
Osaka
Jakarta
Hyderabad
AFRICA
Cape Town
AUSTRALIA &
NEW ZEALAND
Melbourne
COMING SOON
4 New Regions
EUROPE
Germany
ASIA PACIFIC
Thailand
Malaysia
AUSTRALIA &
NEW ZEALAND
Auckland

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability zones design for resiliency
Distance ensures
high availability
Low latency
ensures real-time
data replication
1 2
N
1 2
N
1 2
N
REGION
A V A I L A B I L I T Y
Z O N E ( A Z )
I S O L A T E D P A R T I T I O N
Fully isolated with one or more datacenters
D I S T A N C E
Physically separated by a meaningful distance –
all within 60 miles (100km) of each other
I N T E R C O N N E C T I O N
Datacenters connected via fully redundant and
isolated metro fiber
POWER
Highly available, fault tolerant, and scalable
100K+ servers at scale

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Global Infrastructure
KEY
Region
Local Zone
Direct Connect
Edge location
Multiple edge locations
Regional Edge caches

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary
›Cloud computing eliminates undifferentiated work including
infrastructure procurement, maintenance, and capacity planning
›Organizations leverage AWS to reduce the opportunity cost
of underutilized technology and scale to meet demand
›Organizations realize quantifiable benefits including cost savings, staff
productivity, operational resilience and business agility when using AWS
›Inherit global security and compliance controls when using AWS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Core services overview

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Compute
Compute for any workload—instances, containers, and serverless computing
Pay as you go: $/compute-hr, $/month
Savings Plans, Reserved Instances, EC2 Spot Instances, autoscaling, scheduling, rightsizing,
modernization, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Compute services landscape
AWS manages Customer manages
Data source integrations
Physical hardware, software,
networking, and facilities
Provisioning
Application code
Container orchestration, provisioning
Cluster scaling
Physical hardware, host OS/kernel,
networking, and facilities
Application code
Data source
integrations
Security config and updates
Network config
Management tasks
Container orchestration control plane
Physical hardware software, networking,
and facilities
Application code
Data source integrations
Work clusters
Security config and updates,
network config, firewall,
management tasks
Physical hardware software,
networking, and facilities
Application code
Data source integrations
Scaling
Security config and updates
Network config
Management tasks
Provisioning, managing scaling
andpatching of servers
AWS Lambda
Serverless functions
AWS Fargate
Serverless containers
Amazon ECS/EKS
Container-management
-as-a-service
Amazon EC2
Infrastructure-as-a-Service
Less
More
Opinionated

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
T4g
General
Purpose
M5T3
T3a M5a
M5
Compute
Optimized
C5 C5n
Memory
Optimized
Accelerated
Computing
Storage
Optimized
R5 X2iednX1
R6a
R5
Z1d
Z1d
G3 F1P2 H1D3
I3
I3
C5
metal
General
Purpose
Burstable
performance
Big Data
Optimized
Dense
Storage
Memory
Optimized
Memory
Intensive
In-memoryCompute +
network up to
100 Gbps*
High I/O
Graphics
Intensive
Compute
Intensive
FPGA
General
Purpose GPU
Compute and
Memory
Intensive
Local storage
(NVMeSSD)
M5d
C5d R5d
AWS
Graviton
I3en
u-
24tb1
M7g C7g R7g
G5
G5g Im4gn
C7gn X2gd
Instance Types
48

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage
A reliable, scalable, and secure place for your data
Pay as you go: Storage space provisioned vs. used, $/read, $/write
Infrequent access tiers, rightsizing, batching reads/writes, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Services
BLOCK
Amazon
EBS
Amazon EFS
Amazon FSx for
Windows File Server
FILE
Amazon FSx
for Lustre
OBJECT
Amazon
S3
AWS Snowball
Edge
AWSSnowconeAWS Storage
Gateway
AWS SnowmobileAWS
DataSync
AWS Transfer
Family
DATA TRANSFER AND EDGE PROCESSING
Amazon FSxfor
NetApp ONTAP
Amazon FSx for
OpenZFS
BACKUP
AWS
Backup
Amazon File
Cache

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database
The broadest selection of purpose-built databases for all your application needs
Pay as you go: $/compute-hr, storage space provisioned vs. used, $/read, $/write
Infrequent access tiers, rightsizing, batching reads/writes, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Purpose Built Databases

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Analytics
Fastest way to get answers from all your data to all your users
Pay as you go: $/compute-hr, $/query, storage space provisioned , $/user
Reserved Instances, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Networking and content delivery
The global cloud network for every workload
Pay as you go: Data transfer out (DTO), $/request
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security, identity, and compliance
Secure your workloads and applications in the cloud
Pay as you go: $/check, $/events analyzed, DTO, $/rule, $/request, $/S3 bucket evaluated
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
AWS Security, Identity, and Compliance Solutions
AWS Identity and Access
Management (IAM)
AWS IAM Identity Center
(successor to AWS SSO)
AWS Organizations
AWS Directory Service
Amazon Cognito
AWS Resource Access
Manager
AWS Security Hub
Amazon GuardDuty
Amazon Inspector
Amazon CloudWatch
AWS Config
AWS CloudTrail
VPC Flow Logs
AWS IoT
Device Defender
AWS Firewall Manager
AWS Network Firewall
AWS Shield
AWS WAF
Amazon VPC
AWS PrivateLink
AWS Systems Manager
Amazon Macie
AWS Key Management Service
(KMS)
AWS CloudHSM
AWS Certificate Manager
AWS Secrets Manager
AWS VPN
Server-Side Encryption
Amazon Detective
Amazon EventBridge
AWS Backup
AWS Security Hub
AWS Elastic Disaster
Recovery
Identity and access
management
Infrastructure
protection
Incident
response
AWS Artifact
AWS Audit Manager
Amazon CloudWatch
AWS CloudTrail
AWS Config
AWS Security Hub
AWS Systems
Manager
Data
protection
Privacy and
Compliance
Detective
controls

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Management and governance
Implement control but maintain or increase business agility
Pay as you go: $/metric, $/event, $/apicall, AWS Support, Free
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application integration
Integrate distributed systems and serverless applications with less code
Pay as you go: $/state transition, $/flow, $/published event, $/compute-hr.
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Internet of Things (IoT)
IoT services for industrial, consumer, and commercial solutions
Pay as you go: $/min-connection, $/message, $/device, $/update, $/searches
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Compute

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic Compute Cloud (Amazon EC2)
•Complete control of your computing resources
•Resizable compute capacity
•Reduced time required to obtain and boot
new server instances
•Over 475 types of compute instances
Amazon
EC2

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What’s your use case?
I N S T A N C E T Y P E D E T A I L S
General
purpose
Compute
optimized
Memory
optimized
Accelerated
computing
Storage
optimized
Instancetypes
a1, m4, m5,
t2, t3
c4, c5
r4, r5,
x1, z1
f1, g3, g4,
p2, p3
d2, h1, i3
Use case
Broad High
performance
In-memory
databases
Machine
learning (ML)
Distributed file
systems

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Auto Scaling
Su M T W Th F Sa
Used capacity
(demand)
Provisioned capacity
•Helps you maintain application
availability
•Enables you to automatically add or
remove EC2 instances, according to
conditions you define
•Detects impaired EC2 instances and
unhealthy applications, and replaces
the instances without intervention
•Provides several scaling options:
Manual, scheduled, dynamic or
on demand, and predictive

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless computing

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is serverless?
Building and running applications and services without
managing servers
No servers to
provision or manage
Never pay
for idle
Scales
with usage
Availability and
fault tolerance built in

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Lambda
•Fully managed compute service
•Supports multiple languages
•Runs stateless code
•Runs your code on a schedule or in
response to events, such as changes
to data in an Amazon S3 bucket or
Amazon DynamoDB table
•Per millisecond pricing
AWS
Lambda

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Web
applications
Static websites
Complex web
applications
Packages for
Flask and
Express
Data
processing
Real time
MapReduce
Batch
ML inference
Chatbots
Powering
chatbot logic
Backends
Applications
and services
Mobile
Internet of
Things (IoT)
Amazon
Alexa
Powering
voice-enabled
applications
Alexa
Skills Kit
IT
automation
Policy engines
Extending
AWS services
Infrastructure
management
Serverlessapplication use cases

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Containers

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Running containers on AWS
Amazon Elastic
Container
Service
(Amazon ECS)
Remove the complexity of standing up the
infrastructure
Orchestrate the execution of containers
Maintain and scale the fleet of nodes
running your containers
Amazon Elastic
Kubernetes
Service
(Amazon EKS)

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2. Storage

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS storage options
Amazon Simple Storage
Service (Amazon S3)
Scalable, highly durable
object storage in the cloud
Amazon Elastic File System
(Amazon EFS)
Scalable network file storage
for Amazon EC2 instances
Amazon S3 Glacier
Low-cost, highly durable
archive storage in the cloud
Amazon Elastic Block Store
(Amazon EBS)
Network-attached volumes that
provide durable block-level storage
for Amazon EC2 instances

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon S3
Object-level
storage
Designed for
99.999999999%
durability
Event triggers
Amazon
S3
Use cases
•Content storage and distribution
•Backup and archiving
•Big data analytics
•Disaster recovery
•Static website hosting

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EBS
•Persistent network-attached
block storage for instances
•Different drive types
•Scalable
•Pay only for what
you provision
•Snapshot functionality
•Encryption available
Amazon EBS volumes
EC2
instance
EC2
instance
AWS Cloud
Monday’s snapshot
Tuesday’s snapshot
Wednesday’s snapshot
Thursday’s snapshot
Friday’s snapshot
Detach and reattach volumes
to other EC2 instances
Create volume snapshots
for backup and recovery

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EFS
Performant and
cost optimized
Serverless
shared storage
Full AWS compute integration Four storage classes
Serverless and scalable
Simple and
highly reliable
Elastic
Highly durable and available
Performant

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3. Databases

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Purpose-built databases
Amazon
RDS
Amazon
Aurora
Amazon
Redshift
Relational
database
Nonrelational
key value
Amazon
DocumentDB
Amazon
DynamoDB
Nonrelational
document
Amazon
Neptune
Nonrelational
graph
Amazon
QLDB
Nonrelational
ledger
Amazon
ElastiCache
Nonrelational
In memory

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS
Set up, operate, and scale a relational database in the cloud with just
a few clicks
Database engines
Easy to set up
and operate
ScalesAmazon RDS
Amazon Aurora
MySQLORACLE
Microsoft
SQL Server

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora
MySQL-and PostgreSQL-compatiblerelational databasebuilt for the cloud
High
availability
and durability
High
performance
Compatible
Multi-Region
Amazon Aurora
High
scalability

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB
Fast and flexible NoSQL database service for any scale
Fully
managed
Fast,
consistent
performance
Fine-grained
access control
Flexible
Amazon DynamoDB

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
4. Networking

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon VPC
Amazon
VPC
Provides logical
isolation for
your workloads
Dev Test
Allows custom access
controls and security
settings for your resources
Your private
network space in
the AWS Cloud
VPC
AWS Cloud

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example
Amazon EC2
Auto Scaling
group
EC2 instances
Amazon VPC
Clients
Amazon
Route 53
Amazon
ELB
Internet
gateway

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
5. Security

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Highest standards for privacy and data security
Encryption at scale
with keys managed by
our AWS Key Management
Service (KMS) or managing
your own encryption keys
with AWS CloudHSMusing FIPS
140-2 Level 3 validated HSMs
Meet data residency
requirements, choose
an AWS Region and AWS will
not replicate it elsewhere
unless you choose to do so
Comply with local
data privacy laws
by controlling who
can access content, its
lifecycle, and disposal
Access services and tools
that enable you to
build compliant
infrastructure
on top of AWS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shared responsibility model
AWS
Security of
the cloud
AWS is responsible for
protecting the infrastructure
that runs all of the services
offered in the AWS Cloud
Security in
the cloud
Customer responsibility will
be determined by the AWS
Cloud services that a
customer selects
CUSTOMER

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shared responsibility model
Customer
responsibility
AWS
responsibility
AWS foundation services
Compute Storage Databases Networking
AWS global infrastructure
Availability ZonesRegions Edge locations
Platform, applications, and identity and access management (IAM)
Operating system, network, and firewall configuration
Customer data
Network traffic
protection (encryption,
integrity, identity)
Client-side data
encryption and data
integrity authentication
Server-side encryption
(file system/data)

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Compliance
Find out more: https://aws.amazon.com/compliance/

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security, identity, and compliance service
category
AWS security, identity,
and compliance services
AWS Identity and Access
Management (IAM)
AWS Artifact
AWS KMS
AWS Shield
And more . . .

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Identity and Access Management (IAM)
•Securely control access to your AWS resources
•Assign granular permissions to users, groups,
or roles
•Share temporary access to your AWS account
•Federate users in your corporate network or
with an internet identity provider
AWS IAM

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Trusted Advisor
Provides guidance to help you reduce cost, increase performance,
and improve security

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pricing

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pay for what
you use
Pay less when
you reserve
Pay less with
volume-based
discounts
Pay even less
as AWS grows
AWS pricing concepts

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Free Tier
Enables you to gain hands-on experience with
the AWS platform, products, and services at no cost
https://aws.amazon.com/free
Always free 12 months
free
Trials

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 purchasing options
On-Demand
Instances
Reserved
Instances
Savings
plans
Spot
Instances
•Charged per
hour/second
•Short-term
•Unpredictable
workloads
•Discount for
1-to 3-year
commitments
•Larger upfront
payment for greater
discount
•Up to 90% discount
•Applications with
flexible start and end
times
•Urgent computing
needs for large
amounts of capacity

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved
Reimagine the experience across the
entire software development lifecycle
Amazon Q Developer

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MORE THAN
of enterprises will have
used generative AI APIs
or deployed generative
AI-enabled apps by
2026
1
ACCORDING TO GARTNER, INC.®
1
Gartner, “More than 80% of Enterprises,” October 11, 2023.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
INFRASTRUCTURE FOR FM TRAINING AND INFERENCE
GPUs AWS
Inferentia
AWS
Trainium
Amazon
SageMaker
Amazon EC2
Capacity Blocks
AWS
Neuron
Amazon EC2
UltraClusters
Elastic Fabric
Adapter (EFA)
AWS
Nitro
TOOLS TO BUILD WITH LLMs AND OTHER FMs
Amazon Bedrock
GuardrailsAgentsCustomization capabilities
Generative AI stack
APPLICATIONS THAT USELLMs AND OTHER FMs
Amazon Q
Business
Amazon Q
Developer
Amazon Q in
QuickSight
Amazon Q in
Connect

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q, a generative AI–powered assistant from AWS
AMAZON Q BUSINESSAMAZON Q DEVELOPER
In-built privacy and security Customizable to your business
Benefits
Developers IT professionals Employees Business analystsPersonas

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
< one hour coding time
The median developer spends less than onehour a day writing code
1
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved
99
73% 27%
of time is spent
on running and
maintaining applications
of time is spent
on innovation and
transformation
1
Software.com, “Global Code Time Report,” January 2022.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where are developers
spending time in the SDLC?
Test and
secure
Operate
Plan
Create
Maintain and
modernize
Plan
•Find accurate and specific technical
guidance from relevant documentation,
code examples, resources, and so on
•Design changes based on business
and technical requirements
Create
•Generate code
•Manage infrastructure
Test and secure
•Apply proper test cases for code changes
•Scan for security vulnerabilities in code
Operate
•Identify and mitigate code issues
•Monitor performance and efficiency
Maintain and modernize
•Modernize and update old code
languages and dependencies

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q
Developer
Reimagines the experience across the entire
software development lifecycle (SDLC)
Helps developers and IT professionals build and manage
secure, scalable, and highly available applications
Helps you write, debug, test, optimize, and
upgrade your code faster
Converses with you to explore new AWS capabilities,
learn unfamiliar technologies, and architect solutions
Amazon Q is built with security and privacy in mind from the start, making
it easier for organizations to use generative AI safely.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q supports developers
across the SDLC
Plan
•Amazon Q Developer in theAWS Management Console (best
practices, AWS WAF, Amazon EC2 instance optimization)
•Business-specific application
•Explain code with conversational coding
Create
•Inline coding companion in IDE and CLI
•Software development
•Conversational coding
Test and secure
•Unit test generation
•Security scanning and remediation
Operate
•Troubleshoot errors (Amazon S3, AWS Lambda, Amazon
EC2, Amazon Elastic Kubernetes Service)
•VPC Reachability Analyzer
•Debug and optimize code with conversational coding
•Helps you optimize your AWS resources and costs [NEW]
Maintain and modernize
•Update code with Amazon Q Developer Agent for
code transformation
Test and
secure
Operate
Plan
Create
Maintain and
modernize

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q is available where you do your work
Amazon
CodeCatalyst
AWS consoles IDEs AWS documentation
Slack and Teams
(through AWS Chatbot)
AWS Console
Mobile Application

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Explore and plan
Ask questions and
get guidance from
17 years of AWS
knowledge, best
practices, well-
architected advice
Create a business-
expert application
using your data,
systems, and more.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Create
Generate code
Explain code
Help understand
your code base
Customizable
to your code

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Advanced capability: Amazon Q Developer
Agent for software development
Amazon Q Developer
Agent for software
development can help
you write and
implement entire
application features in
minutes right from a
simple natural language
prompt in your IDE, with
interactive step-by-step
instructions, code, tests,
and best practices.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Test and secure
Generate unit tests
Scan entire project
for security
vulnerabilities
Generate
remediations to
improve security
and code quality

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Operate
Diagnose and
troubleshoot
errors in the
console
Analyze
network
connectivity
and VPC
reachability

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q Developer knows your AWS account resources and billing
List, describe, and
get guidance
based on
resources in your
AWS account
Retrieve and
analyze cost data
from AWS Cost
Explorer (preview)

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build
and test
(Java 8)
Apply
knowledge
base
Build
and test
(Java 17)
Gen AI
fixes
errors
Upgraded
code
Source
code
M O D E R N I Z E L A N G U A G E V E R S I O N S I N A F R A C T I O N O F T H E T I M E
Maintain and modernize: Amazon Q Developer Agent for
code transformation
Knowledge
database

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Q
Developer Agent
for code
transformation
Automates the complete
process of upgrading
and transforming code

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Java applications Minutes each,
on average
Days
Amazon Q
Developer Agent
for code
transformation

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Retire tech debt at scale
Modernize projectsandupgrade language version and
dependencies with Amazon Q DeveloperAgent forcode transformation
Summary of core use cases
Drive developer productivity
Get inline coding recommendations, summarize and document code,
scan for security issues, diagnose and troubleshoot bugs, and write unit tests
Improve security and code quality
Ship more secure code with less effort with code scanning and
automated code remediation

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 114
Amazon Q also accelerates time to insights
>Increase user productivity:Empowers you to
integrate and query data using natural language
without deep knowledge in coding, AWS data
services, or your organization’s database metadata
>Generative AI in every place: Assists you
everywhere you work with AWS: in the console,
studio, notebooks, and SQL Editor
>Reduce time to insights:Answers your questions
on data and AWS services, troubleshoots issues,
and proposes solutions
Q in Redshift Q in Glue

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS AI/ML stack
B R O A D E S T A N D M O S T C O M P L E T E S E T O F M A C H I N E L E A R N I N G C A P A B I L I T I E S
ML FRAMEWORKS
& INFRASTRUCTURE
STUDIO IDE
AMAZON
SAGEMAKER
CANVAS
No-code ML for
business analysts
STUDIO LAB
Learn ML
GROUND TRUTH
Label data Prepare data
Geospatial
ML
Store features
Build with
notebooks
Train
models
Tune
parameters
Manage
and monitor
Deploy in
production
PyTorch, Apache MXNet, TensorFlow Amazon EC2 CPUs GPUs
AWS
Trainium
AWS
Inferentia
FPGA
Habana
Gaudi
CORE
SPECIALIZED
AI
SERVICES
BUSINESS PROCESSES
Amazon Personalize
Amazon Forecast
Amazon Fraud Detector
Amazon Lookout forMetrics
SEARCH
Amazon Kendra
CONVERSATION
Amazon Lex
Amazon Transcribe CallAnalytics
Contact Lens
Voice ID
CODE + DEVOPS
Amazon CodeGuru
Amazon CodeWhisperer
Amazon DevOpsGuru
INDUSTRIAL
Amazon Monitron
Amazon Lookout for Equipment
Amazon Lookout for Vision
HEALTH
Amazon HealthLake
Amazon Comprehend Medical
Amazon Transcribe Medical
Amazon Omics
TEXT
Amazon Translate Amazon Comprehend
SPEECH
Amazon Polly Amazon Transcribe
VISION
Amazon Textract Amazon Rekognition AWS Panorama
CI/CD | GOVERNANCE | RESPONSIBLE ML
EDGE MANAGER
Manage edge devices

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Generative AI with AWS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
117
BLOOM
Question: What is generative AI?
Creates new content and ideas, including conversations,
stories, images, videos, and music
Powered by large models that are pretrained on vast corpora of
data and commonly referred to as foundation models (FMs)

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Generative AI is powered
by FMs
Pretrained on vast amounts of
unstructured data
Contain large number of parameters that make
them capable of learning complex concepts
Can be applied in a wide
range of contexts
Customize FMs using your data for domain-
specific tasks
118

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How FMs differ from other machine learning
(ML) models
119
Text generation
Summarization
Information
extraction
Q&A
Chatbot
Pretrain Adapt
Foundation models
Tasks
Unlabeled
data
FM
Traditional ML models
Text generation
Summarization
Information
extraction
Q&A
Chatbot
Train Deploy
Tasks
ML model
ML model
ML model
ML model
ML model
Labeled data
Labeled data
Labeled data
Labeled data
Labeled data

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Types of FMs
120
Text-to-text
Generate text from natural
language prompts
Text-to-embeddings
Generate numerical
representation of text
“summarize the
articles on impact of
walking on heart health”
“a photo of an astronaut
riding a horse on mars”
Multimodal
Create and edit images using
natural language prompts
“hand soap”
Numerical representation of
“Hand soap refills
Hand soap dispenser
Hand soap antibacterial”
“Ten thousand steps per day
is optimum for maintaining
a healthy heart”
Input Output FM

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Writing
Media design
Conversational search
Virtual assistants
Chatbots
Personalization
AI-powered Contact Center
Summarization
Modeling
Code generation
Data to insights
Document processing
Process optimization
Data augmentation
Cybersecurity
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Enhance
customer
experience
Boost
employee
productivity
Creativity
and content
creation
Improve
business
operations
Generative AI can be used for a wide range of use cases
121

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Year
of POCs
What does this mean for my business? What is a Foundation Model?
What is a Large Language Model?
What is generative AI?
Do I need to become a prompt engineer?Is this secure?
How do I choose a model? Where do I get started?
Which models should we try out? What is FM?
Slide is animated

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Year of
Production
(FOR SOME)
How do I prioritize my projects?
How can we move faster?
How do I make this real?How can I lower my costs?
How I can I scale this? Which models should I use?
How do I manage risks?Should I train my own model?
What customization method should I use?
Slide is animated

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Innovation opportunities

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Generative AI has potential to
create significant business value
Create new content and
ideas, including
conversations, stories,
images, videos, and music
Radically improve productivity
across all lines of business
Extract insights and
clear answers from all
your corporate information,
enabling faster and
better decisions
Create new innovative and
engaging ways of
interacting with your
customers and employees
B D M & T D M

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CREATIVE GENERATION AND
OPTIMIZATION
OPTIMIZE BUSINESS
PROCESSES
Generative AI use cases across industries
CHATBOTS
VIRTUAL
ASSISTANTS
CONVERSATION
ANALYTICS
PERSONALIZATIO
CONVERSATIONAL
SEARCH
SUMMARIZATION
CONTENT
CREATION CODE
GENERATION
DOCUMENT
PROCESSING
DATA
AUGMENTATION
FRAUD DETECTION
PROCESS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Make generative AI
work with
Generalized and specialized knowledge for your domain
Unlabeled, unstructured enterprise data
Change a copy of the foundation model
Specialized knowledge for specific tasks
Small number of labeled examples
Change a copy of the foundation model
Specialized knowledge through prompt augmentation
Enterprise knowledge corpus
No change to the foundation model

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build a data foundation to fuel
your generative AI applications on
AWS
End-to-end data
governance capabilities,
responsible AI, and regulating
user interactions with LLMs
Choices for integrating
data including zero ETL
so you can easily connect
to all your data
Comprehensive set of
services for storing and
querying structured,
unstructured, and vector data

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
generative AI for your
business
From models to tools, choiceenables long-term more flexibility and agility
Security and privacy must be built in from day one
Ensure your data is readily accessible andready for AI
Customization is key to delivering differentiated experiences

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Make the leap from
Measure and track the business value and ROI as you scale
Manage risk, maintain trust, and build responsibly with strong compliance & governance
Use services designed for to enable innovation, and designed to scale
Optimize for your cost, latency, and accuracy needs

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security considerations for generative AI
The policies, procedures,
and reporting needed to
empower the business
while minimizing risk
---
Create generative AI usage
guidelines
Establish process for
output validation
Develop monitoring &
reporting processes
The specific regulatory,
legal, and privacy
requirements for using
or creating generative AI
solutions.
---
Retain control of your
data
Encrypt data in transit
and at rest
Support regulatory
standards
The implementation of
security controls that are
used to mitigate risk.
---
Human-in-the-loop
Explainability & audibility
Testing strategy
Identity and access
management
Identification of potential
threats to generative AI
solutions and
recommended
mitigations.
---
Threat modeling
Third-party risk
assessments
Ownership of data,
including prompts and
responses
How to architect
generative AI solutions to
maintain availability and
meet business SLAs.
---
Data management
strategy
Availability
High Availability and
Disaster Recovery
strategy

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Considering impacts
on different groups
of stakeholders
Understanding
and evaluating
system outputs
Having mechanisms
to monitor and steer
AI system behavior
Appropriately obtaining,
using and protecting
data and models
Incorporating best practices
into the AI supply chain,
including providers
and deployers
Enabling stakeholders to
make informed choices
about their engagement
with an AI system
Responsible AI Dimensions
Preventing harmful system
output and misuse
Achieving correct
system outputs,
even with unexpected
or adversarial inputs

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Bedrock
The easiest way to build and
scale generative AI applications
with foundation models (FMs)
Choice of leading FMs through a single API
Model customization
Retrieval Augmented Generation (RAG)
Agents that execute multistep tasks
Security, privacy, and safety

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Helps keep your data
secure and private
None of the customer’s data is used to
train the underlying model
All data is encrypted in transit and at rest;
data used for customization is securely
transferred through customer’s VPC
Data remains in the Region where the API
is processed
Support for GDPR, SOC, ISO, CSA
compliance, and HIPAA eligibility

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Guardrails for
Amazon Bedrock
Implement safeguards customized to
your application requirements and
responsible AI policies
Apply guardrails to multiple foundation
models and Agents for Amazon Bedrock
Configure harmful content filtering
based on your responsible AI policies
Define and disallow denied topics with
short natural language descriptions
Redact or block sensitive information
such as PIIs, and custom Regex.
Slide is animated

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Next steps

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Classroom training AWS Certification
In-person and virtual training
from instructors who teach your
team in a hands-on learning
environment
Identify skilledprofessionals to
lead cloud initiatives using AWS
Digital training
No cost, on-demandcourses so
your team can learn about the
latest services when and where
it’s convenient
Expand your cloud skills with AWS

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Validate expertise with AWS Certification
Why certify?
•Demonstrate
your expertise
•Earn recognition
and visibility
•Foster credibility with
your employer and peers
Certification
resources
•Exam readiness training
•Self-paced labs

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deepen your skills with digital
learning on demand
Access 500+ freedigital courses
and Learning Plans
Earn an industry-recognized
credential
AWS Skill Builder AWS Certifications
Explore resources with a variety
of skill levels and 16+languages
to meet your learning needs
Join the AWS Certified community
and get exclusive benefits
Receive Foundational,
Associate, Professional,
and Specialty certifications
Train now
Access new
exam guides
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Learn in-demand AWS Cloud skills

Thank you!
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sami Hoda
LinkedIn: @samihoda