CLOUD COMPUTING AWS SERVICESUnit 2 Part 2.pptx

CC

1. Unit – 2 Cloud Computing Fundamentals

2. Cloud Computing Fundamentals Part 1 (1) Motivation for cloud computing with AWS as a case study (2) 5 essential characteristics (3) Amazon LEX (4) Amazon Lambda (5) Amazon Sumerian (6) Elastic resource pooling using Amazon - Elastic Compute Cloud (EC2) as example Part 2 (7) Storage types - Rapid elasticity using Amazon EBS - Amazon EFS - Amazon S3 (8) Overview of Docker CLI commands cloud deployment using Docker

3. PART 2

4. Rapid Elasticity using EBS in Cloud Computing Elasticity is a 'rename' of scalability, a known non-functional requirement in IT architecture. Elasticity or Scalability is the ability to add or remove capacity, mostly processing, memory, or both, from an IT environment. Ability to dynamically scale the services provided directly to customers' need for space and other services. It is one of the five fundamental aspects of cloud computing.   Example : Imagine a restaurant in an excellent location. It can accommodate up to 30 customers, including outdoor seating. Customers come and go throughout the day. Therefore restaurants rarely exceed their seating capacity. The restaurant increases and decreases its seating capacity within the limits of its seating area.   . 

5. Scalability done in two ways: Horizontal Scalability : Adding or removing nodes, servers, or instances to or from a pool, such as a cluster or a farm. Most implementations of scalability are implemented using the horizontal method, as it is the easiest to implement, especially in the current web-based world we live in. Example : Adding Volumes of EBS to EC2 instance. Vertical Scalability : Adding or removing resources to an existing node, server, or instance to increase the capacity of a node, server, or instance. Vertical Scaling is less dynamic because this requires reboots of systems, sometimes adding physical components to servers. Example : In Ec2 we are changing the t2.micro to t2.medium or t2.large.

6. Vertical or Horizontal can be done in Three forms Manual Scaling Manual scalability by manually adding resources to add capacity. Ordering, installing, and configuring physical resources takes a lot of time, so forecasting needs to be done weeks, if not months, in advance. It is mostly done using physical servers, which are installed and configured manually. Another downside of manual scalability is that removing resources does not result in cost savings because the physical server has already been paid for. Semi-automated Scaling Semi-automated scalability takes advantage of virtual servers, which are provisioned (installed) using predefined images. A manual forecast or automated warning of system monitoring tooling will trigger operations to expand or reduce the cluster or farm of resources. Using predefined, tested, and approved images, every new virtual server will be the same as others (except for some minor configuration), which gives you repetitive results. It also reduced the manual labor on the systems significantly, and it is a well-known fact that manual actions on systems cause around 70 to 80 percent of all errors. There are also huge benefits to using a virtual server; this saves costs after the virtual server is de-provisioned. The freed resources can be directly used for other purposes.  

7. Elastic Scaling (fully automatic Scaling) Elasticity, or fully automatic scalability, takes advantage of the same concepts that semi-automatic scalability does but removes any manual labor required to increase or decrease capacity. Everything is controlled by a trigger from the System Monitoring tooling, which gives you this "rubber band" effect. If more capacity is needed now, it is added now and there in minutes. Depending on the system monitoring tooling, the capacity is immediately reduced. Let's look at some examples where we can use it. Cloud Rapid Elasticity Example 1 Let us tell you that 10 servers are needed for a three-month project. The company can provide cloud services within minutes, pay a small monthly We can compare this to before cloud computing became available. Let's say a customer comes to us with the same opportunity, and we have to move to fulfil the opportunity. We have to buy 10 more servers as a huge capital cost. When the project is complete at the end of three months, we'll have servers left when we don't need them anymore. It's not economical, which could mean we have to forgo the opportunity. Because cloud services are much more cost-efficient, we are more likely to take this opportunity, giving us an advantage over our competitors.  

8. Cloud Rapid Elasticity Example 2 Let's say we are an eCommerce store. We're probably going to get more seasonal demand around Christmas time. We can automatically spin up new servers using cloud computing as demand grows. New buyers will register new accounts. This will put a lot of load on your server during the campaign's duration compared to most times of the year. Existing customers will also revisit abandoned trains from old wish lists or try to redeem accumulated points. It works to monitor the load on the CPU, memory, bandwidth of the server, etc. When it reaches a certain threshold, we can automatically add new servers to the pool to help meet demand. When demand drops again, we may have another lower limit below which we automatically shut down the server. We can use it to automatically move our resources in and out to meet current demand.  Cloud Rapid Elasticity Example 3 Streaming services, Netflix is probably the best example to use here. When the streaming service released all 13 episodes of House of Cards' second season, viewership jumped to 16% of Netflix's subscribers, compared to just 2% for the first season's premiere weekend. Those subscribers streamed one of those episodes within seven to ten hours that Friday. Now, Netflix has over 50 million subscribers (February 2014). So a 16% jump in viewership means that over 8 million subscribers streamed a portion of the show in a single day within a workday. Netflix engineers have repeatedly stated that they take advantage of the Elastic Cloud services by AWS to serve multiple such server requests within a short period and with zero downtime.

9. Amazon EBS delivers high-availability block-level storage volumes for  Amazon (EC2)  instances. It stores data in equally-sized blocks and organizes them into a hierarchy similar to a traditional file system. The volumes are provisioned in size and attached toEC2 instances in a way that’s similar to the local disk drive on a physical machine. It stores data on a filesystem which is retained after the EC2 instance is shut down. Two types of Block store device are available for EC2 1. Elastic Block Store Persistent Network attached virtual Device 2. Instance store Blocked ec2 Basically the virtual hard disk on the host allocated to the EC2 instance. Limited to 10gb per device.Ephemeral storage(Non-Persistent Storage)   Amazon Elastic Block Storage

10. The EC2instance cant be stopped , can only be rebooted or terminated , terminate will delete data. EBS volumes behave like raw, unformatted block devices. You can mount these volumes as devices on your instances. EBS volumes are block storage devices suitable for databases size data that requires frequent read and writes. An EBS volume can attach to a Single EC2 instance only at a time. Both EBS Volume and EC2 instance must be in the same AZ. An EBS Volume data is replicated by AWS across multiple servers in the same AZ to prevent data loss same AZ to prevent data loss resulting from any single AWS component failure.

11. EBS Volume types (1) Solid State Disk Backed Volume (a) General Purpose SSD (gp2) (b) Provisioned IOPS SSD (io1) (2) Hard Disk Drive Backed Volume (a) Throughput optimized HDD (st1) (b) Cold HDD (3) Magnetic standard(presently not available)

12. (1) SSD: SSD stands for solid-state Drives. In June 2014, SSD storage was introduced. It is a general purpose storage. It supports up to 4000 IOPS which is quite very high. SSD storage is very high performing, but it is quite expensive as compared to HDD (Hard Disk Drive) storage. SSD volume types are optimized for transactional workloads such as frequent read/write operations with small I/O size, where the performance attribute is IOPS.

13. (a) General Purpose SSD (gp2) GP2 is the default EBS Volume type for the amazon EC2 instance. GP2 Volume are backed by SSDs. General purpose ,balances both price and performance . Ratio of 3 IOPS/GB with upto 10,000 IOPS Both Volume having low latency Volume Size -4GB -16TB. Price - $0.10 gb /month. (b) Provisioned IOPS SSD (io1) These volumes are for the IOPS intensive and throughput intensive workloads that require extremely low latency or for mission critical applications . Designed for I/O intensive application such as large relational or No SQL Databases. Use if you need more than 10,000 IOPS. Can provision upto 32,000 Iops per Volume (64,000 IOPS). Volume size 4gb -16Tb. Price - $0.125/ gb /month .

14. (2) HDD: (a) Throughput optimized HDD (st1) St1 is backed by hard disk drivers and is ideal for frequently accessed, Throughput intensive workloads with large datasets. It volume deliver performance in term of throughput , measured in MB/S. Big data, Data warehouse, log processing. It cannot be a Boot Volume can provisioned upto 500 IOPS per volume. Volume size – 500gb -16Tb. Prize - $0.045gb/month.

15. (b) Cold HDD (SC1) SC1 is also backed by HDD and provides the lowest cost per gb of all EBS volume types Lowest cost storage for infrequent access workloads. Used in file servers. Cannot be a Boot Volume. Can provisioned upto 250 IOPS per volume. Volume size 500GB -16Tb. Price : $0- 025 /Gb/month. (c)Magnetic Standard Lowest cost per Gb of all EBS volume type is Bootable. Magnetic volumes are Ideal for workloads when data is accessed infrequently ,and applications where the lowest storage cost is important . Price -$ 0.05 per gb /month Volume size - 1gb -1 TB Max IOPS/volume –40-200.

16. Fig: EBS Architecture

17. Step by step procedure for creating a volume using EBSin same zone: Create an empty EBS volume and attach it to a running instance at same availability zone of Ec2 instance Create an EBS volume from a snapshot and attach it to a running instance in availability zone or from other zone. To create an EBS volume using the console in same availability zone Open the Amazon EC2 console and Launch Ec2 Instance . In the Left navigation pane, choose Elastic Block store..select Volumes . Choose  Create volume . For  Volume type , choose the type of volume to create select default ssd For  Size , enter the size of the volume, in GiB example 15GB. For  Availability Zone , choose the Availability Zone in which to create the volume. A volume can be attached only to an instance that is in the same Availability Zone. After creating the volume ,attach it to running instance.

18. Note : The volume is ready for use when the  Volume state  is  available . 8. Again In the left navigation pane, choose  Volumes . 9. Select the volume which was created with 15GB ,enable it and choose Actions , Attach volume . Note : You can attach only volumes that are in the Available state. 10. For  Instance , enter the ID of the instance or select the instance from the list of options. Note : .The volume must be attached to an instance in the same Availability Zone. 11.For  Device name , enter a supported device name for the volume. This device name is used by Amazon EC2.. 12.Choose  Attach volume 13. Connect to the instance and mount the volume. 14.After that go t the instance dash board and click on storage then you will be able to see the attached EBS volume to the instance.  

19. EBS snapshot: EBS snapshots are point -in-time images/copies of your EBS volume. Any data written to the volume after the snapshot process s initiated ,will not be included in the resulting snapshot (but will be included in future , incremental update). Per AWS account , up to 5000 EBS volume can be created. Per AWS account ,up to 10,000 EBS snapshot can be created. EBS snapshots are stored on S3 ,however you cannot access them directly you can only access them through EC2 APIs. While EBS volume are AZ specific , snapshot are Region specific. Any AZ in Region can use snapshot to create EBS volume. To migrate an EBS from one AZ to another Create a snapshot (region specific) and create an EBS volume from the snapshot in the intended AZ. You can create a snapshot to an EBS volume of the same or larger size than the original volume size from which the original volume size ,from which the snapshot was initially created.

20. You can take a snapshot of a non-root EBS volume while the volume is in use on a Running EC2 instance. This means you can still access it while the snapshot is being processed. However the snapshot will only include data that is already written to your volume. The snapshot is created immediately but it may stay in pending status until the full snapshot is completed .This may takes, few hours to complete specially for the first time snapshot volume. During the period ,when the snapshot status is pending ,you can still success the volume (non-root), but I/O might be slower because of the snapshot activity. While in pending state ,on in-progress snapshot will not include data from ongoing reads and write to the volume. To take complete snapshot of your Non-root EBS volume.- stop or unmount the volume. To create a snapshot for a Root EBS volume ,you must stop the instance first then take the snapshot.

21.   To create a snapshot using the console Note: create 2 EC2 instances in 2 zones and create snapshot at one region and copy it to other destination. (1)Creating instance in Ohio: Go to the EC2 dashboard and Create a new instance by launching it. The Zone is at Ohio region. Click on launch Instance to create instance Name the instance as kmit1 The OS must be Ubuntu Now create a new key pair Provide name to the key pair something as kmitkey1 Click on create key pair and key pair is successfully created Click on Launch Instance Instance is successfully Launched

22. (2) Another instance in Virginia : Now in another tab change the zone to Virginia The Zone is successfully changed to Virginia Click on launch Instance to create instance Name the instance as kmit2 The OS must be Ubuntu Now click on create new key pair to create a new keypair Create a new key pair Provide name to the key pair something as kmitkey2 Click on create key pair and key pair is successfully created Configure the storage from 8 to 10 Click on Launch Instance Instance is successfully Launched

23. (3) Creation of snapshot Go back to the instance 1 dashboard ,in the left pane at EBS select snapshot. Now in actions click on create a snapshot Now create a snapshot Add the description something as snapshot1 and create snapshot Snapshot is created successfully Now go to the snapshots The snapshot created will be shown. Now select the snapshot and go to actions Select copy snapshot option Now in copy snapshot add destination region as us-east1 Snapshot is created successfully  

24. (4)Accessing from second zone: Now go to the second instance created. In that check for snapshots We will find our snapshot that we created and status will be completed In the actions of the snapshot now, create volume from snapshot Change the availability zone from 1c to 1a as 1c will be busy. Create the volume and the volume is created successfully Now check the storage of EC2 ,u will be able to check the attached snapshot.  

25. Advantages and Disadvantages of Rapid Elasticity Advantages Rapid elasticity in cloud computing provides an array of advantages to businesses hoping to scale their resources. High availability and reliability.  With rapid elasticity, you can enjoy a remarkably consistent, predictable experience. Cloud providers take care of scaling behind the scenes, keeping the system running smoothly and fast. Growth-supporting.  You can more easily adopt a growth-oriented mindset with rapid elasticity. With elastic cloud computing, your IT infrastructure becomes more agile and nimble, as well as more prepared to acquire new users and customers. Automation capability.  Rapid elasticity in cloud computing uses increased automation in your IT environment, which has many benefits. For example, you can free up your IT staff to focus on core business functionality rather than scalability. Cost-effective.  Cloud providers offer resources on a pay-per-use basis, so you only pay for what you actually use. Adding new infrastructure components to prepare for growth becomes convenient with a pay-as-you-expand model.

26. Disadvantages Though rapid elasticity in cloud computing provides a multitude of benefits, it also introduces a few complexities you should keep in mind. Learning curve.  Rapid elasticity takes some time and effort to fully comprehend and therefore benefit from. Your staff may need to familiarize themselves with new programming languages, cloud platforms, automation tools, etc. Security.  Since elastic systems only run for a short period, you must rethink how you handle user authentication, incident response, root cause analysis, and forensics when you are dealing with security. Luckily, experts like Synopsys provide accessible and reliable  cloud security solutions  to simplify this process. Cloud lock-in.  Rapid elasticity is a big selling point for public cloud providers, but vendors can lock you into their service. Do your research before settling on a public cloud provider to ensure you fully understand its offerings and your contract.

27. Amazon Elastic File System (Amazon EFS) Amazon EFS offers scalable file storage, optimized for EC2. It can be used as a common data source for any application that runs on numerous instances. EFS is the best choice for running any application that has a high workload, requires scalable storage, and must produce output quickly. It scales automatically, even to meet the most abrupt workload spikes. After the period of high-volume storage demand has passed, EFS will automatically scale back down. EFS can be mounted to different AWS services and accessed from all your virtual machines. Use it for running shared volumes, or for big data analysis. You’ll always pay for the storage you actually use, rather than provisioning storage in advance that’s potentially wasted.  

28. Amazon EFS Architecture

29. Amazon EFS Use Cases Lift-and-shift application support:  EFS is elastic, available, and scalable. It enables you to move enterprise applications easily and quickly without needing to re-architect them. Analytics for big data:  It has the ability to run big data applications, which demand significant node throughput, low-latency file access, and read-after-write operations. Content management system and web server support:  EFS is a robust throughput file system capable of enabling content management systems and web serving applications, such as archives, websites, or blogs. Application development and testing:  Only EFS provides a shared file system needed to share code and files across multiple compute resources to facilitate auto-scaling workloads.  

30. Step by Step Procedure of EFS Note: Select OS Linux while doing EFS , use same security group and key pair for both instances and select the subnet id for second instance other than first instance while creating security group Creating first instance and note down the availability zone and security group Create the first instance by launching the Instance Name the first instance to be launched as efs1 Select The operating System as AWS Linux Create a Key pair and name it as nfs Create the key pair. Configure the network settings Provide all the permissions as shown by checking the boxes. Configure the storage from 8GB to 10GB Now Launch the instance. Instance 1 named efs1 is successfully launched.

31. (2)Creating Second instance and adding same security group, keypair and different availability zone Go back to the Dashboard of EC2 instance to create another instance. Check the availability zone and Security group in another tab so that for the second instance the availabilty zone should be different and security group to be the same. Repeat the same process and create another instance with name as efs2 same as the previous instance and use same key and security group for instance 2. Checking the Security group in another tab so that to apply it same to the instance 2 that we are creating. Changing the security group as wizard2 as it was in instance1 Now edit the same for the second instance2 Select the existing security group for instance2 Launch the instance2 Instance 2 is also successfully launched The availability zones are different.

32. (3) Adding security group New Rule with NFS The Security groups are same, if we add both instances can be reflected. Select the first instance efs1 Click on the security tab in dashboard of instance of efs1 click on the security groups Now select the inbound rules and edit the inbound rules,in the edit inbound rules click on add rule Add the rule , Select NFS and anywhere in IPV4. Save the changes and the saved changes will be successful. (4) Creating EFS Service Go back to the dashboard and search for EFS, Now click on create file system Provide name to the file system something as efsdemo ,Let VPC be default and Storage class as Standard and click on customize Click on Next and Removed all the previous provided Security Groups Network access. Apply the security group name same as the EC2 instances security group Click on next, Now click on Create. EFS created successfully.

33. (5)Mounting the EFS with instances from console Go back to instances Now go to efs1 i.e , instance 1 and right click the instance and connect to the instance. Connect to the instance, by Click on connect to establish connection Connection is being established After connection is established, Same step must be repeated for the second instance efs2 and connection must be established. After connection is established, Type the below all commands in two instance consoles 1) sudo su 2) mkdir efs 3) yum install-y amazon- efs -utils Go back to the amazon aws console , in the services go back to efs service, right click on created efs i.e. efsdemo Click on attach to mount efs,We are ,mounting via DNS , Copying the command and paste in two consoles.

34. (6) Creating EFS directory and files Type the commands in two consoles - ls - cd efs Now create a file in any one of the ec2 instance such that it must reflect in another instance even. For example create file in instance1 must reflect in instance 2 Type the command in one console - touch file1 file2 - ls in any one of the instance. Touch file1 file2 to create files and ls to list the created files. In another instance(instance where touch command not used) type ls. It shows the created files l1 and l2 In the other instance ,to remove the file t ype the command - rm file1 - ls Check the same ls command in the instance where we have created file1 and file2 after removal of file1. It shows only file2 In this process Efs can be shared among ec2 instances with in the regions

35. AMAZON S3 Amazon Simple Storage Service (S3) is a storage for the internet. It is designed for large-capacity, low-cost storage provision across multiple geographical regions. Amazon S3 provides object storage with its own unique identifier or key, for access through web requests from any location . Unlike EBS or EFS, S3 is not limited to EC2. Files stored and protected in S3 bucket can be accessed by customers directly or programmatically of all sized industries.

36. How Amazon S3 works: Data in S3 is organized in the form of buckets.   Amazon S3 is an object storage service that stores data as objects within buckets. An  object  is a file and any metadata that describes the file. A  bucket  is a container for objects. To store your data in Amazon S3, you first create a bucket and specify a bucket name and AWS Region. Then, you upload your data to that bucket as objects in Amazon S3. Each object has a  key  (or  key name ), which is the unique identifier for the object within the bucket. S3 provides features that you can configure to support your specific use case. For example, you can use S3 Versioning to keep multiple versions of an object in the same bucket, which allows you to restore objects that are accidentally deleted or overwritten. Buckets and the objects in them are private and can be accessed only if you explicitly grant access permissions. You can use bucket policies, AWS Identity and Access Management (IAM) policies, access control lists (ACLs), and S3 Access Points to manage access.

37. S3 Architecture

38. S3 Buckets –Naming Rules S3 Bucket names (keys) are globally Unique across all AWS Regions. Bucket Names cannot be change after they are created. If a bucket is deleted ,its name becomes available again to your or other account to use. Bucket names must be at least 3 and no more than 63 characters long. Bucket names are part of the URL used to access a bucket. Bucket name must be a services of one or more labels ( xyz bucket) . Bucket names can contain lowercase , numbers and cannot use uppercase letters. Bucket name should not be an IP address(10 to 2020) Each label must start and end with a lowercase letter or a number By default buckets and its objects are private by default, only owner can access the bucket. The name is of two parts :- Bucket region’s endpoint /bucket name Ex: S3 bucket named mybucket in Europe west Region https://S3-eu-west1.amazons.com/mybucket

39. S3 Buckets- Subresources : Sub-resources for S3 bucket includes:- Lifecycle:- To decide on objects lifecycle management Website:- To hold configuration related to state website hosted in S3 buckets. versioning :- Keep object versions as it changes (Gets updated) Cross-region replication:- Automate , fast and reliable asynchronous replication of data across region Access Control List:- Buckets Policies.

40. S3 Objects Any object size stored in an S3 bucket can be ) bytes to 5 TB. Each object is stored and retrieved by a unique key(ID or name). An object in AWS S3 is Uniquely identified and addressed through -Service endpoint -Bucket name -Optionally Object Version Object stored in a S3-bucket in a Region will never leave that region unless you specifically move them to another region or CRR. A bucket owner can grant cross-account permission to another AWS account to upload objects. We can grant S3 bucket /object permission to :- -Individual users -AWS Account -Make the Resource public -or to all authenticate user

41. S3 Bucket versioning Bucket versioning is a S3 bucket Sub-resource used to protect against accidental object /data deleted or overwrites. Versioning can also be used for data Retention and archive. Once you enable versioning on a Buckets ,it cannot be disabled ,however it can be suspended. When enabled ,bucket versioning will protect existing and new objects, and maintains their versions as they are updated. Updating objects refers to PUT,POST,COPY,DELETE actions on objects. When versioning is enabled and you by to delete an object , a delete marker is placed on the object. We can still view the object and the delete marker. It you Reconsider deleting the objects ,we can delete the “Delete Marker” and the object will be available again. We will be changed for all S3 storage cost for all object versions stored. We can use versioning with S3 lifecycle policies to delete older versions, or you move them to a cheaper S3 storage (or Glacier). Bucket versioning state -Enabled -Suspended

42. S3 Bucket versioning(contd..) Versioning applies to all objects in a bucket and not partially applied. Object Existing before enabling versioning will have a version ID. If you have a bucket that is already versioned ,then you suspend versioning, existing objects and their versions remain as it is. However they will not be updated/versioning further with future updates while the bucket versioning is suspended. New object (uploaded after suspension they will have a version ID “null” If the same key (name) is used to stone another object ,it will override the existing one. An object deletion in a suspended versioning buckets will only delete the objects with ID “null”.

43. S3 Cross-Region Replication Replication enables automatic, asynchronous copying of objects across Amazon S3 buckets. Buckets that are configured for object replication can be owned by the same AWS account or by different accounts.. You can replicate objects to a single destination bucket or to multiple destination buckets.. The destination buckets can be in different AWS Regions or within the same Region as the source bucket. To automatically replicate new objects as they are written to the bucket, use live replication, such as Cross-Region Replication (CRR).

44. S3 Cross-Region Replication To enable CRR, you add a replication configuration to your source bucket To enable CRR, you add a replication configuration to your source bucket. -The destination bucket or buckets where you want Amazon S3 to replicate objects -An AWS Identity and Access Management (IAM) role that Amazon S3 can assume to replicate objects on your behalf Use Cases : Compliance – store data hundreds of miles a part Lower latency- Distribute data to regional customers Security – create remote replicas managed by separate AWS accounts Only replicates new PUTs once S3 is configured ,all new updates into a source buckets will be replicated. Versioning is required.

45. To upload objects in Amazon S3 : First u need to create Bucket with the following points Create Buckets Upload Objects S3 Versioning Version ID Bucket Policy Access Control List (ACL’s)

46. Step by step procedure to create S3 bucket : 1. Click on S3 services. 2. Provide bucket name and e nable the acl’s enabled. 3 . Unblock all the public access settings for the bucket 4 .Check box the acknowledgement, disable bucket versioning. 5 .Provide default encryption as amazon s3-managed keys and bucket key as enable and click on create bucket. 6 . Bucket is successfully created . 7. After creatio n of bucket ,click on the bucket and go to permission tab, enable the ACL’s permission to list and read. 8. Now right click on the bucket created, click on upload to upload A file here I uploaded kmit.Jpg 9 .Click on upload and the file is uploaded successfully. 10. After upload of file once again go to permission tab of object check whether ACL’s permission to list and read is enabled or not. 11 .Now go back to the file been uploaded into the bucket 12 .Right click onto the file and go to properties, Copy the object url and paste in browser,will be able to see the object uploaded publicly.

47. AWS S3 Bucket Benefits  Users get 99.99% durability. New users get 5GB of Amazon S3 standard storage. S3 provides Encryption to the data that you store. In two ways, Client-Side Encryption and Server-Side Encryption Multiple copies are maintained to enable the regeneration of data in case of data corruption. S3 is Highly Scalable since it automatically scales your storage according to your requirement. only pay for the storage you use. Amazon S3 Use Cases Data lake and big data analytics:  S3 can create a data lake to hold raw data in its native format, then use machine learning tools, query-in-place, and analytics to draw insights. S3 works with  AWS Lake Formation  to create data lakes, then define governance, security, and auditing policies. Together, they can be scaled to meet your growing data stores, and you’ll never have to make an investment upfront.

48. Backup and restoration:  Secure, robust backup and restoration solutions are easy to build when you combine S3 with other AWS offerings, including EBS, EFS, or S3 Glacier. These offerings enhance your on-premises capabilities, while other offerings can help you meet compliance, recovery time, and recovery point objectives. Reliable disaster recovery:  S3 storage,  S3 Cross-Region Replication  and additional AWS networking, computing, and database services make it easy to protect critical applications, data, and IT systems. It offers nimble recovery from outages, no matter if they are caused by system failures, natural disasters, or human error. Methodical archiving:  S3 works seamlessly with other AWS offerings to provide methodical archiving capabilities.  S3 Glacier  and  S3 Glacier Deep Archive  enable you to archive data and retire physical infrastructure. There are three S3 storage classes you can use to retain objects for extended periods of time at their lowest rates. S3 Lifecycle policies can be created to archive objects at any point within their lifecycle, or you can upload objects to archival storage classes directly. S3 Object Lock meets compliance regulations by applying retention dates objects to avoid their deletion. And unlike a tape library, S3 Glacier can restore any archived object within minutes.

49. Amazon S3 storage classes Types Amazon S3 offers different storage classes with different levels of durability, availability, and performance requirements. Amazon S3 Standard is the default Amazon S3 Standard-Infrequent Access (Standard-IA) –Infrequent objects can be stored. Amazon S3 One Zone-Infrequent Access (One Zone-IA) - Infrequent objects can be stored in one zone Amazon S3 on Outposts - will give users 48TB or 96TB of S3 storage capacity, with up 100 buckets on each Outpost. Amazon S3 Glacier Deep Archive - ideal for those industries which store data for 5-10 years or longer like healthcare, finance, etc. It can also be used for backup and disaster recovery. Note : Mostly Amazon s3 Standard is default all are using

50. What is Docker Docker is a platform which packages an application and all its dependencies together in the form of containers. This containerization aspect ensures that the application works in any environment. I n the diagram, each and every application runs on sepa- - rate containers and has its own set of dependencies & libraries. This makes sure that each application is independent of other applications, giving developers surety that they can build applications that will not interfere with one another. So a developer can build a container having different applications installed on it and give it to the QA team. Then the QA team would only need to run the container to replicate the developer’s environment.

51. Docker Commands 1.  docker –version This command is used to get the currently installed version of docker 2.  docker pull Usage: docker pull <image name> This command is used to pull images from the  docker repository (hub.docker.com

52. 3.  docker run Usage: docker run -it -d <image name> This command is used to create a container from an image 4.  docker ps This command is used to list the running containers 5.  docker ps -a This command is used to show all the running and exited containers

53. 7.  docker stop Usage: docker stop <container id> This command stops a running container 8 .  docker kill Usage: docker kill <container id> This command kills the container by stopping its execution immediately. The difference between ‘docker kill’ and ‘docker stop’ is that ‘docker stop’ gives the container time to shutdown gracefully, in situations when it is taking too much time for getting the container to stop 9.  docker commit Usage: docker commit < conatainer id> <username/ imagename > This command creates a new image of an edited container on the local system 10.  docker images This command lists all the locally stored docker images . 

54. 11.  docker build Usage: docker build <path to docker file> This command is used to build an image from a specified docker file

55. 12.   docker push Usage: docker push <username/image name> This command is used to push an image to the docker hub repository 13.  docker login This command is used to login to the docker hub repository

56. 14.  docker rm Usage: docker rm <container id> This command is used to delete a stopped container 15.  docker rmi Usage: docker rmi <image-id> This command is used to delete an image from local storage

57. ( (4) Step by step Procedure to Pull the image from Docker to EC2 Instance aand access it publicly. Create the EC2 instance and connect with EC2 Console. In the opened Cons ole of EC2, Type the following commands to pull the image from docker - sudo apt update / sudo apt-get update - sudo apt install docker.io / sudo apt-get install docker .io - sudo docker version - sudo docker image ls (it shows the images list present in our Instance) Note: we don’t have images in the instance because we didn’t pulled the image from docker - sudo docker pull scott2srikanth/ fileshare_docker-fdp (pull the image) - sudo docker image ls (shows the image pulled in the list) - sudo docker run –d –p 3000:3000 scott2srikanth/ fsdreactdemo Note: 3000:3000 first is inbound values we change it but right isde 3000 value is docker bound values we cant change that,example we can give 3008:3000 -

58. After run command it shows the image downloaded. Now we can access it publicly, by copying the EC2 public IP address shown below of the console or EC2 dashboard. Copy the public ip and paste it on browser with inbound value. Example : http://3.12.123.4:3000 Note : if it is not opening check (a) whether u have given https or http or (b) Go to dashboard ,click on EC2 instance ,it shows security tab.. click on Edit inbound rules . click on Add rule .select All traffic and anywhere from IPV4 and save it and refresh the browser. Finally the pulled image will be displayed.