Artificial Intelligence Chapter 12 : Artificial Intelligence on Cloud
Why are Companies Migrating to the Cloud?
Why are Companies Migrating to the Cloud ? Productivity Improvement
Why are Companies Migrating to the Cloud? Responsive Agility
Why are Companies Migrating to the Cloud? Operational Efficiency
Why are Companies Migrating to the Cloud? Mobility
Why are Companies Migrating to the Cloud? Improved Cost Management
Why are Companies Migrating to the Cloud? Scalability, Speed and Security
Why are Companies Migrating to the Cloud? Enhanced Data Security
The Top Cloud Providers
1. Amazon EC2 (Elastic Compute Cloud) EC2 is a cloud platform provided by Amazon that offers secure, and resizable compute capacity. Its purpose is to enable easy access and usability to developers for web-scale cloud computing, while allowing for total control of your compute resources. Deploy applications rapidly without the need for investing in hardware upfront; all the while able to launch virtual servers as-needed and at scale.
2. Amazon RDS (Relational Database Services) Amazon Relational Database Service (Amazon RDS) makes database configuration, management, and scaling easy in the cloud. Automate tedious tasks such as hardware provisioning, database arrangement, patching, and backups – cost-effectively and proportionate to your needs. RDS is available on various database instances which are optimized for performance and memory, providing six familiar database engines including Amazon Aurora, PostgreSQL , MySQL, MariaDB , Oracle. database, and SQL server. By leveraging the AWS Database Migration Service, you can easily migrate or reproduce your existing databases to Amazon RDS
3. Amazon S3 (Simple Storage Service) Amazon S3, at its core, facilitates object storage, providing leading scalability, data availability, security, and performance. Businesses of vast sizes can leverage S3 for storage and protect large sums of data for various use cases, such as websites, applications, backup, and more. Amazon S3’s intuitive management features enable the frictionless organization of data and configurable access controls
4. Amazon Lambda Lambda permits you to run code without owning or managing servers. Users only pay for the compute time consumed. Operate code for nearly any application or backend utility without administration. Users just upload the code, and Lambda does the rest, which provides precise software scaling and extensive availability
5. Amazon CloudFront CloudFront is a content delivery network platform that executes at rapid rates with the secure distribution of data, videos, apps, and APIs on a global scale with low delay-times. Connected with the global infrastructure of AWS, CloudFront integrates seamlessly with systems like Amazon S3, Amazon EC2, AWS Shield and Lambda@Edge to manage custom code, personalizing the experience When connected with applications such as Amazon S3, Amazon EC2, etc , there are no additional data transfer fees
6. Amazon Glacier AWS Glacier services are secure, flexible, and affordable Amazon S3 cloud storage classes for data caching and prolonged backup. These storage classes ensure confident delivery while ensuring comprehensive security and compliance capabilities, while fulfilling the regulatory prerequisites. Users can store as little as $1 per terabyte monthly; meanwhile, helping them save both up-front and long-term when compared to their on-premises servers
7. Amazon SNS (Simple Notification Service) Amazon SNS is a fully managed messaging solution that provides low-cost infrastructure for bulk message delivery, primarily to mobile users. Users can chat directly with customers through system-to-system or app-to-person communication between decoupled micro service apps
8. Amazon EBS (Elastic Block Store) Amazon Elastic Block Store (EBS) is a high-performance block storage solution used within Amazon EC2 for throughput and transaction workloads of any size, at any time. It handles a diverse range of workloads, such as relational and non-relational databases, and enterprise applications. With EBS, users have the option to choose between five different volume types to achieve optimal cost and effectiveness. Change volume size and type to fine-tune the performance without disturbing other vital applications, while maintaining cost-efficient storage on an as-you-go basis
9. Amazon VPC (Virtual Private Cloud) Amazon VPC enables you to set up a reasonably isolated section of the AWS Cloud where you can deploy AWS resources at scale in a virtual environment. VPC gives you total control over your environment, which includes the option to choose your own IP address range, creation of subsets, and arrangement of route tables and network access points. Easily customize the network configuration of your VPC with flexible dashboard management controls designed for maximum usability. For example, users can launch public-facing subnet for web servers with internet access
10. Amazon Kinesis Gain timely insights by leveraging Amazon Kinesis to collect, process, and analyze data in real-time, helping you react quickly. Key features inside AWS Kinesis are cost-efficient processing of streaming data at scale, and the option to choose tools best fit for your application. Ingest real-time data, including video, audio, application records, website activity, and IoT telemetry data for machine learning and other apps. With Kineses , users can track, analyze, and process data in real-time, enabling instant response capabilities
11. Amazon Auto-scaling The AWS Auto-scaling solution monitors your apps and automatically tunes capacity to sustain steady, predictable performance at the lowest possible price. Seamlessly configure application scaling abilities for various resources across multiple services almost instantly. Auto-scaling has a feature-rich and straightforward user interface that enables you to build scaling plans for various assets. These resources include Amazon EC2 instances and Spot Fleets, EC2 tasks, Dynamo DB tables and indexes, and Amazon Aurora Replicas
12. Amazon IAM (Identity and Access Management) AWS Identity and Access Management provides secure access and management of resources in a secure and compliant manner. By leveraging IAM, you can create and manage users and groups by allowing and denying their permissions for individual resources. There are no additional costs, people only get charged for the use of other services by their users.
13. Amazon SQS (Simple Queue Service) AWS SQS is a fully managed message queuing facility enabling you to decouple and scale microservices , distributed systems, and serverless apps. SQS purges the intricacies and overhead associated with managing and operating message-oriented middleware and permits developers to focus on diverse workloads. With SQS, users can send, store, and receive messages between multiple software parts en masse, without losing message data or requiring the availability of other systems. SQS offers two classes of message queues, including standard queues, which provide maximum throughput and FIFO queues to guarantee that messages are processed only once, in the exact order the sequences occurred
14. Amazon Elastic Beanstalk Elastic Beanstalk is an AWS service with easy-to-use deployment and web scaling capabilities developed with Java, .NET, PHP, Python, Node.js, Ruby, Go, and Docker on servers like Apache, Nginx , Passenger, and IIS. You just upload code, and Elastic Beanstalk will automatically manage the deployment; from capacity tuning, load balancing, auto-scaling, to application health evaluation and monitoring. Meanwhile, you maintain full control over your AWS assets and the underlying resources powering your application. Users only pay for what is needed to manage their applications
15. Dynamo DB DynamoDB is a document database with key-value structuring that delivers single-digit millisecond performance at scale. Dynamo has built-in security with a fully managed, multimaster , multiregion , durable database, backup and restore, and in-memory archiving for web-scale applications. DynamoSB can manage upward of 10 trillion requests daily and can support thresholds of more than 20 million requests per second
16. Amazon ElastiCache ElastiCache is an AWS service that effortlessly sets up, runs, and scales popular open-source, in-memory data storages in the cloud. Operate data-intensive apps or enhance the performance of existing databases by evaluating data from high throughput and low latency in-memory data stores. AWS ElastiCache is a popular option for real-time use cases including caching, session stores, gaming, geospatial services, live analytics, and queuing. For high-maintenance applications that require sub-millisecond response times, ElastiCache offers fully managed Redis and Memcached applications.
17. Amazon Redshift Redshift is a data warehouse service offering industry-leading performance and seamless provisioning, that supports cost-effective data analysis on standard SQL. Operate sophisticated analytic queries against terabytes to petabytes of structured data using query optimization, columnar storage, and parallel query execution.
18. Amazon Sagemaker SageMaker is a full-fledged management service providing developers and data scientists with the resources to build, train, and deploy machine learning models rapidly. Use it to create highly scalable machine learning models that deploy products faster and deliver to market quickly
19. Amazon Lightsail Amazon Lightsail is an easy on-ramp for users who are getting started with AWS and just need virtual private servers. Lightsail has the tools required for a speedy product launch at a low and predictable price. The resources included in Lightsail are virtual machines, SSD-based storage, data transfer, DNS management, and a static IP. After the provision of an instance, you can easily manage them within the Lightsail console, Lightsail API, or Lightsail command line interface
20. Amazon EFS (Elastic File System) Elastic File System is an AWS service offering a simple, scalable, fully managed elastic NFS file system for use with AWS cloud services and on- prem resources. By leveraging EFS, users can scale on-demand to petabytes without disturbing application performance, automatically shifting as files transfer, meanwhile eliminating tedious, manual tasks. EFS provides massively shared access to thousands of Amazon EC2 instances, while granting your apps access to high levels of aggregate throughput and IOPS with perennial low late cues.
21. Amazon Cloudwatch CloudWatch on AWS is a monitoring and observability service designed for DevOps engineers, developers, site reliability engineers, and IT managers. In the CloudWatch console users can monitor applications, respond to performance changes system-wide, scale resources expediently, and view overall health in the form of logs, metrics, and events. With CloudWatch , detect abnormal behaviour in your environments, set alerts, troubleshoot issues, take automated actions, and more.
22. Amazon Chime Chat, meet, and place business calls on Chimes communication service inside and outside of your application, all on a single platform. Leverage the same infrastructure and operations of Amazon Chime with audio calling, video calling, and screen sharing capabilities integrated directly to the Amazon Chime SDK. Amazon Chime Voice Connector lets enterprises migrate their telephony workloads to AWS, supporting inbound and outbound calling functionality
23. Amazon Cloud Directory Cloud Directory allows you to develop durable cloud-native directories for data hierarchy structuring along multiple dimensions. Users can build directories for a variety of use cases, including organizational charts, course catalogs, and device registries. Organizational charts can be navigated through individual hierarchies for reporting structure, location, and cost center, scaling to hundreds of millions of objects. Cloud Directory removes time-intensive, costly administrative tasks, like scaling infrastructure and managing servers. Users define a strategy, create a directory, and then colonize their directory by coordinating with the Cloud Directory API
24. Amazon Cognito AWS Cognito administers a control access dashboard for on-boarding users through sign-up, and sign-in features to their web and mobile apps. AWS Cognito scales to millions of users and offers sign-in support with social identity providers including Facebook, Google, and Amazon, along with enterprise identity providers via SAML 2.0
25. Amazon Inspector Inspector provides automated security assessment to enhance security and compliance of apps deployed on AWS. AWS Inspector automates security audits to reveal vulnerabilities, exposures, and deviations. After each assessment, Inspector displays a comprehensive list of security findings prioritized by the level of threat presented to your software - available on the user console or API
Amazon Web Services (AWS )
The Top C loud Providers……….. Amazon Web Services (AWS ) Amazon Web Services is one of the cloud pioneers Launched in 2006, AWS has ranked highly in the greatly respected Gartner's Magic Quadrant Since its inception, AWS has held a big chunk of the cloud market AWS is an appealing option both for legacy players as well as start-ups According to Gartner : " AWS is the provider most commonly chosen for strategic, organization-wide adoption“ AWS helping its customers to deploy and leverage the services Most mature , most advanced cloud provider, with a strong track record of customer success Highly value being first, they are willing to launch services quickly that might not be fully mature and feature-complete, and work out the kinks once they are released In fairness, this is not a tactic exclusive to AWS to release beta versions of their services In addition, since Amazon competes in markets other than the cloud, it is not uncommon for some potential customers to go with other providers in order to not "feed the beast." For example, Walmart is well known for avoiding using AWS at all costs because of their fierce competition in the e-commerce space
The Top Cloud Providers……. Microsoft Azure Second position in the Gartner Magic Quadrant, trailing AWS, lagging significantly on their ability to execute better than AWS Microsoft's solution is appealing to customers hosting legacy workloads as well as brand new cloud deployments, but for different reasons Legacy workloads are normally run on Azure by clients that have traditionally been Microsoft customers and are trying to leverage their previous investments in that technology stack For new cloud deployments, Azure cloud services hold appeal because of Microsoft's strong offerings for application development, specialized Platform as a Service ( PaaS ) capabilities, data storage, machine learning, and Internet of Things ( IoT ) services Enterprises that are strategically committed to the Microsoft technology stack have been able to deploy many large-scale applications in production Azure specifically shines when developers fully commit to the suite of Microsoft products, such as .NET applications, and then deploy them on Azure Another reason Microsoft has deep market penetration is its experienced sales staff and its extensive partner network In addition, Microsoft realizes that the next battle in technology will not revolve around operating systems but rather in the cloud and they have become increasingly open to adopting non-Microsoft operating systems As proof of this, as of now, about half of Azure workloads run on Linux or other open source operating systems and technology stacks A Gartner report notes " Microsoft has a unique vision for the future that involves bringing in technology partners through native, first-party offerings such as those from VMware, NetApp, Red Hat, Cray, and Databricks . “ On the downside, there have been some reports of reliability, downtime, and service disruptions as well as some customers taking issue with the quality of Microsoft's technical support
The Top Cloud Providers….. Google Cloud Platform ( GCP ) In 2018, Google broke into the prestigious Gartner's leaders' quadrant with its GCP offering , joining only AWS and Azure in the exclusive club In 2019, GCP remained in the same quadrant with its two fierce competitors. However, in terms of market share , GCP is a distant third They recently beefed up their sales staff, they have deep pockets, and they have a strong incentive to not be left behind so don't discount them yet Google's reputation as a leader in machine learning is undisputed so it is no surprise that GCP has strong big data and machine learning offerings But GCP is also making some headway, attracting bigger enterprises looking to host legacy workloads such as SAP and other traditional customer relationship management ( CRMs ) systems Google's internal innovations around machine learning, automation, containers , and networking, with offerings such as TensorFlow and Kubernetes, have advanced cloud development. GPS's technology offerings revolve around their contributions to open source . Be careful about centering your cloud strategy exclusively around GCP , however In a recent report, Gartner declared : " Google demonstrates an immaturity of process and procedures when dealing with enterprise accounts, which can make the company difficult to transact with at times .“ And: " Google has a much smaller pool of experienced Managed Service Providers ( MSP ) and infrastructure-centric professional services partners than other vendors in this Magic Quadrant .“ However , Gartner also states : "Google is aggressively targeting these shortcomings.“ Gartner also notes that Google's channel needs development.
The Top Cloud Providers….. Alibaba Cloud Alibaba Cloud made its first appearance in Gartner's Magic Quadrant in 2017, and as of 2019, Alibaba's cloud offering called Aliyun remains in the Niche Player category Gartner only evaluated the company's international service, headquartered in Singapore Alibaba Cloud is the market leader in China, and many Chinese businesses, as well as the Chinese government, have been served well by using Alibaba as their cloud provider However , a big part of this market share leadership might be given up if China ever decides to remove some of the restrictions on other international cloud vendors The company provides support in China for building hybrid clouds But , outside of China, it's mostly used by cloud-centric workloads In 2018, it forged partnerships with VMware and SAP Alibaba has a suite of services that is comparable in scope to the service portfolios of other global providers The company's close relationships with the Alibaba Group helps the cloud service to be a bridge for international companies looking to do business in China, and out of China for Chinese companies Alibaba does not yet seem to have the service and feature depth of competitors such as AWS, Azure, and GCP And in many regions, services are only available for specific compute instances They also need to strengthen their MSP ecosystem, third-party enterprise software integration, and operational tools
The Top Cloud Providers….. Oracle Cloud Infrastructure ( OCI ) In 2017, Oracle's cloud offering made a debut on Gartner's Magic Quadrant as a Visionary But in 2018, due to a change to Gartner's evaluation criteria, Oracle was moved to Niche Player status. It remained there as of 2019 Oracle Cloud Infrastructure, or OCI , was a second-generation service launched in 2016 to phase out the legacy offering, now referred to as Oracle Cloud Infrastructure Classic OCI offers both virtualized and bare-metal servers, with one-click installation and configuration of Oracle databases and container services OCI appeals to customers with Oracle workloads that don't need more than basic Infrastructure as a Service ( IaaS ) capabilities Oracle's cloud strategy relies on its applications, database, and middleware Oracle has made some headway in attracting talent from other cloud providers to beef up its offerings It's also made some progress in winning new business and getting existing Oracle customers to move to the OCI cloud However , Oracle still has a long road ahead of it before it can catch up with the big three.
The Top Cloud Providers….. IBM Cloud In the mainframe era, IBM was the undisputed computing king of the hill It lost that title when we started moving away from mainframes and personal computers became ubiquitous IBM is again trying to reclaim a leadership position in this new paradigm shift. IBM Cloud is IBM's answer to this challenge The company's diversified cloud services include container platforms, server-less services , and PaaS offerings They are complemented by IBM Cloud Private for hybrid architectures Like some of the other lower-tier cloud providers, IBM appeals to its existing customers who have a strong preference to purchase most of their technology from Big Blue (IBM's nickname) These existing customers usually have traditional workloads IBM is also leveraging these long relationships to transition these customers into emerging IBM solutions , such as Watson's artificial intelligence IBM benefits from a large base of existing customers running critical production services and that are just starting to get comfortable with cloud adoption This existing customer base positions IBM well to assist these customers as they embrace the cloud and begin their transformation journeys Like Oracle, IBM is fighting an uphill battle to gain market share from AWS, Azure , and Google
Amazon Web Services
Amazon Web Services – Amazon SageMaker (AWS- ASM ) ML platform for developer and Data Scientists Create, Train, Deploy ML models in the clouds Platform Daily used by Data Scientists Daily used by data scientists Documents that contain a combination of computer code such as Python, rich text elements such as paragraphs, equations, graphs, and URLs Easily be understood by humans because they contain analysis, descriptions, and results (figures, graphs, tables, and so on) Executable programs that can be processed online or on a laptop Jupyter Notebook Data Preparation Algorithm Selection and Training Algorithm Tuning and Optimization Algorithm Deployment Integration and Invocation Machine Learning Pipeline
AWS: Amazon SageMaker Pipeline Algorithms: Data Preparation
AWS: Amazon SageMaker Pipeline Algorithms : Algorithm Selection and Training
AWS: Amazon SageMaker Pipeline Algorithms: Algorithm Tuning and Optimization
AWS: Amazon SageMaker Pipeline Algorithms: Integration and invocation
AWS: Alexa , Lex, and Polly – Conversational Agents
AWS: Amazon Comprehend – Natural Language Processing Overview Amazon Comprehend is a natural language processing ( NLP ) service provided by AWS It uses machine learning to Analyze Content Perform Entity Recognition Find Implicit Relations Find Explicit Relationships Companies are starting to realize that they have valuable information in the mounds of data that they generate every day Valuable insights can be ascertained from Customer Emails Support Tickets Product Reviews Call Center Conversations Social Media Interactions Amazon Comprehend make it cost-effective to perform analysis on vast amounts of data Advantage of this service is that is it yet another AWS service that is fully managed , so there is no need to provision of servers , install drivers, and upgrade software S imple to use Deep experience in NLP is not required Amazon Comprehend integrates with other AWS services such as AWS Lambda and AWS Glue
AWS: Amazon Comprehend – Natural Language Processing Use Cases Amazon Comprehend can be used to scan documents and identify patterns in those documents This capability can be applied to a range of use cases , such as Sentiment Analysis Entity Extraction Document Organization by Topic As an example, Amazon Comprehend could analyze text from Social media interaction with a customer Identify key phrases Determine whether the customer's experience was positive or negative
AWS: Amazon Comprehend – Natural Language Processing Console Access Amazon Comprehend can be accessed from the AWS Management Console One of the easiest ways to ingest data into the service is by using Amazon S3 We can then make a call to the Comprehend service to analyze text for key phrases and relationships Comprehend can return a confidence score for each user request to determine the confidence level of accuracy; the higher the percentage , the more confident the service is Comprehend can easily process a single request or multiple requests in a batch
AWS: Amazon Comprehend – Natural Language Processing APIs Key phrase Extraction API – Identifies key phrases and terms Sentiment Analysis API – Returns the overall meaning and feeling of the text , either positive, negative, neutral, or mixed Syntax API – Allows a user to tokenize text to define word boundaries and label words in their different parts of speech, such as nouns and verbs Entity Recognition API – Identifies and labels different entities in the text , such as people, places, and companies Language Detection API – Identifies the primary language in which a text is written. The service can identify over a hundred languages Custom Classification API – Enables a user to build a custom text classification model
AWS: Amazon Comprehend – Industry Specific Services Amazon Comprehend Medical was released at AWS relevant in 2018 It is built specifically for the medical industry Identify industry-specific terminology Comprehend also offers a specific Medical Named Entity and Relationship Extraction API AWS does not store or use any text inputs from Amazon Comprehend Medical for future machine learning training
Amazon Web Services (AWS) Amazon SageMaker Alexa, Lex, and Polly – Conversational Gents Amazon Comprehend – Natural Language Processing Amazon Rekognition – Image and Video Amazon Translate Amazon Machine Learning Amazon Transcribe – Transcription Amazon Textract – Document Analysis