Migrate Open Source Databases to Azure.pptx

dominicduantran 46 views 23 slides Aug 28, 2024
Slide 1
Slide 1 of 23
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23

About This Presentation

Documentation


Slide Content

Migrate Open Source Databases to Azure

Why Migrate at all? Capacity needs Hardware or Cloud OS Data Store Security threats ! Software and hardware refresh Integrate acquisitions Datacenter contracts expiry End of support Compliance Application innovation

Azure Databases for PostgreSQL, MySQL and MariaDB are fully managed, enterprise-ready community databases-as-a-service.  Azure takes the admin out of MySQL and MariaDB Greater manageability and security Improved performance and intelligence Global scalability Built-in tools and resources Datacenter management Hardware O/S provision /patching Database provision/ Patch/Scaling Virtualization Data Applications High availability /DR/Backups Datacenter management Hardware Virtualization O/S Database provision/ Patch/Scaling Data Applications High availability /DR/Backups Data Applications Datacenter management Hardware Virtualization O/S Database provision/ Patch/Scaling High availability/ DR/Backups Intelligent performance Intelligent security On-premises PostgreSQL, MySQL and MariaDB IaaS Azure VMs with PostgreSQL,  MySQL , and MariaDB PaaS   Azure Database for PostgreSQL, MySQL, and MariaDB Managed by Microsoft Managed by customer Machine learning capability

Azure Database Open Source Databases Fully managed OSS community databases on MySQL, PostgreSQL, MariaDB Integrates Azure services with s treamlined provisioning and management experience for common OSS frameworks and languages Secure and compliant with Advanced Threat Protection and Azure IP Advantage Best total cost of ownership with built in HA Enterprise-ready Easy migration Developer productivity Built-in intelligence optimizes performance and security Enterprise scale with Hyperscale Scale PostgreSQL databases across 100s of nodes with Hyperscale (Citus)

PostgreSQL, MySQL and Maria DB migration to PaaS Focus on your App and free yourself database management by migrating on-premises and IaaS PostgreSQL/ MySQL/ MariaDB workloads to Azure Database for PostgreSQL , Azure Database for MySQL , Azure Database for MariaDB Take advantage of Azure’s enterprise-ready features on security, compliance, and intelligent performance Choose the migration approach that best fits the needs of your customer’s workloads* Reduce downtime on critical databases with Azure Database Migration Service Ideal for migrating on-premises or IaaS to Azure Open Source Database Services Options for migrating to Azure Database for PostgreSQL Discover and assess Connect to Azure with your favorite tool Migrate schema and data Azure Database Migration Service Import/Export Dump and store DMS Continuous Sync X Remediate apps Optimize Test

Two options to migrate to Azure Opensource Databases Option 1 Azure Database Migration Service* Minimize downtime with continuous sync Recommended for full database migrations and in-production applications Option 2 Proof of concept migration Use dump and restore or import/export for faster migrations Recommended for testing and proof of concept scenarios only mysql dump + restore *Azure Database Migration Service is only available on Azure Database for MySQL Recommended approach

Minimize downtime using Database Migration Service Migrate initial load New transactions continue to replicate to target until data catches up Stop new traffic coming in (downtime started) Wait for last batch of data to catch up Complete DB migration Update connection string (back online) DMS Continuous Sync

HarvestMark migrated its existing PostgreSQL database to Microsoft Azure Database for PostgreSQL​ in just two hours During the migration there was no impact to their customers. HarvestMark saw a 20 percent decrease in cloud hosting service costs. The company maintains its high standards for reliability and speed with Azure. HarvestMark chooses Azure over Amazon for improved security and performance Customers of HarvestMark wanted them to find a new cloud-services provider that would avoid a conflict of interest and give them the performance and peace of mind for their solutions

GeekWire is serves 2 million readers worldwide with Azure Database for MySQL Based in Seattle, Washington, GeekWire is a rapidly growing technology news site with a global readership. As its popularity and site traffic increased, so did performance concerns. GeekWire decided to migrate its WordPress site to the Microsoft Azure platform. This ensured better scalability and performance Removed pain of patching, scaling, and backing up the database and allowed them to focus on their application By taking advantage of fully managed service Azure Database for MySQL the company can scale on-demand while cutting costs 45 percent.

Summary By Migrating to Azure Open Source Database services customers can: Reduce cost and database management Focus on Application development Ensure cloud scale and performance Take advantage of enterprise ready features on Azure OSS Database Migrating to Azures Open Source Databases Seamless migration with support for latest Open Source Database editions   Fast and secure migration with minimal down time

Database Migration Guide http://aka.ms/datamigration Azure Database Migration Service Migrate with minimum downtime http://aka.ms/get-dms  Resources for migration Microsoft Azure On-premises workloads Azure Database Migration Service

Partner Partner Solution Capabilities & Experience Country Availability OCP Catalog Listing Co-Sell Status Partner Contact RecordPoint Azure Database for PostgreSQL Net new app dev; App innovation/replat Australia, USA, UK RecordPoint In Market [email protected] Satalyst Pty LTD Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat Australia MySQL and PostgreSQL database migration to Azure database In Market [email protected] Kangaroot BVBA Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev Belgium, Netherlands, Luxemburg Open Source Databases in Azure Co-Sell Prioritized Peter Dens [email protected] Oktabit S.A. Azure Database for MySQL App innovation/replat Greece Sybil In Market [email protected] Rockplace Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat Korea OSS on Azure Co-Sell Prioritized [email protected] Actiglobal Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat Mexico Data Platform Optimization, Administration, and Configuration In Market OMAR VIVES SARMIENTO [email protected] Syone SA Azure Database for MySQL Lift and shift; Net new app dev; App innovation/replat Portugal, Spain, Belgium, Norway, Sweden MySQL / MariaDB on Azure In Market [email protected] Ascent Technology Azure Database for MySQL Azure Database for PostgreSQL Lift and shift S Africa Opensource DB on Azure Co-Sell Prioritized [email protected] 10th Magnitude Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat USA 10vu Azure Migration Co-Sell Ready Jason Rook [email protected] Credera Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat USA Azure Migration Factory Co-Sell Ready John Franks [email protected] DB Best Technologies Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat USA Data Estate Modernization Co-Sell Ready Zach Barlow [email protected] Neal Analytics, LLC Azure Database for MySQL Lift and shift; Net new app dev; App innovation/replat USA, Mexico, Canada End to End Data Estate Modernization In Market David Brown [email protected] Pactera Technologies Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat USA, China, India Website Listing in process [email protected] Pragmatic Works Azure Database for MySQL Azure Database for PostgreSQL Lift and shift USA, CA Azure Data Platform Pilot Co-Sell Prioritized Robert Beatty [email protected] SNP Technologies Inc Azure Database for MySQL Azure Database for PostgreSQL Lift and shift; Net new app dev; App innovation/replat USA MySQL Migration to Azure Co-Sell Prioritized Sachin Parikh [email protected] OSS Databases on Azure Partners Internal use only The following partners have solutions in market with Azure Database for MySQL and/or PostgreSQL. They are ready to be brought into customer engagements, workshops, demand gen campaigns, etc.

Objection handling Objection Response Will I end up paying more with managed service if I’m moving form IaaS or on-premises? No, you will most likely pay less. IaaS and on prem servers are traditionally over built to handle spikes in workload. Azure Database Services for MySQL and MariaDB allow you to provision in line with your typical workloads but offer the ability to scale-up on the fly as workloads increase. HA is built in with no need for extra replicas. Will I need to rebuild my app? No, Azure Database Services are built around the community database engines of MySQL and MariaDB.  If your app works outside of Azure, moving to Azure will be painless. Will I be able to move off of Azure? Yes, by utilizing the community versions of MySQL and MariaDB you will not be locked into the service and can leave Azure with community tools Why should I choose Azure for my workloads vs. Amazon, Google, and others? Competitor cloud vendors not offer indemnification of intellectual property for open source workloads. Microsoft offers the Azure IP Advantage program to protect against lawsuits. How difficult will it be to move my app to the cloud? No code changes are necessary to move existing applications to Azure IaaS.  Zero downtime is achievable by doing an online migration using Azure Database Migration Services. MICROSOFT CONFIDENTIAL

MySQL homepage: http://aka.ms/mysql                   MariaDB homepage: http://aka.ms/mariadb MySQL documentation: http://aka.ms/mysqldocs MariaDB documentation: https://aka.ms/mariadbdocs Ask Questions: [email protected] [email protected] MySQL Videos: https://aka.ms/mysql-azure-videos   MariaDB Videos: https://aka.ms/mariadb-azure-videos Content - Azure Database for MySQL

Azure service page: http://aka.ms/postgresql Documentation: Azure Database for PostgreSQL Discussion forum: MSDN , StackOverflow Feedback forum: User Voice Hands-on Lab: http://aka.ms/postgresqlhol GitHub repo: https://github.com/Azure/azure-postgresql Content – Azure Database for PostgreSQL

Old slides

Migration Approach

What to Discover Tools for Discovery Application Details: Multi-Tenant, SaaS Identify workloads move together Cores, IOPS, # of DBs and Size Environment topology Replication Details Monitoring and Logging OLTP and OLAP details Third Party applications Custom fields Data encrypted? Sharding and Partitioning details Encoding details (UTF 8/16?) HA and DR details Back up and Retention PII data stored? Type of PII data Compliance details (ex: GDPR, HIPPA) PCI complaint? Financial data? Performance and response times MAP Microsoft Assessment and Planning Toolkit: Inventory, assessment Download Link: MAP Tool kit Azure Migrate for application workloads and dependencies. Ora2Pg: scans Oracle Databases and collects schema, Data. Download | Documentation Inventory collection template –click Icon Outcomes of Discovery Discover the server, application, and database assets of different sources to PostgreSQL. Determine application dependencies. Workloads that need to be migrated together (Server, Application, Databases). Inventory collection template filled. Ora2Pg preliminary inventory details. Discovery

Assessment What to assess Tools for assessment Review and Assess output of Azure migration assistant and Azure Migration output Assess application technologies and target remediation SKUs, dependency map with application, server, DBs. Run and gather output from Ora2Pg Identify Application and Databases breaking and critical changes. For ex: Third party application that does not support movement to Azure, functions, Package body and nested procedure calls , Synonyms, Table sub-partitions etc. Map the discovered inventory with limitations of Azure PostgreSQL. For ex: Storage  IOPS Review LOBS, XML, JSON types Data load frequency. HA/DR- possible configurations and cost assessment Table partitioning, Indexes, Ingestion record sizes Realtime analytical workload scenarios. Data Encryption. Experience from previous migration using Ora2Pg can convert 80-90% schema and 50% of code for very complex code involves nested procedure. Please consider this for your planning and migration timelines. Application Assessment Azure Migrate Assessment link | Download the Migration Assistant for your .NET and PHP Apps Database Assessment Ora2Pg Download | Sample Assessment : Migration Guide and Migration Journey and Tools Video Outcomes of assessment Target SKUs For ex: single server Vs Hyperscale (see next slide for sample key decision drivers) Target topology- Application, DB, storage, sizing, network requires, back ups, monitoring, security, logging, analytics, optimization and Modernize options post migration, replication (geo Vs local), back up and retention, storage size, application remediation areas, code changes, function changes/re-write code paths, Deployment and cutover plan Decision to leave some DBs On-prem and move application only using hybrid connections and move to IaaS for now with a future path to optimize and modernization in the radar i.e. move on to PaaS.

Migrate to Azure Database PostgreSQL (Hyperscale) Assessment : Sample decision drivers Assessment and Tools Output Azure Database for PostgreSQL (Single Server) Scale beyond single node: Multi-Tenant and SaaS Applications? Is customer currently on AWS/Using Hyperscale? Y/N No Yes Concurrency: Require Faster Response times? Parallel queries? Ingest terabytes of data + DB Sizes > 100 GB? Functions and Sub functions require are complex and sub sec response times? OLTP with high volumes + Real-time analytical workloads?+ Analyze data in Realtime? Horizontal scale out by sharding across different nodes? Performance scale

Migration synopsis Tools for MIGRATION Provision resources based on target topology identified in Assessment phase Create NSG rule and network pre-requisites for migration Run Ora2Pg or DMS Migrate schema, Data Remediate application code to talk to new platform Remediate DB code that cannot be converted by tool (Ora2Pg/ DMS) Create Azure DMS configuration and network re-pre-requisites Identify non-breaking code and objects that are not migrated and converted and form post-remediation plan. Create optimization report. Azure Database Migration Service (DMS) Migrate to PostgreSQL | Migrate RDS PostgreSQL DMS| DAMT Tool Kit Known Issues for online migrations Database Migration using Ora2Pg Download | Sample Assessment : Outcomes of MIGRATION Schema and data migrated Application migrated and remediated Cutover plan completed (Online Vs Offline migrations) Sanity and smoke testing completed. Ready to perform testing and validation MIGRATION

Post-Migration synopsis Best PRACTICES After migration it is important to use an iterative optimization process to ensure the best performance and functionality of your solution in the target environment Verification: Verify the schema and Data Application connectivity and post migration remediations Optimization oppurtunities : Optimize with configuration changes identified during Assessment phase and look for key indicators Look for resource contention Database performance using pg_stat_statements module Check links in best practice section if you are using Pgbench for testing performance Use Azure Advisor for Azure deployments Concurrency : Optimizing Autovaccum : Optimizing autovacuum on Azure Database for PostgreSQL server Bulk Inserts: Optimizing bulk inserts and use of transient data on Azure Database for PostgreSQL server Look for query stats: Optimize query statistics collection in Azure Database for PostgreSQL server Performance Best Practices Performance Optimization Recommendations Tuning Best Practices Query Store Best Practices Monitoring Azure DB for PostgreSQL Outcomes of OPTMIZATION Azure database for PostgreSQL performing at desired level with no memory, CPU resource contentions and configured as advised in the above artifacts and links Optimized client applications suit to modern platform. For additional information , refer to the following resources. Manage your cloud spend with transparency and accuracy using Azure Cost Management . Save with Azure Offers : Take advantage of offers from Azure, such as Azure Hybrid Benefit and Azure Reserved Virtual Machine Instances , and continue right-sizing your migrated virtual machines to your workloads for improved value. Secure and manage : Help protect and manage your virtual machines, applications, and data using Azure services. Post-MIGRATION
Tags