VMware - HCX - Architecture and Design .pdf

VMware HCX

1. Confidential │©2019 VMware, Inc.
VMware HCX

2. Confidential│©2019 VMware, Inc. 2
•This presentation may contain product features or functionality that are currently under
development.
•This overview of new technology represents no commitment from VMware to deliver
these features in any generally available product.
•Features are subject to change, and must not be included in contracts, purchase orders,
or sales agreements of any kind.
•Technical feasibility and market demand will affect final delivery.
•Pricing and packaging for any new features/functionality/technology discussed or
presented, have not been determined.
•This information is confidential.
Disclaimer
The information in this presentation is for informational purposes only and may not be incorporated into any contract. There is no commitment or obligation
to deliver any items presented herein.

3. 3Confidential│©2019 VMware, Inc.
HCX Use Case & Services overview
But what is a “Hybrid Cloud”

4. Confidential│©2019 VMware, Inc. 4
Workload Migration and Mobility Challenges
Barriers customers face when trying to move workloads to the cloud
Application
Dependency
Mapping Delays
Cross-site
networking and
security issues
Incompatible,
non-interoperable
stacks
Business
Disruption

5. Confidential│©2019 VMware, Inc.
VMware HCX
5
CONFIDENTIAL5
Accelerate cloud adoption
App Mobility across vSphere
5.0+ version on-premises to
VMware based clouds
Hybrid Cloud Extension
Multisite, WAN Optimized,
Secured, Load Balanced, Traffic
Engineered Network Extension
Transform With Bulk Migration
Zero-downtime live migrations
and scheduled large-scale warm
migrations.
Infrastructure Hybridity
HCX
HCX
Enterprise HCX
ProviderInfrastructure Abstraction
App Mobility
Internet / WAN
vSphere 5.0+
On-Prem VMware Cloud
on AWS
Rapid
Migration
Migrations and
Transformation
Burst
Capacity
Hybrid
Applications
Legacy Equipment
Replacement
Avoidance
Consolidate
smaller DCs to
cloud
Hardware/Software
Refresh/upgrades
USAGE SCENARIOS

6. Confidential│©2019 VMware, Inc. 6
Legacy Data Center
Migrate
VMware Cloud Foundation
Hybrid Cloud
Private DatacenterPublic Cloud Providers
VMware HCX
Automated day 0 to day 2 operations of the entire cloud infrastructure
VMware Cloud Foundation
vSphereNSXvSAN
SDDC Manager VMware Cloud
on AWS
AmsterdamDallas
Sydney
HCXHCX

7. Confidential│©2019 VMware, Inc. 7
True Hybrid Cloud
Consistent Infrastructure creates Consistent Operations
VMware Cloud Foundation
Hybrid Cloud
Private DatacenterPublic Cloud Providers
VMware Cloud Foundation
vSphereNSXvSAN
SDDC Manager VMware Cloud
on AWS
AmsterdamDallas
Sydney
VMware Cloud Foundation
vSphereNSXvSAN
SDDC ManagerHybrid Cloud
HCX HCX

8. Confidential│©2019 VMware, Inc. 8
VMware HCX –Enterprise Modernization use case
Large Financial Institution –adopting VCF
Legacy Data Center
Migrate
VMware Cloud Foundation
vSphereNSXvSAN
SDDC Manager
HCX
Legacy Data Center
HCX
VMware Cloud
Foundation
•Transforming from Legacy DCs to moderns
SDDC using VCF and HCX
•Consolidating multiple small DC/Regions
HCX Advantage
-Driving Large scale migration
-Automatic VM transformation
-No business impact
-Map legacy IPs/Networks to new SDDC
-Successful outcome of transformation in weeks
-Self-Service by the customer
Customer Scenario

9. Confidential│©2019 VMware, Inc. 9
VMware HCX –VMC Adoption use case
Large Government Loan and Finance Institution
On-Prem
Datacenter
VMC on AWS
DR site
Migrate
HCX
Protect
HCX
•Migrating Large scale to VMC
•Protect from VMC to existing DR side
HCX Advantage
-Driving Large scale migration
-DRaaS+ HCX for Protection to DR side
-Secure migration and DR traffic
-Network and IP preservation
-Partial DR
-High scale L2 Extensibility
Customer Scenario

10. Confidential│©2019 VMware, Inc. 10
VMware HCX –VMW VCPP Adoption use case
American Airlines with IBM Cloud
Legacy Data
Center
IBM Cloud
Using VCF
Migration &
Hybrid
Connectivity
HCX
Physical
Storage
Tied to Apps
HCX
•Migrate applications to IBM Cloud
•Using Physical DB from on-prem Datacenter
•Maintain IP address and Network
HCX Advantage
-Extend & Transform from Cisco N1K to NSX
-Maintain IP addresses
-Large scale migration w/o business impact
-DC Extension to use on-prem DB
-High performance L2 Extensivity
-True Hybrid Architecture
Customer Scenario

11. Confidential│©2019 VMware, Inc. 11
VMware HCX –Multi-Cloud Adoption use case
Largest Bank in Canada
VMware Cloud Foundation
vSphereNSXvSAN
SDDC
Manager
HCX
VMC on AWS
VMware Cloud Foundation
vSphereNSXvSANSDDC
Manager
•Multi-cloud Strategy
•Migrate Apps to cloud on-demand
•Keep hybridity on for multi-site
HCX Advantage
-Hybrid architecture across on-prem and clouds
-Hybridity across versions/stacks
-Large scale mobility of workloads
-Mobility on demand w/ business impact
-Secure and high performanceDC extension
Customer Scenario

12. Confidential│©2019 VMware, Inc.
VMware HCX -Services
SDDCSDDC HCX
Benefit from HCX to re-balance at will

13. Confidential│©2019 VMware, Inc.
Migration using HCX
Cold Migration
HCX vMotion
HCX Bulk
Replication Assisted
vMotion
NFC
vMotion
HBR+
vMotion
HBR
Data
TransferVM State
Off
On
On
On
VM
Migration
Cold
Live
Live
Warm
Best-In-Class : HCX Migration Options
OS Assisted ReplicationAgentOnWarm
HCX Enterprise
HCX Advanced

14. 14Confidential│©2019 VMware, Inc.
HCX Enterprise

15. Confidential│©2019 VMware, Inc. 15
HCX Enterprise
KVM + Hyper-V to
vSphere Migration
Replication
Assisted vMotion
/ Live Bulk
Migration with zero
downtime
Advanced
Disaster Recovery
with SRM Readiness
NON-VSPHERE
BULK MIGRATION
LARGE SCALE
LIVE
MIGRATION
OPTIMIZED
DISASTER RECOVERY
Add-On SKU for Enterprise Features

16. Confidential│©2019 VMware, Inc.
Migration using HCX
Cold Migration
HCX vMotion
HCX Bulk
Replication Assisted
vMotion
NFC
vMotion
HBR+
vMotion
HBR
Data
TransferVM State
Off
On
On
On
VM
Migration
Cold
Live
Live
Warm
Best-In-Class : HCX Migration Options
OS Assisted ReplicationAgentOnWarm
HCX Enterprise
HCX Advanced

17. Confidential│©2019 VMware, Inc.
HCX RAV -How It Works
17
Start Migration
Full SyncContinuous Sync
ReplicationReplication
Online Sync
Replication
Disable
Replication
Prepare for
Delta vMotion
Delta vMotion
vMotion
Memory state
copy
vMotion
Switchover
vMotion
Migration
Complete
Snapshot VM
Prep with
replicated seed
disks
Replication Phase
Delta vMotionPhase (Live Switchover)
Maintenance Window Start here

18. Confidential│©2019 VMware, Inc. 18
Site Recovery with HCX data path: a best-in-class DR service
Combine best-in-class DR automation
capabilities of VMware SRM with
best-in-class hybridity services of
HCX for efficient DR protection of
most critical workloads
DR automation
•Extensible DR runbooks for
orchestrated recovery of many VMs
•Non-disruptive full-site and app-level
testing workflows
•Detailed DR reports for audit
purposes and RTO measurement
Replication & Hybridity
•WAN optimization and traffic shaping
•Secure tunneling of replication traffic
•Easy-to-setup L2 stretch networks to
avoid re-IP of recovered VMs
Private Cloud
(Production)
SRM
HCX HCXEfficient VM data replication
Streamlined DR automation
Private (Recovery
site)
SRM

19. Confidential│©2019 VMware, Inc. 19
Benefits of the HCX hybrid connectivity + VMware Site Recovery
Private cloud
(recovery site)
Private Cloud
(Production)
HCX
SRM DR Automation
CapabilityBenefit
WAN optimized replication traffic
(limits, deduplication, compression)
Balance replication vs. production traffic and reduce
egress bandwidth
Encrypted overlay over WAN or internetsecure path for DR traffic
Scalable and easy L2 network extensionAvoid having to re-IP recovered VMs
Supports partial DR scenarions
HCX RAV and vMotionoptionsComplete Disaster avoidance
Support for VDS and all flavors of NSXAdopt NSX directly in DR site
Proximity RoutingOptimize VM access when in DR site

20. Confidential│©2019 VMware, Inc.
Mobility Group –List View

21. Confidential│©2019 VMware, Inc.
Mobility Group –Drill Down

22. Confidential│©2019 VMware, Inc. 26
VMware HCX –Cloud-to-Cloud Hybridity and Mobility
HCX
VMC on AWS
VMware Cloud Foundation
vSphereNSXvSANSDDC
Manager
•Move workloads between clouds
•Cloud-to-Cloud Data Protection
•Hybrid connectivity between clouds
HCX Advantage
-Hybrid architecture across multi-cloud
-Move workloads between clouds seamlessly
-Extend networks between clouds
-Protect workloads between and across clouds
Customer Scenario
VMC on AWS
VMware Cloud
on Azure

23. 27Confidential│©2019 VMware, Inc.
HCX Components

24. Confidential│©2019 VMware, Inc. 28
Topics to be covered in this section
.
•HCX Components:
•HCX Manager (Connector)
•HCX Manager (Full)
•HCX Interconnect (HCX-WAN-IX)
•HCX WAN Optimization (HCX-WAN-OPT)
•HCX Network Extension (HCX-NET-EXT)
•HCX Sentinel Gateway (HCX-SGW)
•HCX Sentinel Data Receiver (HCX-SDR)
•HCX Sentinel Agent
•HCX Component Flows:
•Bulk & vMotion
•WAN Opt
•Network Extension
•OS Assisted Migration

25. Confidential│©2019 VMware, Inc. 29
HCX Service Deployment Platform –Multi-Site Management Functions & Operator ViewsHCX Components –HCX Manager
HCX Manager (Connector)
§One Manager deployed as an OVA per vCenter Server.
§Provides the HCX configuration via catalog and
§integration with vSphere via plugin and context menus.
§Decoupled management pane glass with Stand Alone UI.
§Orchestrates and abstracts deployment and mobility jobs across distinct domains
as single user operations.
Multisite Management Path
HCX to HCX Site Pairing
HCX Manager
Previously:
HCX Enterprise
HCM
Previously:
HCX Cloud
NSP

26. Confidential│©2019 VMware, Inc.
VMware HCX –Services Catalog
SDDCSDDC HCX

27. Confidential│©2019 VMware, Inc.
What is Infrastructure Hybridity?
Direct ConnectOn-premise
Datacenters
WAN Edge Fabric
•WAN Optimization: Compression, De-Dup
•Intelligent Routing
•Strong Suite B Encryption
Hybridity/Migration Pipeline
MPLS
Network Extension & Mobility
Services
•Secure Migration Proxies
•High-throughput L2 stretching
Target Site

28. Confidential│©2019 VMware, Inc. 32
Virtual Machine Migrations and Disaster RecoveryHCX Components –IX Interconnect Appliance
HCX WAN IX
§Uses Replication and vMotion-based
protocols –securely proxied over the
Internet or private paths to the HCX target.
§Provides migration and DR capabilities with
strong encryption, traffic engineering.

29. Confidential│©2019 VMware, Inc. 33
In-Line Data Reduction & WAN Path Conditioning HCX Components –WAN Optimization
HCX WAN OPT
§The VMware HCX WAN Optimization
service improves performance
characteristics of the private lines or
Internet paths by applying WAN
optimization techniques like the data
de-duplication and line conditioning.
§It accelerates on-boarding to the cloud
using Internet/VPN-without waiting for
Direct Connect/MPLS circuits.

30. Confidential│©2019 VMware, Inc. 34
Layer 2 Extension for DVS / NS1KV / VXLAN / GENEVE Based NetworksHCX Components –Network Extension Appliance
HCX-NET-EXT

31. Confidential│©2019 VMware, Inc. 35
Layer 2 Extension with Layer 3 VM Mobility (Proximity RoutingHCX Components –Network Extension Appliance
HCX-NET-EXT

32. Confidential│©2019 VMware, Inc. 36
Non vSphere to vSphere Virtual Machine MigrationsHCX Components –OS Assisted Migrations
HCX-SGW/SDR

33. 37Confidential│©2019 VMware, Inc.
Summarized Component Flows
for HCX Operations

34. Confidential│©2019 VMware, Inc. 38
Migration Path from Cluster to ClusterComponent Flows for Bulk & vMotionOperations

35. Confidential│©2019 VMware, Inc. 39
In-Line Data Reduction & WAN Path Conditioning Component Flows for WAN Optimized HCX Operations

36. Confidential│©2019 VMware, Inc. 40
Layer 2 Extension for DVS / NS1KV / VXLAN / GENEVE Based NetworksSystem Path for Network Extension Traffic

37. Confidential│©2019 VMware, Inc. 41
Non vSphere to vSphere Virtual Machine MigrationsSystem Path for OS Assisted Migration Operations
KVM
HCX-SGW HCX-SDR
HCX-Agents

38. 42Confidential│©2019 VMware, Inc.
Understanding the HCX
Migration Options

39. Confidential│©2019 VMware, Inc.
Migration using HCX
Cold Migration
HCX vMotion
HCX Bulk
Replication Assisted
vMotion
NFC
vMotion
HBR+
vMotion
HBR
Data
TransferVM State
Off
On
On
On
VM
Migration
Cold
Live
Live
Warm
Best-In-Class : HCX Migration Options
OS Assisted ReplicationAgentOnWarm
HCX Enterprise
HCX Advanced

40. Confidential│©2019 VMware, Inc. 44
VR/HBR for Efficient and Compatible
Moves.
•vSphere 5+ / VM Hardware v7+
•AMD to Intel.
Parallel: Mass migration with Scheduled
Low Downtime switchover.
Highly Resilient: Transfer halts/resumes on
network path disruptions.
VM Transformation during switchover.
(Disk Type, Tools, HW, Pre/Post Scripts)
Highly Compatible HCX vMotion
•vSphere 5.5 -7, Hardware v9+,
•vMotionwithout EVC requirements.
•Works with isolated & overlapping vMotion
subnets.
Serial Operations: Single VM migration with
Live Switchover.
No Virtual Machine changes during the live
switchover.
Ideal for DR avoidance & cloud bursting.
HCX Bulk Migration
”The Resilient Workhorse for Mass Migrations” HCX vMotion
“Live State ”
HCX Advanced Migration Options –At a Glance Comparison
Not mutually exclusive approaches. Use what makes sense.

41. Confidential│©2019 VMware, Inc. 45
HCX Cold Migration is auto-selected when
the selected source virtual machine is
powered off.
What about HCX Cold Migration?
Click to edit optional subtitle

42. Confidential│©2019 VMware, Inc. 46
HCX vMotionCapabilities
Seamlessly Migrate VMs Across Infrastructure Boundaries
•Encrypted vMotionbetween legacy source and SDDC target
•Bi-directional, (Cross-CPU family compatibility without cluster EVC )
•Compatible from vSphere 5.5+ environments (VM HW v9)
•In-flight Optimization (Deduplication / Compression)
•Supports overlapping vMotionvmkernelsubnets.
•Serial migration –Protocol tendency to saturate.
•Requires 150ms RTT Latency (HCX supports 250ms with WAN OPT)
•vSphere 6+ required (HCX: Supports 5.5+)
•Does not support encryption (HCX: Inflight encryption)
•Requires routed vMotionnetworks (HCX vMotionProxy doesn’t require
the vMotionSRC/DST vmkernelnetworks to be aware of each other)
•Does not support 3rdparty switches (HCX supports N1kv Migrations)
Overview
Target SDDC
SDDC
vSphere
5.5+
Considering Cross vCenter vMotion/ Long Distance vMotion

43. Confidential│©2019 VMware, Inc. 47
HCX Bulk Migration Capabilities
Low Downtime, Highly Compatible, Resilient to Network Path Degradation
•Encrypted Replication migration between legacy source and SDDC target
•Bi-directional, (Cross-Vendor CPU compatibility, e.g. AMD to INTEL)
•Compatible from vSphere 5+ , VM HW version 7+
•WAN Optimized (Deduplication / Compression)
•Optimized for parallel migration –single replications will not saturate the
link. Build migration waves.
•No line in the sand latency requirements (Latency will influence migration )
•Supports RDMvmigrations.
•Supports Virtual Machine transformation as part of the migration workflow.
Tools and VM Hardware can be upgraded to the latest at the target.
•Supports Pre/Post Customization scripts.
•Last resort access hostname/re-IP for corner cases where low downtime is
not a strong requirements.
Overview
Target SDDC
SDDC
vSphere
Additional Capabilities
5.0+
(ESXi5 w/5.1 VC)

44. Confidential│©2019 VMware, Inc.
HCX RAV –Best of Bulk Migration and vMotion
48
Start Migration
Full SyncContinuous Sync
ReplicationReplication
Online Sync
Replication
Disable
Replication
Prepare for
Delta vMotion
Delta vMotion
vMotion
Memory state
copy
vMotion
Switchover
vMotion
Migration
Complete
Snapshot VM
Prep with
replicated seed
disks
Replication Phase
Delta vMotionPhase (Live Switchover)
Maintenance Window Start here

45. Confidential│©2019 VMware, Inc. 49
HCX OS Assisted Migration (OSAM)
KVM Guest VMs replicating to Target SDDC while
remaining online in source environment
Target SDDCSource –KVM Host
OS Assisted Replication-based migration with
WAN Acceleration
Active Replicating
•Utilizes OS assisted replication to migrate
(conceptually similar tovSphere replication)
•Source VM remains online during replication
•Quiesce the source VM for final sync before
migration
•Perform software stack adaptation (fixup)
•Source VM is powered off and the migrated
VM is powered on in target site, for low
downtime switchover
•VMware tools is installed on the migrated VM
Target SDDCSource –KVM Host
At user-selected time, the VM is powered off at
source, powered on in target site, for low down-time
switchover
Powered off Active

46. Confidential│©2019 VMware, Inc. 50
HCX Migration Configuration Maximums/Limits

47. 51Confidential│©2019 VMware, Inc.
HCX Network Extension

48. Confidential│©2019 VMware, Inc. 52
CapabilitiesHCX Network Extension

49. Confidential│©2019 VMware, Inc. 53
Layer 2 Extension for DVS / NS1KV / VXLAN / GENEVE Based NetworksSystem Path for Network Extension Traffic

50. Confidential│©2019 VMware, Inc. 54
HCX Network Extension with NSXvProximity RoutingSystem Path for Network Extension Traffic

51. Confidential│©2019 VMware, Inc. 55
HCX Network Extension Configuration Maximums/Limits

52. 56Confidential│©2019 VMware, Inc.
Site Level HCX Architectures

53. Confidential│©2019 VMware, Inc. 57
Bringing it all togetherHCX Architecture –Site to Site Deployment

54. Confidential│©2019 VMware, Inc. 58
HCX Architectures –VMware Cloud on AWS (VMC)

55. Confidential│©2019 VMware, Inc. 59
Click to edit optional subtitleHCX Architectures –Multi Site Deployments

56. Confidential│©2019 VMware, Inc. 60
HCX Mobility Cluster
(Requires vSphere on
Source)
VIO
HCX
Source
Infrastructure
Target
Infrastructure
VLAN
Network
Infra
HCX Network Extension
HCX Interconnect Deployment
•Deploy HCX multi-site system software
•Setup HCX Interconnects
•Extend Networks
•Install OS-assisted migration sentinels on
the KVM guest VMs
•Migrate VMs from KVM to vSphere/VIO
Target vSphere/VIO
KVM
Click to edit optional subtitleHCX Architectures –OpenStack/KVM to VIO/vSphere
HCX-SGW

57. Confidential│©2019 VMware, Inc. 61
HCX Connector to HCX A & HCX BHCX Architectures –Connecting SDDC HCX Systems

58. Confidential│©2019 VMware, Inc. 62
“HCX to HCX” | “Cloud to Cloud” Enabled HCX Architectures –Connecting SDDC HCX Systems

59. Confidential│©2019 VMware, Inc. 64
HCX Architectures –Source vCenterswith Linked Mode
§Applications can be migrated out of
the vCenter Server’s legacy clusters
usingHCX built-in compatibility to
mitigate EVC related cluster
constraints,or between geographically
dispersedclusters efficiently with HCX
data reduction.
§Intel to AMD.

60. 65Confidential│©2019 VMware, Inc.
Deployment Planning
and Best Practices

61. Confidential│©2019 VMware, Inc. 67
NSX Networking
Corp LAN/WAN
Source
Management VLAN
HCX
Manager
VDS, NSX or N1K
Management VLAN
HCX Manager
(Connector)
VMVM
VM
Hybridity
Tunnel
Step 1 –Install and Activate HCX Managers
Palo Alto Milwaukee
Destination
VM VLAN
NSX Edge
Management VLAN
Uplink VLAN

62. Confidential│©2019 VMware, Inc. 68
NSX Networking
Corp LAN/WAN
Source
Management VLAN
HCXManager
VDS, NSX or N1K
Management VLAN
HCXManager
VMVM
VM
Hybridity
Tunnel
Step 2 –Site Pairing and Compute Profiles
Palo Alto Milwaukee
Destination
VM VLAN
Site Pairing
Uplink VLAN
NSX Edge
Source Environment
ComputeProfile
Destination Environment
ComputeProfile

63. Confidential│©2019 VMware, Inc. 69
Hybrid
Interconnect
WAN Optimizer
Network
Extension
NSX Networking
Corp LAN/WAN
Source
Management VLAN
vMotionVLAN
Extended L2
VLAN
Uplink VLAN
HCXCloud
NSX EdgeHybrid
Interconnect
WAN Optimizer
Network
Extension
VDS, NSX or N1K
Management VLAN
vMotionVLAN
Uplink VLAN
HCXEnterprise
VMVM
VM
Establish
Hybridity
Step 3 –Establish Site to Site Hybridity
Palo Alto Milwaukee
Destination
HCX TRUNK HCX TRUNK
VM VLAN

64. Confidential│©2019 VMware, Inc. 70
Hybrid
Interconnect
WAN Optimizer
Network
Extension
NSX Networking
Corp LAN/WAN
Source
Management VLAN
vMotionVLAN
Extended L2
VLAN
Uplink VLAN
HCX
Manager
NSX EdgeHybrid
Interconnect
WAN Optimizer
Network
Extension
VDS, NSX or N1K
Management VLAN
vMotionVLAN
Uplink VLAN
HCXManager
(Connector)
VMVM
VM
HCX Service
Mesh
Step 4 –Extend Networks, Migrate and Protect Workloads
Palo Alto Milwaukee
Destination
HCX TRUNK HCX TRUNK
VM VLAN

65. Confidential│©2019 VMware, Inc. 71
For Installations with Private Target EnvironmentsHCX Deployment Workflows

66. Confidential│©2019 VMware, Inc. 72
For Installations with HCX Enabled Public CloudsHCX Deployment Workflows

67. Confidential│©2019 VMware, Inc. 73
HCX Network Profiles
§HCX deployments will use all configured Network Profiles in the Compute Profile
§An IP range should be set aside for HCX in each of the Network Profiles.
§HCX will only use 1 IP address per network profiles.
§HCX appliance deployments will fail if any of the Network Profiles are exhausted.
§Individual Network Profiles can be used in many Compute Profiles.

68. Confidential│©2019 VMware, Inc. 74
HCX Proxy Configuration for HTTPS Connections

69. Confidential│©2019 VMware, Inc.
Thank You