Kubernetes at Scale: Going Multi-Cluster with Istio

Divine Odazie and Jubril Oyetunji share tips on Going Multi-Cluster with Istio Service Mesh at DevOpsDays Houston.

1. 1
Kubernetes at Scale:
Going Multi-Cluster
with Istio
Webinar
Divine Odazie
DevOpsDays Houston 2024
Jubril Oyetunji

2. 22
Divine Odazie
●Technology Evangelist
at Severalnines
●Electrical/Electronics Engineering
●Certified Kubernetes Application
Developer (CKAD)
●Certified AWS Solutions
Architect
●Excited to speak at DevOpsDays
Houston 2024!!
Control Your Data

3. 33
Jubril Oyetunji
●Independent Software
Engineer & Technical Writer
●Loves making Terraform
providers
●Dabbles in IOT
●Excited to speak at
DevOpsDays Houston 2024!!
Control Your Data

4. 4
1.What is Multi-Cluster?
2.What is a Service Mesh?
3.Why Multi-Cluster?
4.Demo: Multi-Cluster with Istio
5.Challenges with multi-cluster
Control Your Data

5. 5
What is Multi-Cluster?
Multi-cluster Kubernetes is exactly what it
sounds like.
It refers to an architecture that distributes
applications and data in two or more
Kubernetes clusters.
Control Your Data

6. 6
Service mesh

A service mesh is a dedicated infrastructure
layer that facilitates service-to-service
communication.
It provides traffic management, security,
observability, without any code changes




Control Your Data

7. 7
Istio service mesh
●“Istio” is Greek for sail
●Built on top of Envoy proxy
●CNCF graduated project
●Secure service-to-service
communication
●Load balancing for various traffic
types
●Fine-grained traffic control & routing
●Policy layer for access, rate limits &
quotas, etc.




Control Your Data

8. 8
Why
Multi-Cluster?


Control Your Data

9. 9
Disaster recovery
A multi-cluster set up can significantly
enhance your disaster recovery capabilities
by distributing your workloads across
geographically dispersed clusters.

Istio specifically has the concept of failovers
to help migrate traffic from a failing cluster.



Control Your Data

10. 10
Localization
Multi-Cluster can be useful for delivering you
applications closer to your users. This can
help you:
-Reduce latency
-Improve response times
Control Your Data

11. 11
Kubernetes upgrades
With Multi-Cluster you can experiment
with different versions of Kubernetes in a
controlled fashion.


Control Your Data
Public Cloud Co-Location On-Premises

12. 12 12
A/B Testing
Targeted Rollouts with Traffic Splitting
Deploy different application versions (A/B) to
specific clusters within the multi-cluster mesh.
Istio routes traffic percentages to each version
for controlled testing
Built-in monitoring capabilities to gather data on
user behavior and application performance for
both versions




Control Your Data

13. 13
Multi-Cloud/Hybrid Environments
Flexibility and Cost Optimization
●Utilize the strengths of different
cloud providers for specific
workloads.

●Potentially achieve better pricing
by avoiding vendor lock-in.



Leverage Existing Infrastructure
●Integrate on-prem workloads with
cloud deployments for a hybrid
approach.

●Migrate workloads to the cloud at
your own pace.



Control Your Data

14. 14
Webinar
14
Going
Multi-Cluster
with Istio
Service Mesh
Control Your Data

15. 15 15
Prerequisites
Two Kubernetes clusters
Istioctl – Istio’s configuration
command line utility
Istio Repo

Control Your Data

16. 16




Control Your Data

17. 17
Multi-Cluster setup
Control Your Data
Install Istio

1 2 3
Install the east-west gateway Deploy your services

18. 18Control Your Data

19. 19 19
Challenges with
Multi-Cluster
●Cost
●Can be painful at times
●Increased deployment complexity
Control Your Data

20. 20
Tech Evangelist @ Severalnines
Divine Odazie
@_Odazie
Independent Software Engineer
Jubril Oyetunji
@s1ntaxe770r