Event Driven Autoscaling using KEDA - MVP

Slidedeck used during the COding Night NZ sesison on 2 September 2024. The recording of the session is available on YouTube
https://www.youtube.com/live/a8gwqaJR1Ck?si=V9iskiZQCUHOvgzj

1. Event Driven Autoscaling
using
KEDA
Nilesh Gule @nileshgule

2. $whoami
{
“name”: “Nilesh Gule”,
“website” : “https://www.HandsOnArchitect.com",
“github” : “https://GitHub.com/NileshGule"
“twitter” : “@nileshgule”,
“linkedin” : “https://www.linkedin.com/in/nileshgule”,
“YouTube” : “https://www.YouTube.com/@nilesh-gule”
“likes” : “Technical Evangelism, Cricket”,
}

4. @nileshgule
KEDA
Kubernets based Event Driven Autoscaling
Scaling in Kubernetes KEDA Overview
TechTalks demo with RabbitMQ Autoscaling with KEDA
KEDA Architecture
Agenda

5. Pre-requisites
•Self contained application with all its
dependencies
Docker
•Orchestrates containers
•Self healing
•Service discovery
•Scaling
Kubernetes
•Dockerhub / private container registry
•Repository for storing container images
Container Registry
•Managed Kubernetes service on Azure
•Native integration with other Azure services like Azure Active
Directory (AAD), Azure Container registry (ACR), Azure
Container Instances (ACI), Azure Monitor etc.
Azure Kubernetes Service (AKS)

6. Kubernetes scaling options
Horizontal Pod
Autoscaler
Vertical Pod
Autoscaler
Cluster AutoscalerManual

7. TechTalks Application Architecture
TechTalks ConsumerTechTalks Producer
TechTalks Frontend (UI)
Message Broker
Polyglot
Programming

8. Techtalks-producer
Azure-Melbourne-cluster
demo-azure-melbourne-rg
ngacrregistry
acrResourceGroup
Techtalks-consumer
TechTalks without KEDA

9. @nileshgule
Demo

10. Problem statement
•Unpredictable workload
•Special events (Christmas / New Year / Diwali / Deepavali / Thanksgiving etc.)
•Scale based on factors outside of Kubernetes cluster
•Scale based on combination of factors
•Unexpected event (large number of logs compared to normal)

11. @nileshgule
Demo KEDA in action

12. Techtalks-producer
Azure-Melbourne-cluster
demo-azure-melbourne-rg
ngacrregistry
acrResourceGroup
Techtalks-consumer
TechTalks with KEDA - AKS

13. KEDA Architecture

14. ScaledObject
apiVersion: keda.k8s.io/v1alpha1
kind: ScaledObject
metadata:
name: rabbitmq-consumer
namespace: default
labels:
deploymentName: rabbitmq-consumer-deployment
spec:
scaleTargetRef:
deploymentName: rabbitmq-consumer
pollingInterval: 5 # Optional. Default: 30 seconds
cooldownPeriod: 30 # Optional. Default: 300 seconds
minReplicaCount: 1 # Optional. Default: 0
maxReplicaCount: 30 # Optional. Default: 100
triggers:
- type: rabbitmq
metadata:
queueName: techtalks-consumer-techtalks
queueLength : ‘5’
authenticationRef:
name: trigger-auth-rabbitmq-host

15. KEDA Features

16. Run Containers at scale
❖KEDA supported scale triggers including Azure Event Hub,
Apache Kafka, RabbitMQ, MongoDB, MySQL, PostgreSQL
etc.
❖Robust autoscaling without managing complex
infrastructure
❖Scale to zero and pay only for use by the second
https://keda.sh/docs/2.15/scalers/

17. Summary
•KEDA helps to auto scale on metrics external to Kubernetes
•KEDA does not modify the behavior of the application
•Application designed using cloud native approach are more suited
for KEDA integrations
•KEDA helps to auto scale on composite metric
•KEDA supports authentication providers

18. References
https://www.youtube.com/@nilesh-gule
https://dapr.io/
Dapr Publish and Subscribe
Kubernetes Event Driven Autoscaling
Serverless - Dapr and Azure Container Apps

19. Containerize Apps Resources
https://github.com/NileshGule/pd-tech-fest-2019
https://github.com/NileshGule/cloud-native-ninja
https://github.com/NileshGule/techtalks-azure-container-apps-demo
Pd tech fest 2019 : https://github.com/NileshGule/pd-tech-fest-2019
Cloud Native Ninja : https://github.com/NileshGule/cloud-native-ninja
Azure Container Apps : https://github.com/NileshGule/techtalks-azure-container-apps-demo
Slides
https://www.slideshare.net/nileshgule/
Slideshare: https://www.slideshare.net/nileshgule/
https://speakerdeck.com/nileshgule/
Speaker Deck: https://speakerdeck.com/nileshgule/

20. Nilesh Gule
ARCHITECT | MICROSOFT MVP
“Code with Passion and
Strive for Excellence”
nileshgule
@nileshgule Nilesh Gule
NileshGule
www.handsonarchitect.com
https://www.youtube.com/@nilesh-gule

21. #GlobalAzure
Q&A