Monitoring Kubernetes with VictoriaMetrics-for presentation

Kubernetes Components That Need Monitoring
Infrastructure
Kubernetes Cluster & Management Components
Kubernetes Workloads & Applications

Instrumentation and Telemetry:
* Instrumentation
* Telemetry
* Metrics
* Logs
* Traces

victoria-metrics-k8s-stack
A brief detour into operators
Logging

VictoriaLogs:
* Ingestion
* Storage
* Analysis

Kubernetes Events:
* Time limited
* Not logged anywhere else

How?
* Lots of dead projects
* kubernetes-event-exporter
* OTEL k8s events receiver (alpha)
* VictoriaLogs collector?

Implementation Gotchas

1. An Introduction to Monitoring
Kubernetes with
VictoriaMetrics/VictoriaLogs
Ryan Jacobs(he/him)

2. Thank You VictoriaMetrics!

3. Ryan Jacobs (he/him)
Solutions Architect, Modern Applications with Insight Canada
15 years of IT experience, last 6 years specializing in cloud
architecture
Father of 3
I was a nationally-ranked competitive figure skater pre-2000

4. Source?
-My own work implementing Kubernetes
clusters for clients
-A series of Medium articles
-Search: Kubernetes Monitoring A
Complete Solution

5. Kubernetes Components That Need
Monitoring

6. Infrastructure

7. Kubernetes Cluster & Management Components

8. Kubernetes Workloads & Applications

9. Instrumentation and Telemetry
Instrumentation Telemetry Metrics Logs Traces

10. Instrumentation and Telemetry
Instrumentation Telemetry Metrics Logs Traces

11. Instrumentation and Telemetry
Instrumentation Telemetry Metrics Logs Traces

12. Instrumentation and Telemetry
Instrumentation Telemetry Metrics Logs Traces

13. Instrumentation and Telemetry
Instrumentation Telemetry Metrics Logs Traces

14. Filling in the picture

17. This Talk
METRICS LOGS

18. Definition
de facto (adverb, /ˌdāˈfaktō/): Latin, lit. “from fact”
Describes practices that exist in reality, regardlessof whether they are officially recognized by
laws or other formal norms.
https://en.wikipedia.org/wiki/De_facto

19. Metrics

20. VictoriaMetrics
Clustered
mode
Storage
options
Simpler
Resource
Efficient
Multi
tenant

21. VictoriaMetrics
Clustered
mode
Storage
options
Simpler
Resource
Efficient
Multi
tenant

22. VictoriaMetrics
Clustered
mode
Storage
options
Simpler
Resource
Efficient
Multi
tenant

23. VictoriaMetrics
Clustered
mode
Storage
options
Simpler
Resource
Efficient
Multi
tenant

24. VictoriaMetrics
Clustered
mode
Storage
options
Simpler
Resource
Efficient
Multi
tenant

25. victoria-metrics-k8s-stack
VictoriaMetricsoperator, which deploys (via CRDs)
VictoriaMetricscomponents: vmsingleORvminsert, vmselect, vmstorage
VictoriaMetricsvmagent
node-exporter
kube-state-metrics
Grafana
AlertManagerand vmalert

27. controller-manager,
scheduler, etcd
Typically require special attention but will
depend on your Kubernetes flavour

28. A brief detour into operators
From: https://www.cncf.io/blog/2022/06/15/kubernetes-operators-what-are-they-some-examples/

29. Logging
Logging is as important, in some cases more so, than metrics

30. VictoriaLogs
Ingestion Storage Analysis

31. VictoriaLogs
Ingestion Storage Analysis

32. VictoriaLogs
Ingestion Storage Analysis

34. VictoriaLogs was Dead Simple
To Set Up

35. Kubernetes Events
Time limited
Not logged
anywhere
else

36. Kubernetes Events
Time limited
Not logged
anywhere
else

37. How?
Lots of dead projects
kubernetes-event-exporter
OTEL k8s events receiver (alpha)
VictoriaLogs collector?

38. More to explore
Vmauth Vmgateway VictoriaTraces
Vmanomaly Vm distributed
Vm backup
manager

39. Implementation Gotchas
Documentation is a challenge

40. Implementation Gotchas
Documentation is a challenge

41. Implementation Gotchas
Documentation is a challenge

42. Implementation Gotchas

43. Implementation Gotchas
CRDs between Prometheus and VM are different

44. Links please!
https://github.com/djryanj/monitoring-k8s-with-victoriametrics-victorialogs
https://medium.com/@ryanjjacobs/kubernetes-monitoring-a-complete-solution-part-1-
architecture-eb5b998658d5
https://docs.victoriametrics.com/victorialogs/articles/

45. Questions?

46. Thank You!