MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
AlessandraBilardi
107 views
68 slides
Jun 01, 2024
Slide 1 of 68
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
About This Presentation
MLOps @ localhost 2024
A pragmatic approach to manage ML systems by workflows and use cases.
https://www.grusp.org/conferenze_/mlops-127-0-0-1-21-maggio-2024/
Slide Content
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps vs LLMOps
MLOps vs LLMOps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
[email protected]
corley.it
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
SUMMARY
DevOps methods
MLOps methods
LLMOps methods
Take away
SUMMARY
DevOps methods
MLOps methods
LLMOps methods
Take away
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
DevOps methods & actors
DevOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
CI / CD & actors
CI / CD & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
DevOps methods & actors
DevOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
DevOps methods & actors
DevOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
DevOps
●code
●monitoring
○metrics
○logs
Resources versioned or
saved with a timestamp
DevOps
●code
●monitoring
○metrics
○logs
Resources versioned or
saved with a timestamp
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & actors
MLOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
CI / CD & actors
CI / CD & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML system
ML system
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML system
ML system
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML system
ML system
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML system
ML system
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Forecasting
Use case - Forecasting
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Forecasting
Use case - Forecasting
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Forecasting
Use case - Forecasting
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Forecasting
Use case - Forecasting
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Forecasting
Use case - Forecasting
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Sentiment analysis
Use case - Sentiment analysis
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps
●code
○processing
○training
○inference
○evaluation
●model & baselines
●monitoring
○metrics
○logs
○bias
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
MLOps
●code
○processing
○training
○inference
○evaluation
●model & baselines
●monitoring
○metrics
○logs
○bias
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Face recognition
Use case - Face recognition
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Face recognition
Use case - Face recognition
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Face recognition
Use case - Face recognition
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & actors
MLOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & actors
MLOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps
●code
○processing
○training
○inference
○evaluation
●model & baselines
●embeddings
●monitoring
○metrics
○logs
○bias
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
MLOps
●code
○processing
○training
○inference
○evaluation
●model & baselines
●embeddings
●monitoring
○metrics
○logs
○bias
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & actors
LLMOps methods & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
CI / CD & actors
CI / CD & actors
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
ML
ML
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLM
LLM
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLM
LLM
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLM
LLM
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Chat bot - preparation steps
Use case - Chat bot - preparation steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Chat bot - preparation steps
Use case - Chat bot - preparation steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Chat bot - production version 1.0
Use case - Chat bot - production version 1.0
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Chat bot - production version 1.1
Use case - Chat bot - production version 1.1
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Use case - Chat bot - production version 2.0
Use case - Chat bot - production version 2.0
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
MLOps methods & steps
MLOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & steps
LLMOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & steps
LLMOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & steps
LLMOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & steps
LLMOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps methods & steps
LLMOps methods & steps
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps
●code
○processing ++
○[ training ] ++
○inference ++
■RAG
○evaluation
●model & baselines
●embeddings ++
●prompt
●monitoring
○metrics
○logs
○bias & malicious behaviors
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
LLMOps
●code
○processing ++
○[ training ] ++
○inference ++
■RAG
○evaluation
●model & baselines
●embeddings ++
●prompt
●monitoring
○metrics
○logs
○bias & malicious behaviors
■training baseline vs new data
■prediction baseline vs new pred
Resources versioned or
saved with a timestamp
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Take away
MLOps vs LLMOps
Methods
Resources
MLOps LLMOps
Computing small & CPU or GPU big & GPU
Training often rarely
Evaluation metrics Accuracy, AUC, ..BLEU, ROGUE, ..
Embeddings small big
Prompt ❌ ✅
Monitoring metrics, logs, bias also hacking
Take away
MLOps vs LLMOps
Methods
Resources
MLOps LLMOps
Computing small & CPU or GPU big & GPU
Training often rarely
Evaluation metrics Accuracy, AUC, ..BLEU, ROGUE, ..
Embeddings small big
Prompt ❌ ✅
Monitoring metrics, logs, bias also hacking
MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
Thanks
for listening!
Thanks
for listening!
Categories
TechnologyDownload
Download Slideshow Get the original presentation fileQuick Actions
Statistics
- Views 107
- Slides 68
- Age 548 days
Related Slideshows
11
8-top-ai-courses-for-customer-support-representatives-in-2025.pptx
JeroenErne2
44 views
10
7-essential-ai-courses-for-call-center-supervisors-in-2025.pptx
JeroenErne2
45 views
13
25-essential-ai-courses-for-user-support-specialists-in-2025.pptx
JeroenErne2
36 views
11
8-essential-ai-courses-for-insurance-customer-service-representatives-in-2025.pptx
JeroenErne2
33 views
21
Know for Certain
DaveSinNM
19 views
17
PPT OPD LES 3ertt4t4tqqqe23e3e3rq2qq232.pptx
novasedanayoga46
23 views