Building RAG with self-deployed Milvus vector database and Snowpark Container Services

This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.

1. 1 | © Copyright 2024 Zilliz1 1| © Copyright 9/25/23 Zilliz1| © Copyright 9/25/23 Zilliz
Speaker
Jiang Chen
Ecosystem & Developer Experience

[email protected]
@jiangc1010

2. 2 | © Copyright 2024 Zilliz2
Building RAG with Milvus and
Snowflake’s Container Service
Jiang Chen @ Zilliz

3. 3 | © Copyright 2024 Zilliz3
AI revolutionizes how we use unstructured data
Search by Probability
Statistical analyses of common
datasets established the foundation for
processing unstructured data, e.g. NLP,
and image classification
AI Model Breakthrough
The advancements in BERT, ViT, CBT
etc. have revolutionized semantic
analysis across unstructured data
Vectorization
Word2Vec, CNNs, Deep Speech pioneered
unstructured data embeddings, mapping the
words, images, videos into high-dimensional
vectors

4. 4 | © Copyright 2024 Zilliz4

5. 5 | © Copyright 2024 Zilliz5
01Deploy Milvus Vector Database in RAG
CONTENTS
02Milvus in Snowflake Ecosystem
The Future Landscape of RAG03

6. 6 | © Copyright 2024 Zilliz6
Deploy Milvus Vector
Database in RAG

7. 7 | © Copyright 2024 Zilliz7

8. 8 | © Copyright 2024 Zilliz8
Super easy to start with, and runs on edge devices!

9. 9 | © Copyright 2024 Zilliz9
Scale-up on Docker

10. 10 | © Copyright 2024 Zilliz10
Up to 100 billion vectors with K8s!

11. 11 | © Copyright 2024 Zilliz11

12. 12 | © Copyright 2024 Zilliz12
Milvus with Snowflake
Ecosystem

13. 13 | © Copyright 2024 Zilliz13
Deploy Milvus Docker in Snowpark Container Services
milvus.io/docs

14. 14 | © Copyright 2024 Zilliz14
Set-up Role and Create Database Abstraction

15. 15 | © Copyright 2024 Zilliz15
Deploy Milvus Docker Image in Snowpark

16. 16 | © Copyright 2024 Zilliz16
Run Milvus as a Service

17. 17 | © Copyright 2024 Zilliz17
Start Building Apps with Milvus in Snowpark!

18. 18 | © Copyright 2024 Zilliz18
The Future Landscape of RAG

19. 19 | © Copyright 2024 Zilliz19
Continuous Evaluation and Observability
Measure it before you attempts to improve it!

20. 20 | © Copyright 2024 Zilliz20
Multi-modal RAG
●Combining text and
image in the search
query
●Retrieving
multi-modal content
for generation

21. 21 | © Copyright 2024 Zilliz21
Good dishes come from good ingredients
•Data collection

•Data cleaning

•Parsing & Chunking

•DNN-native data?

22. 22 | © Copyright 2024 Zilliz22
Agents!

23. 23 | © Copyright 2024 Zilliz23
T H A N K Y O U
@jiangc1010