Improving RAG with Knowledge Graph + Multi-modality + Milvus

A quick presentation on Improving RAG using knowledge graphs AND multimodality with Milvus.

1. 1| © Copyright 2024 Zilliz1
Improving RAG with Knowledge Graph +
Multi-modality + Milvus
Jiang Chen @ Zilliz

2. 2| © Copyright 8/16/23 Zilliz2| © Copyright 8/16/23 Zilliz2| © Copyright 8/16/23 Zilliz2| © Copyright 8/16/23 Zilliz
Jiang Chen
Head of Ecosystem and
Developer Relations
[email protected]
https://www.linkedin.com/in/jiangc1010/
https://x.com/jiangc1010

3. 3| © Copyright 2024 Zilliz3

4. 4| © Copyright 2024 Zilliz4

5. 5| © Copyright 2024 Zilliz5
https://milvus.io/docs/integrations_overview.md

6. 6| © Copyright 2024 Zilliz6
Retrieval-Augmented Generation

7. 7| © Copyright 2024 Zilliz7
Knowledge Graph and Data Mining
Picture Credit: KEPLER A Unified Model for Knowledge Embedding and
Pre-trained Language Representation
Picture Credit: https://microsoft.github.io/graphrag/

8. 8| © Copyright 2024 Zilliz8
Knowledge Embedding + Vector SearchKnowledge Embedding + Vector Search
https://github.com/milvus-io/bootcamp/bl
ob/master/bootcamp/tutorials/quickstart/g
raph_rag_with_milvus.ipynb

9. 9| © Copyright 2024 Zilliz9
How to Embed Knowledge Entities and Triples
Alex, child of, Brian) → "Alex child of Brian"
Cole, married to, Brian) → "Cole married to Brian"

10. 10| © Copyright 2024 Zilliz10
Knowledge Retrieval with Vector Embedding

11. 11| © Copyright 2024 Zilliz11
Knowledge Retrieval with Vector Embedding

12. 12| © Copyright 2024 Zilliz12
Knowledge Retrieval with Vector Embedding

13. 13| © Copyright 2024 Zilliz13
MagicLens

14. 14| © Copyright 2024 Zilliz14
Multi-modal Search
multimodal-demo.milvus.io

15. Thank You !
Milvus
Open Source Self-Managed
github.com/milvus-io/milvus
Zilliz Cloud
SaaS Fully-Managed
zilliz.com/cloud
milvus.io for tutorials/notebooks