Taming the LLM Herd - Effortless Multi-Model Integration with LangChain

Imagine having a toolbox filled with the best AI writing assistants, each a master of its craft! Stop settling for a one-size-fits-all solution. LangChain unlocks the potential of using MULTIPLE large language models (LLMs) – think Google Gemini for technical reports and a creative AWS Titan for crafting blog posts. But wait, there's a catch (don't worry, it's a good one). Wrangling these LLMs can be a code-heavy chore.

This talk is your shortcut to LLM mastery! We'll unveil a brand new LangChain extension that streamlines integrating various providers. Plus, we'll dive into TechType Rocket, a real-world application built with this extension, that lets you generate blog posts with ease using a user-friendly Streamlit interface.

1. Naperville Software Development Meetup -
April 3rd, 2024
Credit: Microsoft Designer
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

2. Who am I?
2
●Academic Background
○Ph.D. in Computing Science from Aberdeen University (Scotland)
■Leveraged Semantic Technologies to facilitate inter-department collaboration
■Introduced an approach to map entities across semantic schemas (Thesis)
■Contributed to development of W3C standards, such as SKOS
●Work Experience
○1+ year experience developing prototypes demonstrating value of Generative AI for research
○Spearheaded several expert research solutions based on Artificial Intelligence
○Architected a hybrid AI system combining NLP and rule-based techniques to deliver a
functional solution despite labeled data limitations
○Awarded multiple internal Innovation Awards for contribution to integration of AI solutions
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

3. Agenda
●Introduction
●LangChain
●RQle.ai LangChain extension
●TechType Rocket
●Conclusion
3
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

4. Generative AI
4
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Generative AI is a branch of AI that
focuses on creating entirely new
content. This content can come in many
forms, including text, images, audio, and
even videos.

5. Generative AI
5
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

6. Key Areas for Generative AI
6
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: The economic potential of generative AI: The next productivity frontier
75% of Generative AI value focuses on:
-Customer Operations
-Marketing & Sales
-Software Engineering
-Research & Development

7. Generative AI
7
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: Predicts 2024: AI’s Impact on the Employee Experience, Gartner

8. Evolution of Large Language Models
8
Source: Guide to Large Language Models
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

9. Evolution of Large Language Models

9
Source: Introducing the next generation of Claude.
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Due to their training datasets, different
LLMs are performing better for some
tasks than others.

10. Agenda
●Introduction
●LangChain
●RQle.ai LangChain extension
●TechType Rocket
●Conclusion
10
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

11. 11
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: Introduction to LangChain
LangChain is a framework for developing applications powered by LLMs.
LangChain can be used for a wide variety of applications including:
●Document question answering
●Summarization
●Entity / Relation Extraction
●Conversational Interfaces
●Code Analysis

12. 12
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: Introduction to LangChain

13. 13
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: LangChain LLM Integration

14. 14
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Source: LangChain LLM Integration

15. Agenda
●Introduction
●LangChain
●RQle.ai LangChain extension
●TechType Rocket
●Conclusion
15
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

16. RQle.ai LangChain Extension
Extend LangChain to facilitate integration with different LLM providers:
●AWS Bedrock
●Azure OpenAI
●Google AI
●Oracle Cloud Infrastructure (OCI) Generative AI
●ollama (local deployment)
Leverages llm-guard library to provide guardrails on input/output
16
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

17. RQle.ai LangChain Extension
17
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

18. RQle.ai LangChain Extension
18
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

19. RQle.ai LangChain Extension - Adapters
19
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
⚠ Note This is mostly caused by the fact that no chat interface
have yet been created for this LLM provider in LangChain.

20. Agenda
●Introduction
●LangChain
●RQle.ai LangChain extension
●TechType Rocket
●Conclusion
20
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

21. TechType Rocket
Struggling to break into the tech blogging world?
With TechType Rocket, you'll be ready to:
●Publish high-quality tech blogs that resonate with your target audience.
●Establish yourself as a credible voice in the tech community.
●Build a loyal following eager to consume your insightful content.
21
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

22. TechType Rocket
22
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

23. Agenda
●Introduction
●LangChain
●RQle.ai LangChain extension
●TechType Rocket
●Conclusion
23
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

24. Conclusion
●Streamlined integration for effortless use of various LLM providers by
extending LangChain
●Quickly test different LLMs to check which one performs better
●TechType Rocket to generate blogs
24
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain

25. 25

26. 26
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Contacts
Email: [email protected]
LinkedIn: https://www.linkedin.com/in/quentinreul/
GitHub: https://github.com/RQledotai/rqle-ai-langchain-util

27. 27
Taming the LLM Herd
Effortless Multi-Model Integration with LangChain
Greater Chicago AI Community