DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java

DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java

1. A Solid Foundation for GenAI
Apps -Exploring Architectural
Blueprints for LLM Solutions
with Java
Juarez Barbosa Junior @juarezjunior
Sr Principal Java Developer Evangelist, Oracle

2. Juarez Barbosa Junior
Senior Principal Java Developer Evangelist
•Speaking from Dublin, Ireland
•28 years of experience in SW Engineering & DevRel
•Oracle, Microsoft, IBM, Nokia, Unisys, Accenture, startups
•Microsoft Azure Developer Relations Lead
•IBM Watson Tech Evangelist & Cloud Rockstar
•IBM Mobile Tech Evangelist & Global Thought Leader
•Nokia Developers Global Champion
•Java, Python, Cloud, DevOps, SRE, Cloud-native, IoT, AI,
Blockchain, Rust
•Speaker at conferences
•Oracle CloudWorld, Oracle Code, Microsoft Ignite, Microsoft
TechX, jPrime, JCON, DevConf.cz, GeeCon, DevOpsDays,
DeveloperWeek, DevOps Institute, CloudLand, DWX, The
Developer’s Conference (TDC), Sec4Dev, JSNation, NodeConf,
Conf42, Shift Conf, Global Azure, Open-Source Lisbon,
CodeFrenzy, Mêlée Numérique, React Summit, Test.js Summit,
Porto TechHub Conf, Pyjamas, MiTechCon, JUGs, meetups, etc.
@juarezjunior
@juarezjunior

3. Agenda
•AI and GenAI –Synthetic Content
•GenAI Concepts and AGI
•Reference Architecture for GenAI Apps
•Direct LLM calls (text generation)
•LLM + RAG + Oracle Database 23ai (vector DB)
•Multimodality Prompts (various media)
•Function Calling (execution of client-side
functions)
•Audience: SW Engineers + Business audiences
(not necessarily ML Engineers)
Copyright © 2024, Oracle and/or its affiliates

4. AI and GenAI –
Synthetic Content
Dublin in Ireland pictured in a futuristic
cityscape
Copyright © 2024, Oracle and/or its affiliates

5. •Core concepts in a nutshell
•GenAI-Artificial intelligence algorithms and transformer models with the capability
of generating content.
•Content-Text, images, videos, code, and others.
•Generation–a result of an input prompt (prompt engineering).
•Training data –dataset
•Apps–Applied currently in the fields of content development, entertainment, drug
discovery, software development, healthcare, material generation sciences, and
others.
•Ethical issues –misuse, deep fakes, bias and discrimination, automation and job
replacements, cybersecurity and cybercriminals.
•AI is now a commodity!
•Artificial General Intelligence (AGI) Research –ultimate goal
Copyright © 2024, Oracle and/or its affiliates
GenAI Concepts and AGI

6. Reference
Architecture
for GenAI Apps
Copyright © 2024, Oracle and/or its affiliates

7. Direct LLM calls -Spring AI with Open AI
•Demo -Direct LLM calls -Spring AI with Open AI
Copyright © 2024, Oracle and/or its affiliates

8. Oracle Database 23ai Free available for
download now
•Oracle Database 23ai Free accelerates
Oracle’s mission to make it simple to
develop and run all data-driven apps
•Provides developers easy early access to
23ai AppDev features
•Limited database size, memory, and CPU
threads
http://oracle.com/23aiFree
http://oracle.com/23aiFree
Copyright © 2024, Oracle and/or its affiliates

9. RAG -Spring AI with Open AI and Oracle
Database 23ai
•Demo -RAG -Spring AI with Open AI and Oracle
Database 23ai
Copyright © 2024, Oracle and/or its affiliates

10. Multimodality -Spring AI with Open AI
(GPT-4o)
•Demo -Multimodality -Spring AI with Open AI (GPT-
4o)
Copyright © 2024, Oracle and/or its affiliates

11. Function Calling -Spring AI with Open AI
•Demo -Function Calling -Spring AI with Open AI
Copyright © 2024, Oracle and/or its affiliates

12. Copyright © 2024, Oracle and/or its affiliates
Technical References
•Spring AI -https://spring.io/projects/spring-ai
•OpenAI -https://openai.com/
•Oracle AI Vector Search -https://rb.gy/sp41uk
•Oracle AI Vector Search for Java Developers with the Oracle Database 23ai -
https://rb.gy/7ivwxr
•Java / JDBC –https://www.oracle.com/jdbc
•Introduction to Oracle JDBC Driver Support for Virtual Threads -
https://bit.ly/3UlNJWP
•Developing an Oracle JDBC app with GraalVM Native Image -https://rb.gy/iy3sgh
•Getting Started with Reactive Relational Database Connectivity and the Oracle R2DBC
Driver -https://rb.gy/42dnz5
•Getting Started with the Java library for Reactive Streams Ingestion (RSI) -
https://bit.ly/3rEiRnC
•Introduction to JDBC Reactive Extensions with the Oracle Database —Developer
Release –https://rb.gy/qxlrbx
•Pipelined Database Operations -https://rb.gy/iy3sgh

13. Juarez Junior
@juarezjunior

15. Java Developers
15 Oracle DatabaseWorld @ CloudWorld Copyright © 2023, Oracle and/or its affiliates
Oracle for DB Developers

16. Java App
Dev with
Oracle
Database
Copyright © 2024, Oracle and/or its affiliates

17. Overview of Oracle DB Access with Java
Copyright © 2024, Oracle and/or its affiliates

18. Oracle JDBC -Support for the Latest Java
Versions
•Support to the latest Java versions
(11, 17, 21) and GraalVM
•Project Loom -Virtual Threads
support
•Java Virtual Threads and Pipelined
Database Operations
•JDBC Standards -4.2 and 4.3
•Reactive Streams -Java Flow API
support
•R2DBC, Reactive Streams Ingestion
(RSI)
•Pipelined Database Operations
Data access is critical in
mission-critical applications!
Copyright © 2024, Oracle and/or its affiliates

19. Oracle LiveLabs
Showcasing how Oracle’s solutions can
solve yourbusiness problems
500+
free workshops,
available or in
development
3.5 million
people have already visited
LiveLabs
developer.oracle.com/livelabs
learn something new …at your pace!
600+
events run
using LiveLabs
workshops

20. 3 membership tiers
Connect: @oracleace facebook.com/[email protected]
500+ technical experts &
community leaders helping peers globally
The Oracle ACE Program recognizes & rewards individuals for
their technical & community contributions to the Oracle community
Nominate
yourself or a candidate:
ace.oracle.com/nominate
Learn more-ace.oracle.com
blogs.oracle.com/ace

21. Create your FREE
Cloud Account
•Go to
https://signup.cloud.oracle.com/
Copyright © 2024, Oracle and/or its affiliates