GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
neo4j
200 views
44 slides
May 22, 2024
Slide 1 of 44
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
About This Presentation
David Pond, Lead Product Manager, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnec...
David Pond, Lead Product Manager, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Size: 10.93 MB
Language: en
Added: May 22, 2024
Slides: 44 pages
Slide Content
Neo4j Inc. All rights reserved 2024
Neo4j Product Vision
and Roadmap
David Pond
Lead Product Manager
Neo4j Inc. All rights reserved 2024
SAFE HARBOR ROADMAP
DISCLAIMER
The information presented here is Neo4j, Inc. confidential and does not
constitute, and should not be construed as, a promise or commitment by
Neo4j to develop, market or deliver any particular product, feature or
function.
Neo4j reserves the right to change its product plans or roadmap at any
time, without obligation to notify any person of such changes.
The timing and content of Neo4j’s future product releases could differ
materially from the expectations discussed herein.
2
New in Neo4j5
Neo4j
Product capabilities launched in 2023/2024
Neo4j Inc. All rights reserved 20245
●Parallel Runtime-faster analytical Queries
●Change Data Capture-better data integration
●Autonomous clustering & Fabric-limitless
scalability
●Graph Schema & constraints
●Backup with point-in-time recovery
●Incremental import
●Neo4j/AuraDB Ops Managerfor managing
databases
●Aura Enterprise Databaseon all clouds
(AWS, GCP, Azure)
●SOC II Type 2compliance, AuraDB APIs, RBAC
configuration
●Private Link & CMEK
●Log forwarding & performance metrics-better
observability
●Workspace-unified developer experience
●GraphQLSupport & Simplified Drivers API
●Bloomsupport for GDSalgorithms
●GDS Python API
●Knowledge Graph Embeddings
●Longest Path & Topological SortAlgorithm
●VectorSearch & index
●Embedding APIs & LLM Models -Real Time
integration
●OpenAI + MS Azure OpenAI, VertexAI, AWS
Bedrock, Langchain, LlamaIndexetc. -Real Time
GenAI integration
Neo4j Inc. All rights reserved 20246
Cloud Scale
•Procure through Aura Console or via
Cloud Marketplace
•Zero maintenance, automated
upgrades and highly available
•Scalable and elastic, on-demand
•Enterprise-grade security
•SOC II Type 2 compliance
•Easier RBAC configuration with Aura
Console
•Private link
•CMEK
•Observability with Ops Manager,
performance metrics and logs
forwarding
Customer Managed Keys (Encryption)
7Neo4j Inc. All rights reserved 2024
Whatis it
Aura encrypts all data at transit &
rest by default.
Customer Managed Keys(CMK)
is an alternative way to protect
cloud data for security conscious
Enterprises, enabling customers
to manage their own keys for
encryption / decryption at disk on
Aura using Key Management
Services (KMS) from their Cloud
Service Provider.
Whyit is important
Customers can protect their own
data, control access and have
the ability to revoke access, even
from Neo4j.
Customers can adhere to their
own stringent security policy
around access and key rotation,
on top of Aura’s Enterprise grade
default security and compliance
posture.
Customer Managed Keys (Encryption)
8
Neo4j
Ops Manager
Neo4j Inc. All rights reserved 20249
Unified Product Experience
10Neo4j Inc. All rights reserved 2024
Aura Console
Graph Tools
Ops
Management
Improvements in Bloom / Explore
Neo4j Inc. All rights reserved 2024Neo4j Inc. All rights reserved 2024
Data Slicer
GDS Algos
Neo4j Inc. All rights reserved 202412
April 12, 2024
Welcome GQL!
GQL -Graph Query Language
The first new ISO language since 1987
GQL-fueled additions in Cypher:
•Node and relationship expressions WHERE
clause
•Richer label expressions
•Sophisticated pattern repetitions
•SQL-like synonims
•GQL Error codes
•GQL is Here: Your Cypher Queries in a GQL World
•GQL: The ISO Standard for Graphs Has Arrived
•ISO GQL: A Defining Moment in the History of
Database Innovation
Neo4j Inc. All rights reserved 202413
Graph Pattern
Matching
Improved expressivity of
graph navigation with
Quantified Path Patterns,
a more powerful and
performant syntax to
navigate and traverse
your graph.
NEO4J 5.0 NEW CAPABILITIES
Database Enhancements
Graph Pattern Matching Example →Fraud Rings
Neo4j Inc. All rights reserved 202414
QPP
MATCHpath=(a:Account)-[:PERFORMS]->(first_tx)
((tx_i)-[:BENEFITS_TO]->(a_i)-[:PERFORMS]->(tx_j)
WHEREtx_i.date < tx_j.date
AND 0.80<= tx_i.amount / tx_j.amount <= 1.00
){3,6}
(last_tx)-[:BENEFITS_TO]->(a)
WHEREsize(apoc.coll.toSet([a]+a_i)) = size([a]+a_i)
RETURNpath
accountNumber:2
amount: 1000
date: 2023-01-01T10:10:10.000+0000
accountNumber: 1
amount: 900
date: 2023-01-02T10:10:10.000+0000
amount: 729
date: 2023-01-04T10:10:10.000+0000
accountNumber: 4
accountNumber: 3
Neo4j Inc. All rights reserved 202415
New constraints on nodes,
relationships and properties:
●Node/Relationship unique
property
●Node/Relationship property
existence and type
●Node/Relationship keys
NEO4J 5 NEW CAPABILITIES
Graph Schema
Graph Schema / Graph Type
Neo4j Inc. All rights reserved 202416
The definition of the informational content of a schema
(or rather a graph type), comprising:
●A set of node type descriptors
(also known as a node type set).
●A set of edge type descriptors
(also known as an edge type set).
●A node type name dictionary that maps node type
names,
which are identifiers, to node types contained in the node
type set of this graph type descriptor such that each
node type name is mapped to a single node type.
●An edge type name dictionary that maps edge
type names,
which are identifiers, to edge types contained in the
edge type set of this graph type descriptor such that
each edge type name is mapped to a single edge type.
CREATE OR REPLACE GRAPH TYPEFraudDet
(a:AccountHolder { FirstName :: STRING!,
LastName :: STRING!,
UniqueId :: STRING! }
...) REQUIREUniqueId IS KEY,
(c:CreditCard {AccountNumber :: STRING!,
Balance :: FLOAT!,
...} ...) REQUIREAccountNumber IS KEY, ...
(a)-[:HAS_CARD ...]->(c),
(a)-[:HAS_ACCOUNT ...]->(b),...
CREATE OR REPLACE DATABASEfoo
...
[WITH GRAPH TYPEFrautDet]
...
Neo4j Inc. All rights reserved 202417
Parallel Runtime
Speed up
analytical
queries up to
100x
Neo4j Inc. All rights reserved 202418
Parallel Runtime
Speed up
analytical
queries up to
100x
Neo4j Inc. All rights reserved 202419
Parallel Runtime
Speed up
analytical
queries up to
100x MORE CORES
Neo4j Inc. All rights reserved 202420
Parallel Runtime
Speed up
analytical
queries up to
100x
FASTER QUERIES
MORE CORES
Neo4j Inc. All rights reserved 202421
BLOCK FORMAT
Memory Optimized
and Future Proof
An implementation of graph-native
that’s informed by more than a decade
of experience supporting real-world
production graph workloads.
Neo4j is still graph-first; block format
is:
•Native graph storage
•Optimized for connected data
•Index-free adjacency
Block format supersedes all previous
store formats.
Migrate, convert, import into Block
Format
CHANGE DATA CAPTURE
Automated Real-Time Change Tracking
22Neo4j Inc. All rights reserved 2024
Graph Data at Scale
23Neo4j Inc. All rights reserved 2024
Autonomous Clustering
Easy, automated horizontal scale-
out
Composite Databases
Federated queries and sharded graphs
Graph Data at Scale
24Neo4j Inc. All rights reserved 2024
Properties Sharding
25Neo4j Inc. All rights reserved 2024
Users’ ConnectionsTOPOLOGY DATABASESHARDED PROPERTY
DATABASES
Parallel
data load
Rolling
updates on
demand
AI Enabler
Graph Data Science & Generative AI
Neo4j Inc. All rights reserved 202426
Neo4j Inc. All rights reserved 2023Neo4j Inc. All rights reserved 202428
Knowledge Graphs + LLMs
28
Facts
Explicit
Explainable
Words
Implicit
Opaque
KGsLLMs+
Left Brain + Right Brain
Retrieval Augmented Generation (GraphRAG)
Vector + Graph Search
Neo4j Inc. All rights reserved 202429
●avoid hallucinations
●ignore LLM training data
●only use language skills
●fetch relevant information from
reliable (enterprise) datasources
●often uses vector and/or full-text
search for starting points
●use context from knowledge graph
Graph + Vector = Semantic Search
Neo4j Inc. All rights reserved 202430
Find similar documents.Find related information.
Combine for more
accurate results within a
relevant context.
Vector Index
Graph Structure
Knowledge Graph
Similarity Search
Pattern Matching
31
What is a Knowledge Graph?
An information architecture with layered connections.
Or a digital twin of reality or your organization.
Neo4j Inc. All rights reserved 2024
DATAINFORMATIONKNOWLEDGEINSIGHTMEANING
recordssetsrelationshipspatternslayers
RAG with Neo4j
Neo4j Inc. All rights reserved 202432
Find similar documents,
content and data
Expanded context for related
information and ranking
results
Improve GenAI inferences and
insights. Discover new
relationships and entities
Unifiedsearch, knowledge graph and data science capabilities to
improve RAG quality and effectiveness
Vector Search,
Full-text Search,
Geospatial, Pattern
match
Data ScienceKnowledge Graph
Neo4j Inc. All rights reserved 2023Neo4j Inc. All rights reserved 202433
Knowledge Graph Complementary Benefits
33
LLM
HumanApplication
Knowledge
Graph
Extend LLM
knowledge
through RAG
Invite human
exploration &
curation
Advanced
application
features & analysis
Neo4j Inc. All rights reserved 202434
1Knowledge GraphConstruction
Gen AI use casesLLM
Knowledge
Graph
neo4j.com/labs/genai-ecosystem/llm-graph-builder
Neo4j Inc. All rights reserved 202435
Knowledge Graph
Construction with
Cypher Templates
Neo4j Inc. All rights reserved 202436
Knowledge Graph Construction
neo4j.com/labs/genai-ecosystem/llm-graph-builder
Neo4j Inc. All rights reserved 2024
Human
37
1Knowledge GraphConstruction
Gen AI use casesLLM
Knowledge
Graph
2RAG-basedChat Applications
neo4j.com/labs/genai-ecosystem/rag-demo/
Neo4j Inc. All rights reserved 202438
Natural Language
Search combining
explicit and implicit
relationships
Neo4j Inc. All rights reserved 202439
RAG-based Chat Applications
neo4j.com/labs/genai-ecosystem/rag-demo/
Neo4j Inc. All rights reserved 2024
ApplicationHuman
40
1Knowledge GraphConstruction
Gen AI use casesLLM
Knowledge
Graph
2RAG-basedChat Applications
3RAG-enhanced General Applications
Neo4j Inc. All rights reserved 202441
Natural Language
assistants and co-
pilots,
rooted in business
policy
Prompt +
Relevant
Information
Embedding APILLM API
User
Database
Search
PromptResponse
Relevant ResultsKnowledge
Graph
Application
●Integrate Neo4j with leading LLM open-
source frameworks such as LangChain,
LlamaIndex & More
●Call LLM APIs nativelyvia Cypher using
product integration or open-source APOC
(extended) library
●Agnostic LLM orchestrationconnecting
graphs to OpenAI, AWS Bedrock, GCP
Vertex AI, Azure, Anthropic, Hugging
Face, and other proprietary and open
source foundation models
Integrate with the GenAI Ecosystem
Neo4j Inc. All rights reserved 202442
GenAI Stack
Application
Generative AI & Embedding Models
Orchestration
Grounding Knowledge Graph
Neo4jGraph
Neo4jVector
GraphCypherQAChai
n
Neo4jGraphStore
Neo4jVectorStore
KnowledgeGraphIndex
Neo4j GenAI Integrations
Text | Chat | Embedding
NL Query | Image Gen
Neo4j Drivers
JavaPythonJavaScript
neo4j.com/labs/genai-ecosystem
POWERING GENERATIVE AI APPS
Neo4j’s GenAI Roadmap
●Co-Pilots & integrations in Neo4j Browser, Bloom,
Data Importer, NeoDash, Docs
●Cloud Integrations: GCP Vertex AI, AWS Bedrock,
Azure OpenAI
●Scalable and integrated Vector Search, additional
Graph Embeddings
●GraphRAG eval framework
●More framework integrations: Langchain,
LlamaIndex, SemanticKernel, Spring.AI, Haystack
Neo4j Inc. All rights reserved 202443
Coming 2024+
●Parallel Runtimefor faster analytical Queries
●Block Format for efficient and future proof graph
storage
●Change Data Capture (CDC) better data integration
●Autonomous clustering and Composite Database for
limitless scalability
●Graph Schema, Improved Backup recovery,
incremental import
●Neo4j Ops Managerfor managing databases
●Aura Database on all clouds (AWS, GCP, Azure)
●SOC II Type 2 & HIPAA compliance, AuraDB APIs,
RBAC configuration
●Better observability with security log forwarding
Performance metrics forwarding (EAP)
●Private Link & CMEK
Neo4j product capabilities launched in 2023/24
Neo4j Inc. All rights reserved 202444
●Unified Developer Experience with Neo4j Workspace
●Quantified Graph Pattern Matching
●Call in Transactions
●Self-service Data Import (more coming soon)
●GraphQL Support
●Simplified Drivers API
●Bloom support for Graph Data Science algorithms
●Graph Data Science Client
●Knowledge Graph Embeddings
●Vector Index, similarity search & vector similarity
●Real Time integration with Embedding APIs & LLM
Models
●GenAI Integrations (OpenAI + MS Azure OpenAI,
VertexAI, AWS Bedrock, Langchain(Python & JS),
LlamaIndex, Haystack, Spring AI, LangChain4j)
Neo4j Inc. All rights reserved 202445
Follow us!@neo4j
Enjoy
GraphSummit
Stockholm [email protected]