From Event to Action: Accelerate Your Decision Making with Real-Time Automation

SafeSoftware 390 views 61 slides May 01, 2024
Slide 1
Slide 1 of 61
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61

About This Presentation

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this visi...


Slide Content

From Event to Action:
Accelerate Your Decision
Making with Real-Time
Automation

Matt
Meeboer

Technical Support Specialist,
FME Flow




Stewart
Harper

VP of Product
Development

Don
Murray

Co-Founder &
CEO

Meet our Team

Welcome to Livestorm.
A few ways to engage with us during the webinar:


Audio issues? Click this for 4 simple
troubleshooting steps.

How to download slides
1.Hover over the
slide deck in the
webinar room
2.Click this button

Agenda
1What are Real-Time Events?
2What are sources of Real-Time Events
3Benefits of Automation and Real-Time Events
4Spatial Data and Real-Time Events
5Customer Stories
6Demos
7Conclusion, Resources & Next Steps
8Q&A
Agenda

Flash
Demo

Poll:
How frequently does your
company currently use
real-time data for
decision-making?

1
What are Real-Time
Events?

Batch, Event, and Stream Processing
Batch
Processing
Low High
Event
Processing
Stream
Processing
Data Velocity
April 16, 2024
Webinar
March 13, 2024
Webinar
Today’s
Webinar
Automations

Real-Time Events
Application Integration, data integration
and real-time data processing.

2
What are sources of
Real-Time Events?

Some Common Event Sources
Application Events
●Database Trigger
(update, insert)
●Record
inserted/updated
(Webhook Trigger)
●Polling of Legacy
Application.
●...
Data Arrival Events

●Email arrives
●Data in Directory
●Data in object store
(AWS, Azure, Google)
●FTP (or variant)
●....

Device/IoT and other
Events
●Scheduled event
●JMS message
●FME Flow Stream
●FME Flow App
●SQS, SNS or Azure
Event Grid
●....

3
Benefits of Automation
and Real-Time Events.

Benefits of Real Time Event processing with Automations
●Application Integration: Connect applications so an update in one
application causes an update in other applications.
●Data Integration: Integrate data as it arrives. From IoT event data, to large
data arrivals in the cloud, to immediate QA on data.
●Unrivalled Productivity: No-code interface so your team can create
real-time data flows quickly and easily.
●Save Time & Have a Happier Team: Automate monotonous tasks so your
team is happier doing more valuable work.
●Better Insights: Up to date information for everyone means more informed
decision making.

Capabilities of Real Time Event processing
with Automations
Scalable
●Scale processing to move mountains of data quickly.
Flexible
●Large number of triggers to automate your entire enterprise.
Powerful Orchestration
●Use parallel processing, distributed processing or both in the same
automation to specify how,where and when tasks are done.

4
Spatial Data and
Real-Time Events

The world we live in
is Spatial.


How many ways have you used spatial today without even
thinking about it?
Yet many organizations do not use spatial in their day to day
decision making.

Spatial Data is critical to get from
digital optimization to digital transformation.
●Spatial data reveals new relationships and insights to make
better decisions.
●Without spatial data you miss opportunities, allocate
resources poorly, and fall behind your competitors.
●Spatial Data streams enables you to see when and where
events occur.

Unrivalled Data Type support
Spatial Data is
Everywhere

One platform, two technologies
FME Form FME Flow
Build Event Processing workflows.
Automation with Event Processing
FME Flow Hosted
Safe Software managed FME Flow
fme.safe.com/platform
FME Enterprise Integration Platform
Safe & FME

FME Flow is Automation
Events drive Automations

5
Customer
Stories

Customer Stories

●Electra deploys IoT sensors to improve power network outage
response
○Electra
●Powerlink Queensland automates spatial emergency readiness
○Powerlink
●City of Omaha saves 1000+ hours each year with FME
○City of Omaha
Many more can be found here.

Leverage Real-Time Events for
enhanced decision-making
and efficiency.

6
Automations vs
Streams

FME Flow Automations FME Flow Streams
●Data Volumes: Low-Medium (<100 per
minute)
●Latency: 1s and up
●Triggered by events
●Complex workflow orchestration

●Data Volumes: High (Millions of records
per minute)
●Latency: Near Real-Time <1s
●‘Always on’ and receiving data from a
stream
●Single, simpler workflow focused on
ingesting a lot of data quickly
Workflows are authored in FME Form,
regardless of how they are run on FME Flow

SFTP
Dropbox
System Event
Azure Event
Grid
JMS
UDP
HTTP Request WebSocket
FTP
Logger
SQS/SNS SMTPSQS/SNS
Filter
Merge
S3 Bucket
Network
Event Triggers

7
Demos

Real-Time
Data
Integration

Data Integration with the FME Platform is easy
●Details of entire process are thru no-code FME Form and FME Flow interfaces.
●FME Flow Automations ensure the data import task happens immediately
●Data Validation is part of the workflow ensuring that only high quality data is
imported.
●Email notifications ensure that appropriate personnel are notified immediately.


Key Takeaways

Slide Title
Update data
warehouse with
files submitted
by users
Goal Block Key
Real-Time Data Integration
Result
Access to the
DW and Flow,
Data needs to be
validated

FME Flow
Bucket Watch
Automation

Snowflake
updated in
real-time

Integration Architecture
User uploads file
(csv list of food
programs) to
Amazon S3
Bucket
FME Form
Workspace (fmw)
executes on next
available engine
Notify of
Completion
FME Form
Could be Dropbox,
File Share, Flow
Resource Folder

Demo

Real-Time
Application
Integration

Application Integration enables your applications to work together seamlessly
●Webhook capability of FME Flow Automations makes connecting
applications simple and fast.
●We show how easy it is to connect 3 applications. Again: no-code interface
elevates productivity and improve maintainability.


Key Takeaways

Slide Title
Create a Service
Request in
CityWorks when
an unsafe tree is
reported via
Survey123

Goal Block Key
Real-Time Application Integration
Result
Survey123 and
CityWorks are
not integrated

FME Flow
Webhook
Automation

CityWorks
updated in
real-time &
AGOL updated
to reference new
Service Request
ID

Uni-Directional
Integration Architecture
Linear data flow used to repair, validate, and replicate
data from system A to system B
●Triggers can vary from files being received to
schedules and webhooks.


Dynamic data flow(s) used to integrate multiple
systems by synchronizing changes between 2 (or
more) systems.
●Typically driven by an action being performed in
either system for near real time processing via
webhooks or topics/notifications.

Bi | Multi-Directional

FME Flow
Automation Triggered
(Webhook Received
from Survey123)
Integrate AGOL and Cityworks via REST API
User submits Survey
Published FME Workspace (.fmw)

Published FME Workspace executes
and synchronizes
changes to features from Cityworks,
Salesforce, and ArcGIS Online
FME Flow
Automation Triggered
Record inserted,
updated, or deleted
Record inserted,
updated, or deleted

Demo

Real-Time Data
Enrichment

Different systems hold different information. You want to want to leverage one system to
“enrich” the data of another system.
●Automations can also connect to external services, like ChatGPT (OpenAI), to enrich your
data
●Automations perform this enrichment as data arrives, providing better data for better
insights.

Automations don’t just save you time, they do things you couldn’t afford to do without them.

Key Takeaways

Slide Title
Add additional
details about a
new customer
lead in
Salesforce

Goal Block Key
Real-Time Data Enrichment
Result
Sales doesn’t
have time - too
many leads to
chase

FME Flow
Webhook
Automation with
ChatGPT as our
research
assistant

Salesforce
updated in
real-time

FME Flow
Automation Triggered
(Webhook Received
from Salesforce)User enters lead into Salesforce
Published FME Workspace (.fmw)

Demo

8
Conclusion

FME Flow Automations FME Flow Streams
●Data Volumes: Low-Medium (<100 per
minute)
●Latency: 100s of ms and up
●Triggered by events
●Powerful workflow orchestration

●Data Volumes: Medium-High (Millions of
records per minute or more)
●Latency: Near Real-Time
●‘Always on’ and receiving data from the
stream
●Simple workflow focused on ingesting
data quickly
Workflows are authored in FME Form,
regardless of how they are run on FME Flow
April 16, 2024 Webinar Today’s Webinar
Summary - Real Time

29+
27K+
128
190
20K+
years of solving data
challenges
FME Community
members
countries with
FME customers
organizations worldwide
global partners with
FME services
30+
29K+
128
140+
25K+
years of solving data
challenges
FME Community
members
countries with
FME customers
organizations worldwide
global partners with
FME services
200K+
users worldwide
Safe & FME

Deploy Anywhere
Processing close
to the data
Unrivalled Productivity
No-code environment

Restaurant Model
Customer experience &
quality product that keep
you coming back
Subscription
Every component,
Every capability.
You get it all.

Largest Ecosystem
Only Integration Vendor with
Geospatial
Our Differentiators

Support for
Spatial
Competitor

One platform, two technologies
FME Form FME Flow
Build and run data workflows Automate data workflows

FME Flow Hosted
Safe Software managed instance
fme.safe.com/platform
FME Enterprise Integration Platform
Safe & FME

We are the only All Data
Enterprise Integration Platform

9
Resources

Get our Ebook
Spatial Data for the
Enterprise

fme.ly/gzc


Guided learning
experiences at your
fingertips
academy.safe.com


FME Academy
Resources
Check out how-to’s &
demos in the knowledge
base
support.safe.com
Knowledge Base Webinars
Upcoming &
on-demand webinars

safe.com/webinars

p

Resources
Check out
our podcasts
on-demand.
featuring special guest
speakers over at EM360

10
Next Steps

We’d love to help you get
started.
Get in touch with us at
[email protected]
Experience the
FME Accelerator
Contact Us
A world where data is not just a
commodity but a catalyst for
real change.
fme.safe.com/accelerator



Next Steps

Claim Your Community Badge &
Dive into the new Community!
●Get community badges for watching
webinars
●community.safe.com
●Today’s code: 2K1RXA


Join the Community today!

11
Q&A

Thank You
Recap of Next Steps

1Join the FME Community
2Contact us
3Experience the FME Accelerator

Please fill out our
webinar survey
Tags