Data Virtualization in Action: Scaling APIs and Apps with FME

SafeSoftware 805 views 74 slides Aug 27, 2025
Slide 1
Slide 1 of 74
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62
Slide 63
63
Slide 64
64
Slide 65
65
Slide 66
66
Slide 67
67
Slide 68
68
Slide 69
69
Slide 70
70
Slide 71
71
Slide 72
72
Slide 73
73
Slide 74
74

About This Presentation

Imagine building secure, scalable apps without writing a single line of code. This advanced session builds on our first webinar, showing you how to deploy scalable, secure APIs that power real-time apps and dashboards using FME.

In this advanced session, you’ll learn how to scale and secure your ...


Slide Content

Data Virtualization in
Action: Scaling APIs and
Apps with FME

Dennis
Wilhelm

Software Architect
con terra
Rylan
Maschak

Group Product Manager
Safe Software
Nick
Ison

Product Manager, Cloud Team
Safe Software
Meet the Presenters

Welcome to Livestorm.
A few ways to engage with us during the webinar:


Audio issues? Click this for 4 simple
troubleshooting steps.

How to download slides
1.Hover over the
slide deck in the
webinar room
2.Click this button

Agenda
1Introduction
2Reusable API Templates
3API Authentication and Authorization
4What’s New & Coming
5Conclusion
6Resources & Next Steps
7Q&A

Agenda

1
Introduction

Deliver real-time, secure, and
scalable APIs with FME: no
code required.

Flash
Demo

●Unified access to data across apps,
tools, and platforms
●On-demand data delivery for
dashboards and web apps
●Centralized control over data exposure
and access
●Rapid iteration and deployment
without coding
●Seamless integration with Esri and
enterprise systems




With Data Virtualization

Challenges You Might Face
Common frustrations people face with this topic are:
●Starting from scratch: no templates or examples
●Difficulty securing APIs while enabling real-time access
●Performance bottlenecks with high usage
●Complexity in handling multiple schema types or data formats
●Lack of visibility and control across departments

Solve these challenges by combining
reusable templates, built-in governance
tools, and performance-enhancing features
like caching, async execution, and schema
flexibility – making scalable API deployment
achievable without coding.

The only All-Data, Any-AI Platform.
FME Form FME Flow
Data Movement and transformations
(“ETL”) workflows are built here.
Brings life to FME Form workflows
FME Flow Hosted
Safe Software managed FME Flow
fme.safe.com/platform
FME Enterprise Integration Platform
Safe & FME
FME Realize
Experience data in real world
context, in real time.

With 500+ supported data types in FME.
Unrivalled Data Support





GIS
CAD
Database
XML
Raster
3D
BIM
Web
Point
Cloud
Cloud
Big Data
IOT
Graph
BI
Indoor
Mapping
AR/VR
Generative
AI
Cloud
Native
Tabular

2
Reusable API
Templates

●Data Virtualization allows FME Flow to provide almost any API
●Why not use existing standards to integrate FME even better
in IT infrastructures!
Endless possibilities

New OGC APIs
New OGC API Legacy Usage
OGC API Features Web Feature Service Access to vector data
OGC API Maps Web Map Service Map visualization
OGC API Processes Web Processing Service Execution of processes & job
management
OGC API Coverages Web Coverage Service Raster data access
OGC API Records Catalogue Service for the WebMetadata queries

●Simplified HTTP access to geospatial
●Easier integration with modern web clients and services
●Standardization reduces vendor lock-in
●Widely supported across the geospatial ecosystem

Why OGC APIs Matter

●OGC API - Features
○Expose live vector datasets via OGC-compliant
endpoints
●OGC API - Processes
○Trigger FME Workspaces via a standardized API


●Developed by con terra, available on FME Hub
○Example implementation
○Can be customized for other use cases

Getting started using Hub Templates

“[…] supports the wrapping of computational tasks into
executable processes that can be offered by a server through a
Web API and be invoked by a client application […].
Typically, these processes execute well-defined algorithms that
ingest vector and/or coverage data to produce new datasets.”

https://ogcapi.ogc.org/processes/


OGC API Processes

OGC API Processes ↔ FME Flow

●Request by Deutsche Telekom to provide an OGC API
Processes interface for FME
●Implementation of a Python based adapter
●Goal is to switch to native FME functionality instead of a
custom implementation
Initial motivation

„[…] offers the capability to create, modify, and query spatial
data on the Web and specifies requirements and
recommendations for APIs that want to follow a standard way of
sharing feature data.”

https://ogcapi.ogc.org/features/

OGC API Features

●Access to vector data via
FME Flow
○Filter based on bbox,
datetime, properties, …
●FME implementation built for
API access, not to replace
map clients

OGC API Features

●Data can now be consumed by any
software that has implemented the
specification
●Including of course FME

OGC API Features in FME

Demo

●Define each API endpoint
●Create Workspaces
Setup: OGC API Processes

●Read parameters from API input

Execute Processes Endpoint

●Store job in the database
●Perform the actual workspace
execution
Execute Processes Endpoint

●Provide response back to the
client

Execute Processes Endpoint

Main Processing Steps
●Mapping between parameters from FME and OGC API Processes
●Trigger jobs using the different FME services
●Use a custom job database to
○Map between UUID and FME job id
○Provide async datastreaming
●Provide required metadata
○Descriptions
○Links to resources
⇒ Everything is already done in the templates for you :-)

Demo

“Writing your own API without
standards is like cooking without a
recipe—sure, it might work, but good
luck explaining it to anyone else.”

— ChatGPT

Wrap-up
●Providing your data or processes via a standard will
improve interoperability and user experience
●Templates provide an easy way to get started without
reading through the full API specs first

Thank you
Dennis Wilhelm
Software Architect
con terra
[email protected]

3
API
Authentication
and Authorization

●The Next Leap – Pushing Boundaries in Data & AI Innovation
○Starting at 53:30 - introduction to the project and a good high-level
overview of a demonstration project and how it all works

●Been There, Mapped That: API (& AI) Adventures in Data Virtualization
○Deeper dive into the technical components of how Data Virtualization was
used to build a backend API, and building a front-end to interact with it



Building on The Peak of Data and AI 2025:

Authentication &
Authorization in
Data Virtualization

Authentication Authorization
“Who are you?”
Verifies the identity of the user or
system (e.g., via username +
password, API key, OAuth token).

“What are you allowed to do?”
Determines what actions or resources
that authenticated user/system is
permitted to access.

Authentication proves identity;

Authorization controls access.

●The ability to decide if a specific
endpoint is allowed to be queried
without credentials or with
credentials
●Uses FME Flow User Model

Authentication in Data Virtualization

Slide Title
No
Auth
FME
Flow
Auth
Custom
Auth
Three ways of handling Authentication

Slide Title
No
Auth
●Authentication is not used
●Anybody with the API URL can make a request
and get results
●Need to ensure that no sensitive data is available
●Any API being built for corporate purposes really
should have authentication setup as default

●Authentication is checked when making a
request
●Uses FME Flow users and user groups
●Anybody with the API URL can make a request
and get results, but needs to have valid
credentials
●Can help gate keep sensitive information to those
who have credentials
●Easiest method of securing your endpoints
Slide Title
No Auth
FME
Flow
Auth

●Granular control over who is allowed
to interact with your endpoints - by
role and/or user
Authentication in Data Virtualization

●FME Flow user account that can create other
user accounts - eg: website signup process
●Easy:
○When user logs in, can use those credentials
as part of the header of the subsequent
requests
●Better:
○Use the parent account to generate an API
token for end user, save that in session and
use for subsequent requests
Slide Title
No Auth
FME
Flow
Auth

Authentication in Data Virtualization
Authentication
Type
Placement Configuration
Basic Header Authorization: Basic <base64-encoded " username:password">
Token Header Authorization: fmetoken token=< API-token>
Token Query Parameterfmetoken=<API-token>
More Details on FME Support Center

Slide Title
No Auth
Custom
Auth
●Authentication is checked as part of the FME
Workflow triggered by API Endpoint
○Technically, requests are initially performed
with ‘No Authentication’
●Can be used to check your own Authentication
source (Internal Database, Active Directory, etc.)
●Need to handle messaging/errors when user is
not allowed to access endpoint
○Eg. return HTTP 401 / Unauthorized instead
of HTTP 200 / OK

Example Custom Authentication

Example Custom Authentication

Example Custom Authentication

Authentication Authorization
“Who are you?”
Verifies the identity of the user or
system (e.g., via username +
password, API key, OAuth token).

“What are you allowed to do?”
Determines what actions or resources
that authenticated user/system is
permitted to access.

Authorization
●Authorization has different facets for every company, project, workflow
●This is where your business logic comes into play
●Can be managed with FME Flow user roles
●If you need more granular control (field level, row level, etc. ), you’ll need
to look at incorporating that into your individual endpoints/workflows

4
What’s New
and Coming

Query String Caching
●Caches are now generated for
unique combinations of Query String
Parameters
●Follows the same caching
configuration (per Endpoint or API)


Available now in FME Flow 2025.1!

Complex Schema
Support
●Nested JSON Object Properties
●JSON Arrays
●Use Schemas for Properties
●Schemas in Schemas

●Supported when creating, editing, or
importing an OpenAPI specification

Coming soon in FME Flow 2025.2!

Flexible Content Type
Handling
●Expanded List of Predefined MIME
Types
●Manually Add Any Type
●Supports Better API Documentation


Coming soon in FME Flow 2025.2!

Long Polling for Async Endpoints
●Using query string parameters longPoll and longPollInterval to reduce
excessive polling and network traffic
●Available for all workspace endpoints with ‘Asynchronous Processing’ enabled

Coming soon in FME Flow 2025.2!

Long Polling for Async
Endpoints
●Using query string parameters
longPoll and longPollInterval to
reduce excessive polling and
network traffic
●Available for all workspace endpoints
with ‘Asynchronous Processing’
enabled

Coming soon in FME Flow 2025.2!

Support for
Callback URLs
●Configure an API Response to be
sent to another Data Virtualization
Endpoint
●Support for selecting an Automation
or any URL is on the roadmap

Coming soon in FME Flow 2025.2!

5
Conclusion

Summary
●Use existing templates to jumpstart
your first API
●Solve real problems with FME’s Data
Virtualization—securely and at scale
●Define and test your endpoints early
before layering in advanced config
●Keep sharing your feedback—we’re
building this with you!

30+
30K+
128
140+
25K+
years of solving data
challenges
FME Community
members
countries with
FME customers
organizations worldwide
global partners with
FME services
200K+
users worldwide
200K+
users worldwide

All Data. Any AI.
All Data Velocities
Batch (ETL, Reverse ETL, ...)
Event ( BPA, RPA, ...)
Stream
All Data Locations
Any Cloud
On-premises
Hybrid
Edge
Containers
Embedded
Mixed
All Data Types
Unstructured
Structured
Spatial
APIs
Web Apps

Any AI
Technology
OpenAI
Amazon Bedrock
Google Gemini
Ollama
Deepseek
Composite
...

6
Resources

Data Virtualization
Resources
●OGC API Processes Template
●OGC API Features Template
●Getting Started with Data
Virtualization

Get our Ebook
Spatial Data for the
Enterprise

fme.ly/gzc


Guided learning
experiences at your
fingertips
academy.safe.com


FME Academy
Resources
Check out how-to’s &
demos in the knowledge
base
support.safe.com
Knowledge Base Webinars
Upcoming &
on-demand webinars

safe.com/webinars

7
Next Steps

We’d love to help you get
started.
Get in touch with us at
[email protected]
Experience the
FME Accelerator
Contact Us
A world where data is not just a
commodity but a catalyst for
real change.
fme.safe.com/accelerator



Next Steps

Claim Your Community Badge &
Dive into the new Community!
●Get community badges for watching
webinars
●community.safe.com
●Today’s code: 1EUTHC
●Join bingo!
community.safe.com/p/bingo25

Join the Community today!
Next Steps

8
Q&A

Thank You
Recap of Next Steps

1Follow us on LinkedIn!
2Contact us
3Experience the FME Accelerator

Please fill out our
webinar survey