FME Flow Fundamentals for Admins: Setup & Configuration FAQs

SafeSoftware 780 views 91 slides Oct 03, 2024
Slide 1
Slide 1 of 91
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62
Slide 63
63
Slide 64
64
Slide 65
65
Slide 66
66
Slide 67
67
Slide 68
68
Slide 69
69
Slide 70
70
Slide 71
71
Slide 72
72
Slide 73
73
Slide 74
74
Slide 75
75
Slide 76
76
Slide 77
77
Slide 78
78
Slide 79
79
Slide 80
80
Slide 81
81
Slide 82
82
Slide 83
83
Slide 84
84
Slide 85
85
Slide 86
86
Slide 87
87
Slide 88
88
Slide 89
89
Slide 90
90
Slide 91
91

About This Presentation

Are you about to start on setting up FME Flow, or thinking of upgrading your existing environment? This webinar will get you started on the right foot when it comes to navigating the pre-install and configuration stages with confidence.

Our expert panel will address the most common questions FME Fl...


Slide Content

FME Flow Fundamentals
for Admins: Setup &
Configuration FAQs

Merline
George

Technical Support
Specialist, FME Flow

Chris
Berger

Customer Solutions
Team Lead

Sanae
Mendoza

Technical Support
Specialist, FME Flow

Welcome to Livestorm.
A few ways to engage with us during the webinar:


Audio issues? Click this for 4 simple
troubleshooting steps.

Agenda
1What is FME?
2Aspects of Architecture Pre-Install
3Deployment Options
4FME Flow Engine Types
5Basic Hardware Recommendations
6FME Flow Configuration with Esri
7Resources to set up SSL
8Maintenance & expertise requirements
9User Authentication types
10Q+A Session
Agenda

Today…
Learn to set your FME Flow
deployment up for success with
expert guidance for a smooth,
efficient setup from start to finish.

Poll:
What is your top concern
when configuring
FME Flow?

FME Flow offers streamlined
solutions. With the right guidance,
you can ensure a smooth, efficient
setup every time!

“What is FME?”

FME Flow Hosted
Safe Software managed FME Flow
The only All Data Enterprise Integration Platform
FME Form FME Flow
The Authoring environment
workspaces are built here.
The Deployment environment delivering
services to your organization.


FME Enterprise Integration Platform
Platform Overview

Event Driven Real Time
FME Flow Apps
-Submit Jobs and Trigger Automations
-Stream or Download Job Results

FME Flow Automations
-Polling Services
-Email Received, FTP/S3/Directory
Modified, etc.

FME Flow REST API
-Job as a Webhook
Stream Processing
-Dedicated Engine(s) run a continuous job
-Native support for message brokers

FME Flow Automations
-Push Services
-Webhook/Message Received, Topic
Notified, etc.
FME Flow: Automation Capabilities

FME Flow Automations
Automating Processes with FME Flow Automations

●Event-driven workflows
●Eliminate manual intervention
●Remove schedule-based delays
●Ensure data is always current and
available

Automating Processes with FME Flow Workspace Apps
User uploads file
to FME Flow
Workspace App

1 2 3
Unlimited, Managed
Users
-User/Role permissions
-Authentication Services
(AD, SAML)
Flexible Engine
Deployment
-Deploy Engines Anywhere
-CPU-Based Pricing
-Remote Engines
Advanced Engine
Management
-Queues & Job Routing
-Active Periods
-Engine Assignment

FME Platform Overview

Customer Story
City of Naperville
Project
Automating time-consuming processes for their Electric,
Public Works, Finance, and Water departments.

Solution
Integrating FME with Cityworks to automate service requests
and work orders.

Results
●3300+ service requests and work orders automated,
saving hours of manual effort.
●Three staff with specialized coding skills free to focus
on high-value tasks rather than manual work
●Increased collaboration and stronger relationships
between departments
“With FME, we were suddenly saying “yes!” to other departments and
implementing requests quickly. Now, we’re viewed differently in our
interactions. FME makes it easy for us to improve our relationships with
other departments by helping improve their business processes.”
- Danielle DuBose, Database Developer, City of Naperville

Automate
Workspaces
Schedule
Jobs
No-Code
Workspace
Apps
Process IoT
Data in Real
Time
Published FME Workspace Files (.fmw)
FME Form
Author
Unlimited
Managed
Users
Monitor
System
Performance
Administrator
FME Flow

Poll:
How familiar are you with
FME Flow?

“What key aspects of the
architecture should you
understand before
installing FME Flow?”

FME Flow Architecture
FME Flow is comprised of several
components, each performing a different
function.

Core
Controls job routing, scheduling, and resource allocation.
Manages communication between all components.
Engines
Executes FME workspaces (jobs).
Processes data transformations and sends results to the Core.
Database (Postgres)
Stores job history, system settings, and user data.
Tracks jobs, schedules, and system state.

Web Application Server (Apache Tomcat)
Provides the web interface and API access for all users.
Manages user authentication and security.
System Share
Shared file storage for data, workspaces, and temporary files.
Ensures data accessibility for all components.

FME Flow Architecture
●Flexible: Deploy together or apart.
●Customizable: Bring your own
components.
●Scalable: Add Engines and power.

“What are the different
deployment options?”

Pros Cons
●Simple setup
●Lower cost
●Minimal maintenance
●Fast deployment
●Some scalability
●Single point of
failure
●Limited scalability
●Performance
limitations
●Not suitable for
high availability

Pros Cons
●Scalable
●Resource
optimization
●Flexible
●More complex
setup
●Higher
infrastructure cost

Pros Cons
●High availability
●Load balancing
●Disaster recovery
●Resilient
●Most complex setup
●Higher infrastructure
cost
●Requires advanced
technical knowledge

Deployment Pros Cons
Express ●Simple setup
●Lower cost
●Minimal
maintenance
●Fast deployment
●Single point of failure
●Limited scalability
●Performance limitations
●Not suitable for high availability
Distributed ●Scalable
●Resource
optimization
●Flexible
●More complex setup
●Higher infrastructure cost
Fault Tolerant ●High availability
●Load balancing
●Disaster recovery
●Resilient
●Most complex setup
●Higher infrastructure cost
●Requires advanced technical knowledge

Deploy FME Flow in any environment.
FME Form
& FME Flow

On-Premise
Multi-cloud
/ Hybrid
Contain-
erized
Cloud
Hosted
FME Flow with
Remote Engines
(deployable
anywhere)
Docker &
Kubernetes
Fully hosted
FME Flow on
AWS

Due to its flexibility, ease of
configuration, constant updating,
and development, FME is an ideal
tool supporting and accelerating
everyday work in the processing
and validation of spatial and
non-spatial data.

Marek Szczepkowski
Project Manager, Visimind

Resources

●Visimind is saving PSE hundreds of hours of processing
time - FME by Safe Software

“What are the differences
between FME Flow Engine
Types”

Standard Engines
Fixed licenses that are
purchased per engine.


Available to run jobs for the
duration of the license period.

FME Engine Types

CPU-Usage (Dynamic)
Engine(s) that are licensed
by CPU time (credit based).


Available to run jobs for the
equivalent credit hours.
FME Engine Types

CPU-Usage (Dynamic)
Engine(s) that are licensed
by CPU time (credit based).


Available to run jobs for the
equivalent credit hours (based
on CPU + System time).

1 Credit = 1 hour of CPU Time

FME Engine Types

Standard
Recommended Usage
●Predictable and Consistent Workloads
○I.e Available Engines = minimum
number concurrent requests
●Always on and waiting for new job
submissions (i.e. Automations, Flow
Workspace Apps, etc.)
●Stream Processing*



See FME Flow Administration: Planning and Performing an FME Flow Installation for more information
CPU-Usage (Dynamic)

●Unpredictable Workloads. Includes but
not limited to:
○Automations and Workspace Apps
○Reducing volume in job queues
○Infrequent but intensive jobs
○Irregular but critical jobs
○Stream processing*

FME Engine Types

Remote Engine
Service
Standard and/or CPU-Usage
Engines deployed close to
your data.

Available outside your
network on accessible
endpoints or in the Cloud.
FME Engine Types

Remote Engine Service
Recommended Usage
●Operations in multiple networks
(on-premise, on-cloud, hybrid/multi
cloud)
●Easier Installation Process
Distributed Engine

●Must be within the same network as the
rest of the FME Flow Components
○Bidirectional ports and continuous
network traffic
●More considerations/planning required
FME Engine Types

Engine Requirements
●1 CPU Core per Engine
○Applies to Standard AND
CPU-Usage
●Memory (RAM)
○Job dependent (review Job Logs)
■Queues can help route
resource heavy jobs to the
appropriate engine
●Dependencies
○ArcGIS, Python, Custom
Transformers
Distributed Engine
FME Engine Types

“What are the basic
hardware
recommendations?”

Data
●Size and Volume
●Formats
●Location
●Future Growth
Workflows
●Processes and Transformations
●Real-time or Batch
●Parallel or Sequential
●Frequency
●Performance

Hardware Recommendations
Basic Better Best
FME Flow Engine Count 2 4 8+

Hardware Recommendations
Basic Better Best
FME Flow Engine Count 2 4 8+
Processor (CPU) 4 6 10+

Hardware Recommendations
Basic Better Best
FME Flow Engine Count 2 4 8+
Processor (CPU) 4 6 10+
Memory (RAM) 8 GB 16 GB 32 GB

Hardware Recommendations
Basic Better Best
FME Flow Engine Count 2 4 8+
Processor (CPU) 4 6 10+
Memory (RAM) 8 GB 16 GB 32 GB
Disk Space 100GB 150GB 200GB

“What considerations
should you keep in mind
with Esri when configuring
FME Flow?”

FME Flow & Esri ArcGIS
●An ArcGIS Server license is required for
most Esri formats (with exceptions)
●ArcGIS Server must be installed and
licensed on the same machine as FME
Flow
●Version compatible: ArcGIS must be
compatible with FME.

“What resources do I
need to set up SSL?”

HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key

HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file


HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file
●Pre-requisites
○Familiarity with CA instructions and certificate access
○Familiarity with your web app’s SSL configuration/certificates

HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file
●Pre-requisites
○Familiarity with CA instructions and certificate access
○Familiarity with your web app’s SSL configuration/certificates
●Optional configuration
○Reverse proxy
○Self signed certificates
HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file
●Pre-requisites
○Familiarity with CA instructions and certificate access
○Familiarity with your web app’s SSL configuration/certificates
●Optional configuration
○Reverse proxy
○Self signed certificates
●HTTPS on Linux

HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file
●Pre-requisites
○Familiarity with CA instructions and certificate access
○Familiarity with your web app’s SSL configuration/certificates
●Optional configuration
○Reverse proxy
○Self signed certificates
●HTTPS on Linux
●Upgrade requires re-configuration

HTTPS Configuration

●Asymmetric encryption or public-key cryptography
○Public Key/Certificate
○Private Key
●Certificate formats
○.CER/.CRT file
○.PFX/.P12 file
●Pre-requisites
○Familiarity with CA instructions and certificate access
○Familiarity with your web app’s SSL configuration/certificates
●Optional configuration
○Reverse proxy
○Self signed certificates
●HTTPS on Linux
●Upgrade requires re-configuration
●HTTPS when working with certain transformers

HTTPS Configuration

●Configuring for HTTPS
●Configuring FME Flow for HTTPS
●Use a Reverse Proxy with FME Server
●FME Flow Troubleshooting: Configuring for HTTPS/SSL
Resources

“What User
Authentication
Types does FME
support?”

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control
●Role templates

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control
●Role templates
●Permissions- General vs specific

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control
●Role templates
●Permissions- General vs specific
●Password policy enforcement

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control
●Role templates
●Permissions- General vs specific
●Password policy enforcement
●Password reset

System Users
●Default system users-
admin, author, guest and user
●Default system roles-
fmeadmin, fmesuperuser,
fmeauthor,
fmeguest and fmeuser
●Role-Based Access Control
vs User-based access control
●Role templates
●Permissions- General vs specific
●Password policy enforcement
●Password reset
●MFA feature limitation

LDAP/Active Directory Users

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS
●Pre-requisites
○Standalone Domain
Controller
○Port, Connection Encryption,
Authentication type
○Search /Service account

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS
●Pre-requisites
○Standalone Domain
Controller
○Port, Connection Encryption,
Authentication type
○Search /Service account
●Import Users/groups

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS
●Pre-requisites
○Standalone Domain
Controller
○Port, Connection Encryption,
Authentication type
○Search /Service account
●Import Users/groups
●Optional
○Connection fields

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS
●Pre-requisites
○Standalone Domain
Controller
○Port, Connection Encryption,
Authentication type
○Search /Service account
●Import Users/groups
●Optional
○Connection fields
●Synchronizing

LDAP/Active Directory Users
●Protocol
○LDAP
○LDAPS
●Pre-requisites
○Standalone Domain
Controller
○Port, Connection Encryption,
Authentication type
○Search /Service account
●Import Users/groups
●Optional
○Connection fields
●Synchronizing
●SSO/Kerberos

Azure Microsoft Entra ID Users
●Protocol- OAuth 2.0 / OpenID Connect

Azure Microsoft Entra Users
●Protocol- OAuth 2.0 / OpenID Connect
●Pre-requisites
○HTTPS configuration

Azure Microsoft Entra Users
●Protocol- OAuth 2.0 / OpenID Connect
●Pre-requisites
○HTTPS configuration
●Import Users/groups

Azure Microsoft Entra Users
●Protocol- OAuth 2.0 / OpenID Connect
●Pre-requisites
○HTTPS configuration
●Import Users/groups
●Optional configuration
○Reverse proxy/LB
○Secondary Tenant
Access

SAML Users
●Protocol- SAML 2.0

SAML Users
●Protocol- SAML 2.0
●Pre-requisites
○HTTPS configuration

SAML Users
●Protocol- SAML 2.0
●Pre-requisites
○HTTPS configuration
●Automatic User Import on first login

SAML Users
●Protocol- SAML 2.0
●Pre-requisites
○HTTPS configuration
●Automatic User Import on first login
●Optional configuration
○Reverse proxy/LB
○Attribute field Mapping
○Signed Requests
○Advanced Settings under
Application.properties file

Resources
●User Management
●Security- Password features
●Authentication Services
●Configuring FME Flow for SAML Authentication
●Create an FME Flow Azure Active Directory Web Connection in FME
Form

●FME Flow Troubleshooting: Users/Roles
●FME Flow Troubleshooting: Windows Active Directory
●FME Flow Troubleshooting: Integrated Windows Authentication or Single
Sign On
●FME Flow Troubleshooting: Azure Active Directory
●FME Flow Troubleshooting: SAML

“What kind of
maintenance and
expertise is required?”

1 2 3
Installation
●Document everything
○Networking
○Architecture
○Service Accounts
●Version compatibility
Upgrades
●Review
○Documentation
○Changelog
○Compatibilities
●Test before Prod
●Backup
Maintenance
●Regular backups
●Monitor
●Cleanup tasks
●Stay informed
○community.safe.com
○safe.com

8
Resources

Get our Ebook
Spatial Data for the
Enterprise

fme.ly/gzc


Guided learning
experiences at your
fingertips
academy.safe.com


FME Academy
Resources
Check out how-to’s &
demos in the knowledge
base
support.safe.com
Knowledge Base Webinars
Upcoming &
on-demand webinars

safe.com/webinars

Peak of Data Integration 2025 -
Call for Presentations Now Open
●Abstracts due Nov 29th, 2024
●All levels FME proficiency welcome
●15 & 25 min options (incl. Q&A)
●Special speaker rate for accepted talks
●Registration is open!

peakofdataintegration.com/call-for-presentations

9
Next Steps

Register Now
Tune into Part 2!.

We’d love to help you get
started.
Get in touch with us at
[email protected]
Experience the
FME Accelerator
Contact Us
A world where data is not just a
commodity but a catalyst for
real change.
fme.safe.com/accelerator



Next Steps

Claim Your Community Badge &
Dive into the new Community!
●Get community badges for watching
webinars
●community.safe.com
●Today’s code: R2HBX5


Join the Community today!
Next Steps

10
Q&A

Thank You
Recap of Next Steps

1Follow us on LinkedIn!
2Contact us
3Experience the FME Accelerator

Please fill out our
webinar survey
Tags