Driving Business Innovation: Latest Generative AI Advancements & Success Story

SafeSoftware 839 views 62 slides Jun 12, 2024
Slide 1
Slide 1 of 62
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40
Slide 41
41
Slide 42
42
Slide 43
43
Slide 44
44
Slide 45
45
Slide 46
46
Slide 47
47
Slide 48
48
Slide 49
49
Slide 50
50
Slide 51
51
Slide 52
52
Slide 53
53
Slide 54
54
Slide 55
55
Slide 56
56
Slide 57
57
Slide 58
58
Slide 59
59
Slide 60
60
Slide 61
61
Slide 62
62

About This Presentation

Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow...


Slide Content

Driving Business Innovation:
Latest Generative AI
Advancements & Success Story

Chris
Berger

Customer Solutions
Team Lead
Safe Software
Dmitri
Bagh

Technical Specialist
Safe Software
Hannah
Barrington

Marketing Manager
Workspace Group
Oliver
Morris

Business Director
Tensing
Meet the Presenters

Welcome to Livestorm.
A few ways to engage with us during the webinar:


Audio issues? Click this for 4 simple
troubleshooting steps.

Agenda
1Introduction
2Customer Story: Workspace Group
3Locally Run LLM & Embedding
4Google Gemini Connector
5Resources & Next Steps
6Q&A
Agenda

1
Introduction

Harness the transformative
power of AI.
Gain actionable insights for efficiency in
data integration strategy.



Introduction

Common Barriers to AI Adoption
●Technology Complexity: Difficulty grasping & applying advanced AI systems.
●Skill Shortages: Insufficient expertise to optimize AI use.
●Security Concerns: High stakes around data privacy and security.
●Resource Limits: Financial and time constraints hindering AI adoption.
●Change Resistance: Company hesitancy to adopt disruptive technologies.

Introduction

FME simplifies AI
integration, bridging
resource constraints with
less cost & complexity.











Introduction

One platform, two technologies
FME Form FME Flow
Data Movement and transformations
(“ETL”) workflows are built here.
Brings life to FME Form workflows
FME Flow Hosted
Safe Software managed FME Flow
fme.safe.com/platform
FME Enterprise Integration Platform
Safe & FME

2
Customer
Success Story
Description generation using Generative AI

WORKSPACE
GROUP

Introductions
Workspace Group
-Leading provider of flexible office
spaces in London
-Own > 5m sq.ft. of space
-77 properties in London
-Home to 4,000+ diverse
businesses

Introductions

Hannah Barrington
Marketing Manager
- Property marketing/acquisition
-Building launches
-Focus buildings - boost occupancy
-Branded collateral
-Shop window
-Building signage

Some
Background

●Upgraded DAM from Sharepoint to Bynder
-Sharepoint - Images in standard folder format
-Bynder - Images searchable using tags
- System integration
- SEO/keywords

●Lack of efficiency

●Manual process


Image migration
Background

●SharePointOnlineConnector
●HttpCaller
○Importing the OpenAPI spec
●> 8000 images loaded so far


Image migration
Background
FME Form

●Images synced to CRM,
website and marketing
outputs
●Sped up manual unit
photography process
Result
Background

●Only had illegible architect plans & areas of buildings had changed
●Plans were in varying formats - PDFs, DWGs
●Various failed methods over 3+ years
Floor plan creation - Background
Background

●PDF / CAD to PDF
●Over 800 units created in 1 month


Floor Plan creation
Background
FME Form

●Producing whole buildings at a time
●18 buildings complete
●Remaining building rollout in
coming months

Result

The
Challenge

Slide Title
Generate unit
descriptions for
thousands of
Workspace office
units across over
70 buildings in
London

Goal Block Key
Unit descriptions using FME + AI
Result
Datasets spread
across DAM
catalogue, MS
Dynamics CRM,
PDFs, Google
Sheets and Web
pages

Using FME to
retrieve datasets
and put AI
enabled
transformers to
work

POC has
generated over a
hundred unit
descriptions, with
further integrations
planned

●Currently short and generic default copy
●Written by copywriter as and when units need a boost
●No extra detail around;
-Style
-Views
-Flooring
-Windows/doors
-Amenities eg. AC
-Natural light
-Specifications
-Size

Unit Descriptions

Multi-Modal Data
●Floorplans in PNG
●Unit images
●Descriptions (Unit, Building, Local Area)
Unit descriptions using FME + AI

Data Sources Readers / Transformers
●Digital Asset Management
catalogue (DAM) - Bynder
●Dynamics CRM
●File system - PDFs
●Google Sheets
●Public Web Pages
●HttpCaller
●PDF Reader
●Google Sheets Reader
●PNG (Portable Network
Graphics) Writer
●OpenAIVisionConnector
●AnthropicVisionConnector
Unit descriptions using FME + AI

Demo

●FME great at reading
disparate formats
●FME also is great at
orchestration
●Perfecting prompts is
crucial
●Use multiple models and
tools



Results
Unit descriptions using FME + AI

●Unit photos – from 1 year to
2 weeks
●Floorplans – 3.5 years to
~4,000 units within next 6
months
●Unit descriptions – POC
done in 1 week, possible to
generate 4000 unit
descriptions in hours



Benefits
Unit descriptions using FME + AI

●Write directly out to MS Dynamics CRM
●Use the building CADs to generate more
information - how far away are:
○Phone booths, Drinks points
○Meeting rooms/Break out spaces
●Building area descriptions

Next Steps
Unit descriptions using FME + AI

3
Locally run LLM,
Embedding

Slide Title
Create metadata
for a photo
archive

Goal Block Key
Using AI for Image Metadata Creation
Result
●Manual work is too
laborious
●Photos may
include sensitive
contents
Using locally-run
LLM
The metadata
database and
visualization
tools were
created

What is Ollama?
Ollama is a tool that helps you
use AI models directly or in
your apps easily, without
needing to set up complicated
systems.

https://ollama.com/

Photo
Archive
Local Models for
Sensitive Data:
LLama3+Llava
ChatGPT for
non-sensitive
components:
HTML, CSS,
JavaScript
FME to rule
them all

●Ask ChatGPT for metadata
database structure and SQL
statements for DB creation
●Read a folder of photos
●Ask LLava model for photo
descriptions
●Ask Llama3 model to
generate tags and creative
titles
●Normalize data and store in
database
●Ask ChatGPT for
HTML/CSS/JS
●Create a workspace to
transform DB to JSON
●Visualize your data
Photo Archive Creation
and Visualization

Photo Archive Creation
and Visualization
●Ask ChatGPT for metadata
database structure and SQL
statements for DB creation
●Read a folder of photos
●Ask LLava model for photo
descriptions
●Ask Llama3 model to
generate tags and creative
titles
●Normalize data and store in
database
●Ask ChatGPT for
HTML/CSS/JS
●Create a workspace to
transform DB to JSON
●Visualize your data

Photo Archive Creation
and Visualization
●Ask ChatGPT for metadata
database structure and SQL
statements for DB creation
●Read a folder of photos
●Ask LLava model for photo
descriptions
●Ask Llama3 model to
generate tags and creative
titles
●Normalize data and store in
database
●Ask ChatGPT for
HTML/CSS/JS
●Create a workspace to
transform DB to JSON
●Visualize your data

Visualize your data

View results

Can you see what’s wrong with the tags?
Photo Archive Creation
and Visualization

Lessons learned
●You can protect your data with locally run LLM
●Use the best tool available for generating
open/non-sensitive contents
●Prompt writing becomes an essential skill

Problems discovered
●Inconsistent prompt following (three requests
per image add up)
●Huge number of tags

Updated Solution
●1 request for all tags, then - assigning images to
tags, not tags to images

View results

Next problem
●What if we have 20,000 photos?

Embeddings
Python
Vector database
ChatGPT
Ollama
FME to rule
them all

●Embeddings is a way to
turn words into
numbers.
●We can test how
embeddings work with a
collection of fictional
facts to feed into a
model.
●A small dataset is good
for understanding how
embeddings works and
shows whether the
results are relevant and
accurate.


You will need Python libraries:
Ollama, ChromaDB*
Ollama Embeddings Tutorial

Simple Embedding Tests. What is a Tigerat?

Embedding transformer descriptions

Embedding transformer descriptions

Demo

●Extract object information
●Turn object info and questions into embeddings
●Ask questions
●Save and visualize answers
Embedding Revit data. Workspace

●Extract Object ID from answers
●Join with geometries
●Send to Data Inspector
Embedding Revit data. Visualization

4
Google
Gemini
Connector

Google Vertex Model Garden

Google Vertex AI
Authentication: OAuth

Integration: REST API

Vertex Multimodal support
●Language: Gemini
●Vision: Imagen
●Speech: Universal Speech Model (USM)
GoogleGeminiConnector

Demo

GoogleGeminiConnector Demo

OpenAIChatGPTConnector
●OpenAI: GPT-4o
●Azure OpenAI Model Catalog:
Easy access to 1,672 models
FME & Cloud Based AI Services
AmazonBedrockConnector
●AI21 labs
●Claude
●Cohere
●Stable Diffusion
●Amazon Titan
●Llama
GoogleGeminiConnector
●Gemini 1.5 Pro
●Model Garden: Easy access to 165
models




Discover more on the FME Hub!

FME & Cloud Based AI Services
Google Vertex Model Garden
●Deploy over 700,000 models from
HuggingFace with API access via
the Google Gemini OAuth web
connection & the HTTPCaller




Discover more on the FME Hub!

6
Resources

Get our Ebook
Spatial Data for the
Enterprise

fme.ly/gzc


Guided learning
experiences at your
fingertips
academy.safe.com


FME Academy
Resources
Check out how-to’s &
demos in the knowledge
base
support.safe.com
Knowledge Base Webinars
Upcoming &
on-demand webinars

safe.com/webinars

Check out
our podcasts
on-demand.
featuring special guest
speakers over at EM360

Resources

7
Next Steps

We’d love to help you get
started.
Get in touch with us at
[email protected]
Experience the
FME Accelerator
Contact Us
A world where data is not just a
commodity but a catalyst for
real change.
fme.safe.com/accelerator



Next Steps

Claim Your Community Badge &
Dive into the new Community!
●Get community badges for watching
webinars
●community.safe.com
●Today’s code: A7CKPP

Join the Community today!
Next Steps

8
Q&A

Thank You
Recap of Next Steps

1Join the FME Community
2Contact us
3Experience the FME Accelerator

Please fill out our
webinar survey
Tags