Connector Corners: Building LLM Applications with GenAI Activities

This session will provide a review of the latest and greatest in the first party GenAI Activities and some helpful patterns to keep in mind when building with these activities. We'll talk about new features like Context Grounding, and Action Apps that let people check GenAI outputs, and more. Having some familiarity with GenAI concepts will be useful for this session.

1. 1
Integrate to automate!
Welcome to
Connector Corner

Connector Corners: Building LLM
Applications with GenAIActivities

2. 2
Scott Schoenberger
Senior Product Manager
Logan Emerson
Senior Technical Consultant
Diana Gray
Host, Senior Community
Marketing Manager
Today’s UiPath Team

3. 3
Agenda
•Intro to UiPath GenAI Activities
•GenAI Activities + UiPath Apps Demo
•GenAI Activites + Studio Web Walkthrough and
Build Experience
•Human in the Loop Validation with Action Apps
•Q + A

4. 4
AI at work: the UiPath Business Automation Platform
PROCESS MINING TASK MINING COMMUNICATIONS MINING IDEA CAPTURE & MANAGEMENT
UI + API
AUTOMATION
GENERATIVE AI
& EXPERIENCES
PROCESS
ORCHESTRATION​
LOW-CODE
DEVELOPMENT
Discover
Identify the highest-ROI opportunities for continuous process
optimization and automation using the power of AI
Automate
Rapidly build AI-powered automation that seamlessly collaborates
with people and systems to transform every facet of work
Your ApplicationsYour
People
Your
ProcessesSystems of record | Communications and collaboration | Personal productivity​
REAL-TIME & TREND
ANALYTICS
CONTINUOUS TESTING
UNIFIED MANAGEMENT
& GOVERNANCE
CLOUD-FIRST FLEXIBILITY
Operate
Establish an enterprise-grade foundation to run and optimize
a ​mission-critical automation program at high scale
INTELLIGENT DOCUMENT
PROCESSING & SPECIALIZED AI
GenAI Activities are now GA

5. 5
▪Quality-assured, optimized activities for prompt-based RPA tasks
▪Chain prompts for complex reasoning, minimizing 'If/Then' usage
▪LLM outputs validation through custom App Tasks or Action Center Tasks
▪Flexible architecture for developers to switch models/providers for best
results
▪Dynamic prompts leveraging Studio Web, Desktop & Apps for advanced
workflows with LLM inferences
▪GA Context Grounding with File Upload (Single Doc)
▪GA Context Grounding with Index Reference (Multi-Doc Repository)
▪Vision model addition for image upload and analysis (Available Now)
▪Prompt & template chaining
▪App templates for user validation (human in the loop)(Available Now)
Content Generation
+ (Context Grounding – Preview)
Email Generation
Language Detection Language Translation
Summarization
PII Detection
Rewrite
Semantic Similarity
October
Named Entity Recognition
Available Now
Image Classification + Comparison
October
Sentiment Analysis
Week of Sept 23
Categorize
Available Now
Object Detection
Available Now
Signature Comparison
Week of Sept 23
Reformat
Week of Sept 23
Current Functionality 2024.10 Functionality
Current Activities 2024.10 Activities
GenAI Activities Roadmap
Easy to access, develop with, and leverage high quality AI predictions in automation workflows.
Licensing: 1 AIU per execution

6. 7
Data Encryption
All In Transit TLS 1.2 +
All At Rest AES 256
We manage all services within Trust
Boundary and customer data isnever
retained/reused by our partners
HTTPS
(TLS 1.2+)
UiPath-Managed
3
rd
Party LLMs
UiPath-Managed
3
rd
Party AI models
HTTPS (TLS 1.2+)
Cloud Identity Service
Azure Redis for Cache
Automation Ops
Semantic Search*
Azure Apps Insights
UiPath Orchestrator
Azure OpenAI (GPT) Google VertexAI (Gemini)
HTTPS (TLS 1.2+)
*private preview
**planned 2024
LLM Gateway
Context Grounding*
LLM Proxy
API
Normalized Chat
Embeddings
PII detection
Capabilities
Authentication
Rate Limiting
Governance
Telemetry
Monitoring/Audit**
UiPath AI Trust Layer
UiPath Products
& Services
Autopilot
Document Understanding
Communications Mining
GenAI Connectors
Test Manager
Process Mining
Marketplace
Apps
Studio Web
ACR/Serverless
UiPath AI Trust Layer
UiPath Products
Zero data retention or training
UiPath-managed
AI Models
Customer managed 3
rd
Party LLMs
GenAI Activities
Trust Boundary
UiPath Platform Services

7. 8
What time is it?
DEMO
TIME

8. 9
Studio Web Build Experience
TASK MINING IDEA CAPTURE & MANAGEMENT
GENRATIVE AI
& EXPERIENCES
LOW-CODE
DEVELOPMENT
Discover
Identify the highest-ROI opportunities for continuous process
optimization and automation using the power of AI
Automate
Rapidly build AI-powered automation that seamlessly collaborates
with people and systems to transform every facet of work
REAL-TIME & TREND
ANALYTICS
CONTINUOUS TESTING
UNIFIED MANAGEMENT
& GOVERNANCE
Operate
Establish an enterprise-grade foundation to run and optimize
a ​mission-critical automation program at high scale
INTELLIGENT DOCUMENT
PROCESSING & SPECIALIZED AI

9. 10
Q&A
Ask Russel!

10. 11
Thank
You!