A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1

office503621 110 views 4 slides May 23, 2024
Slide 1
Slide 1 of 4
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4

About This Presentation

Apache Airflow is a free, open-source, Python-based ETL orchestrator. It's code-driven, user-friendly, and comes with an excellent web interface. Its asynchronous engine supports parallel execution, ensuring optimal performance. Find out more: https://knowledgeseed.ch/blog/a_python-based_approac...


Slide Content

• No connection between Chores
• Slower load times
Chores
+ TI Processes
Chore
TI TI TI TI
Chore
TI TI TI TI
Chore
TI TI TI TI
Source
system
TM1
KnowledgeSeed GMBH Altackerstrasse 14. 5707 Seengen, Switzerland

• Independently and concurrently running tasks
• Faster load times
AirFlow
Flexible
Code-
driven
Complex
workflows
Async
Engine
Source
system
TM1
TI
TI TI TI
TI TI
TI TI
TI TI
KnowledgeSeed GMBH Altackerstrasse 14. 5707 Seengen, Switzerland

Built-in Web Interface
Process Management and
Administration
Monitoring
Workflow Progress
Visualize
Dependencies
KnowledgeSeed GMBH Altackerstrasse 14. 5707 Seengen, Switzerland

Additonal Features
Task Retries
??????
Task Rescheduling
??????
E-mail Notifications
??????
KnowledgeSeed GMBH Altackerstrasse 14. 5707 Seengen, Switzerland