Evolution of MQ Messaging to Distributed Data Pipeline

nuboat 3 views 23 slides Oct 24, 2025
Slide 1
Slide 1 of 23
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23

About This Presentation

Evolution from Message Queue to Data Pipeline with Kafka


Slide Content

Evolution of Message Queue
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

Peerapat
Asoktummarungsri
Solution
Architecture
Digital Group & UIH
© COPYRIGHT 2025, PEERAPAT A

5000+
UIH?
WHY
Trusted by Thailand's leading
enterprises
Clients
24/7
Service-first
company
Support
GROUP'S
EXPERTISE
SCALABLE
& SECURE
Scalable and secure
infrastructure
Long history and proven track
record in mission-critical
services
Ownership of end-to-end
infrastructure: connectivity, direct
cloud connect, internet, cloud, and
data center
END-TO-END
OWNERSHIP
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

BUILT ON

PROVEN BY
EXCELLENCE
TRUST
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

© COPYRIGHT 2025, PEERAPAT A
message queue
to
data
pipeline
Agenda

© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A

Weak
Point
© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A

© COPYRIGHT 2025, PEERAPAT A
Partition 1
Partition 2
Partition 3
Partition 4
Partition 5
{ … }
Partition Key
{ … } ประเทภของ Message
Text, Json, XML, Protobuf, Avro
Partition Key
เพื่อให้ Kafka ใช้ดูว่าควรส่ง msg ไป Partition ไหน
TOPIC
Partition เพิ่มแล้วลดไม่ได้
Consumer 1
Consumer 2
Consumer 3
Consumer 4
Consumer 5
Consumer 6
reserved เผือตาย
Group ID = System A
TTL
TTL
อายุของ message ที่จะถูกเก็บใน Kafka
1 Consumer / Partition เสมอ
KAFKA 101

© COPYRIGHT 2025, PEERAPAT A

EDUCATIONHOTEL
HOSPITAL
ENTERPRISE BFSI GOVERNMENT RETAIL
TRUSTED BY
5,000++
OF THAILAND’S LEADING COMPANIES
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

OUR PARTNERS
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

OUR GLOBAL CERTIFICATES
Network Certificates
CISCO
FORTINET
HUAWEI
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

OUR GLOBAL CERTIFICATES
Cloud Certificates
MICROSOFT
GOOGLE AWS
ALIBABA ITIL ORACLE VMWARE
VEEAM LOGIC MONITOR ACRONIS KONG
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

OUR GLOBAL CERTIFICATES
Cybersecurity Certificates
© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

© UIH ALL RIGHTS RESERVED V.2 (15-09-2025)

At UIH, we combine trusted infrastructure, AI-powered solutions, and a deep service mindset to help organizations
grow confidently in the digital era. Let’s shape the future of business—together.
YOUR FUTURE-READY BUSINESS STARTS TODAY