Building API data products on top of your real-time data infrastructure

This talk and live demonstration will examine how Confluent and Gravitee.io integrate to unlock value from streaming data through API products.

You will learn how data owners and API providers can document, secure data products on top of Confluent brokers, including schema validation, topic routing and message filtering.

You will also see how data and API consumers can discover and subscribe to products in a developer portal, as well as how they can integrate with Confluent topics through protocols like REST, Websockets, Server-sent Events and Webhooks.

Whether you want to monetize your real-time data, enable new integrations with partners, or provide self-service access to topics through various protocols, this webinar is for you!

1. @yourtwitterhandle | developer.confluent.io
What are the best practices to debug client applications
(producers/consumers in general but also Kafka Streams
applications)?
Starting soon…
STARTING SOOOOON..
Starting sooooon ..
Starting soon…
Starting soon…

2. @yourtwitterhandle | developer.confluent.io
What are the best practices to debug client applications
(producers/consumers in general but also Kafka Streams
applications)?
Starting soon…
STARTING SOOOOON..
Starting sooooon ..
Starting soon…

3. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
Streaming Architecture

4. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
Streaming Architecture

5. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
Streaming Architecture

6. @yourtwitterhandle | developer.confluent.io
What are the best practices to debug client applications
(producers/consumers in general but also Kafka Streams
applications)?

7. Goal

Partners Tech Talks are webinars where subject matter experts from a Partner talk about a
specific use case or project. The goal of Tech Talks is to provide best practices and
applications insights, along with inspiration, and help you stay up to date about innovations
in confluent ecosystem.

8. @yourtwitterhandle | developer.confluent.io
Starting soon…
STARTING SOOOOON..
Starting sooooon ..

9. @yourtwitterhandle | developer.confluent.io
Starting soon…
STARTING SOOOOON..
Starting sooooon ..

10. @yourtwitterhandle | developer.confluent.io
Starting soon…
STARTING SOOOOON..
Starting sooooon ..

11. Confluent Perspective : REST API
11

12. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. 12
Build a bridge
to Kafka from
anywhere
Native Kafka speakers?
●Confluent supported clients and features
○C/C++, Java, Go, .NET, Python
●Many open source/community supported
clients
●Native Kafka clients not available for all
languages
(Almost) everybody speaks REST
●Gain access to Kafka from almost anywhere
●Be aware
○Understanding of Kafka is required
○REST Proxy wraps Kafka client behavior

13. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
REST Options





REST Proxy

●REST endpoints to interact
with Kafka
○Produce & consume
○Admin




13




REST API

●v3:
○Admin API (details)
○Produce API (details)
●

Connect
●Sink
●Source

14. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
REST Proxy
Non-Java
Applications
Native Kafka Java
Applications
Schema
Registry
REST / HTTP
Connect any application
14
REST Proxy

Allows third-party apps to
produce and consume
messages
Communicate via
HTTP-connected devices
Provides a RESTful interface to
a Kafka cluster

15. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
Try yourself REST Proxy example
●REST Proxy: Example for Apache
Kafka® — Confluent Documentation
●Produce and consume with JSON and Avro
15
REST API reference
●Confluent REST Proxy API Reference —
Confluent Documentation
●Including
○consumer offset management
○manual commits

16. @yourtwitterhandle | developer.confluent.io
What are the best practices to debug client applications
(producers/consumers in general but also Kafka Streams
applications)?
Starting soon…
STARTING SOOOOON..
Starting sooooon ..
Starting soon…

17. Building API data products on top of
your real-time data infrastructure
Linus Hakansson
Field CTO

18. 18
We already know how to drive maximum value
from synchronous communication

19. 19
But what if you could ALSO productize your
events?
But how?

20. Partners and customers
20
Demonstratio
n
Topic: orders
Protocol mediation
Traffic shaping and transformations
Developer Portal and subscription
management
Access control
Analytics and monitoring
Kafka with SASL/SSL
PLAIN
HTTP POST Webhook Websockets

21. Analyst Recognition
21
2023 Magic Quadrant for API Management: Visionary
“Gravitee.io’s offering has strong capabilities and leading-edge features in
each aspect of API management. This wide-ranging product strategy sets
it apart from competitors that specialize in specific aspects of API
management. At the same time, Gravitee.io focuses on support for
event-driven APIs as a market differentiator, including publishing and
managing event-driven APIs side-by-side with request/response APIs.”

2023 Critical Capabilities for API Management: Top 3
“Gravitee.io’s offering received its highest use-case score for internal API
management, where it received a good score. It also received good scores
for the multiexperience architecture, integration using APIs and productizing
APIs use cases; and it received a fair score for the distributed API
management use
case. It ranked in the top 5 offerings in each use case.”
2024 Voice of the Customer for APIM: Leader
Gravitee.io is the only vendor to
receive the prestigious and
sought-after Gartner Peer Insights
Customer’s Choice 2024. Only
one vendor is in the leader
quadrant: Gravitee!
100% Willingness to
Recommend score

22. 22

23. 23

24. 24
Protocol Mediation

25. 25
Protocol Mediation

26. 26
What if I need to expose Kafka without mediation?
Generic TCP Proxy! However, that does
not give you;
●Authentication control
●Analytics and logs
●Transformations
●Traffic shaping and routing

27. 27
Introducing Gravitee Kafka Gateway
Virtual Topics Access Control Failover Transformations
Virtual
Partitions
Authentication
Mediation
Filtering Analytics
API Management for Kafka
●Documentation (AsyncAPI)
●Enterprise Developer Portal
●Subscription Management
●Policies and no-code traffic shaping
●Productize and monetize

28. 28
Kafka Gateway

Generally available in 4.6 (Dec 2024)

29. 29
Register at https://edge.gravitee.io/