Jio Cinema user handling system design: A technical deep dive into streaming video content at scale

CURIOUS : HOW JIOCINEMA HANDLED 32M CONCURRENT USERS .
A technical deep dive into streaming video content at scale

JioCinema is an Indian OTT media streaming service offering video streaming services. Since 2023, JioCinema has held the exclusive digital rights to broadcast the Indian Premier League (IPL) in India.

During the IPL 2023 final, when Dhoni came out to bat, the digital streaming platform JioCinema hit 22 million concurrent viewers

1. CURIOUS : HOW JIOCINEMA HANDLED 32M CONCURRENT USERS A technical deep dive into streaming video content at scale Present By : Ansal KA

2. JIOCINEMA’S MULTI-CAM IPL STREAMING JioCinema is an Indian OTT media streaming service offering video streaming services. Since 2023, JioCinema has held the exclusive digital rights to broadcast the Indian Premier League (IPL) in India. With multiple cameras available on the ground, it is now possible for viewers to switch to their preference camera angle while watching IPL. This includes spider camera view, batsman view, bird's eye view, wicketkeeper view and recently added Hero Cam. Production Control Rooms (PCRs).

3. JIO CINEMA STATISTICS

4. INTRODUCTION

5. BASIC FLOW

6. FRONTEND OPTIMIZATION Feature Flags : Implemented for controlled feature rollouts to identify issues early. Features can be rolled back instantly if causing app crashes or performance drops. Enhances agility in handling real-time issues without impacting the entire user base.

7. FRONTEND OPTIMIZATION Scenario Simulations : Tools like Charles used to simulate different network conditions (low bandwidth, high latency). Test real-world scenarios like DNS failures , API call timeouts , and backend errors to ensure preparedness.

8. FRONTEND OPTIMIZATION Graceful Degradation : When certain features fail, default content is shown (e.g., home screen UI fallback). Core , P1 and P2 Features classification Errors are hidden from the user to ensure continuous satisfaction . Exponential Backoff technique for retrying failed API calls to avoid server overload.

9. EXPONENTIAL BACKOFF

10. BACKEND INFRASTRUCTURE A content delivery network (CDN) is a network of interconnected servers that speeds up webpage loading for data-heavy applications. By distributing content across multiple servers located in different geographic locations, CDNs can deliver content faster and more efficiently to users. That way, it reduces latency, improves page load times, and provides a better user experience.

11. BACKEND INFRASTRUCTURE

12. MULTI-CDN OPTIMIZATION

13. CACHE MANAGEMENT & OFFLOADING

14. PANIC MODE & SNAPSHOT-BASED FAILOVER

15. ASYNCHRONOUS PROCESSING WITH KAFKA

16. LADDER-BASED SCALING DOWN

17. AD INSERTION MECHANISM

18. CONCLUSION & FUTURE READINESS Key Takeaways : Scalability : Proactive planning and simulations ensured readiness for up to 32M users. Resilience : Panic Mode and static content delivery helped prevent system crashes during high load. Efficiency : Efficient CDN and cache management played a crucial role in handling traffic. Ad Scalability : Smooth ad insertion techniques ensured monetization without affecting the user experience. Future Improvements : Further refinement of caching policies. Enhanced database simulations for faster scaling. Even greater automation in scaling and Panic Mode activation.

19. QUESTIONS? References: Medium: Behind the Scenes: How JioCinema Seamlessly Streams IPL Matches to 20 Million Fans Youtube : How JioCinema live streams IPL to 20 million concurrent devices w/ Prachi Sharma | Ep 7