6. Accelerate your Journey to the Data Intelligence Platform.pptx

RishabhKesarwani12 312 views 40 slides Jul 04, 2024
Slide 1
Slide 1 of 40
Slide 1
1
Slide 2
2
Slide 3
3
Slide 4
4
Slide 5
5
Slide 6
6
Slide 7
7
Slide 8
8
Slide 9
9
Slide 10
10
Slide 11
11
Slide 12
12
Slide 13
13
Slide 14
14
Slide 15
15
Slide 16
16
Slide 17
17
Slide 18
18
Slide 19
19
Slide 20
20
Slide 21
21
Slide 22
22
Slide 23
23
Slide 24
24
Slide 25
25
Slide 26
26
Slide 27
27
Slide 28
28
Slide 29
29
Slide 30
30
Slide 31
31
Slide 32
32
Slide 33
33
Slide 34
34
Slide 35
35
Slide 36
36
Slide 37
37
Slide 38
38
Slide 39
39
Slide 40
40

About This Presentation

it is the slides containing the content related to databricks


Slide Content

Traditional Enterprise + Modern Cloud Innovation Partnerships Core Pillars Industry Powered Co-Pilot SAP Extend & Innovate Unity Catalog Migration to Data Intelligence Platform Supply Chain Finance Logistics Procurement Azure Intelligent Enterprise Azure IoT S3 Key Partner for Lakehouse Migrations Key Partner for Unity Catalog Implementations 200+ Data Bricks Customers 15+ Petabyte -Data Migrated Multiple Success Stories & Case Studies

Celebal's expertise in Databricks Data Intelligence Platform Your data. Your Al. Your future. Data Science & Gen Al Real-time Analytics ETL & Orchestration Data Warehousing Mosaic AI Delta Live Tables Workflows Databricks SQL Use generative Al to understand the semantics of your data Data Intelligence Engine Develop generative Al applications on your data with full privacy Democratize access to insights for all users Unify your data and governance for lower TCO, faster value Unified security and governance Unity Catalog Unified data storage, management, and sharing Delta Lake

Accelerate your Migrations with CT Visa On Prem SQL Engineer ETL Engineer Cloud SQL Engineer BI Engineer Analytics Engineer

CT Visa ‹#› Representative efficiency gains – actual results will vary 55% Discovery 76% Analysis 55% ETL Code Conversion 80% History Data Migration 45% Analytics Code Conversion 65% SQL Code Conversion 70% BI Refactoring 66% Data Reconciliation 68% Report Reconciliation 46% DevOps ETL Engineer SQL Engineer Devops Engineer BI Engineer Analytics Engineer

Tool powered Migration Methodology Discovery Phase Assessment & Planning Data Migration Data Reconciliation Code Migration   Unit Testing Data Validation  Performance Tuning Deployment Post Migration Support Evaluation of current SAS Environment. Identify the scope of migration. SAS Code and Data Assessment. Infra and networking Setup. Resources planning. Extract Data from various data sources to Databricks. Determine the optimal data ingestion methodology Ensure that the Data Quality & Integrity are maintained. Data Completeness. Data Readiness. Migrate SAS code to the Equivalent Apache Spark. Migrate all workflows. Preserve Business logic & Document it. Develop test cases. Syntax & Logical error. Code Quality & Correctness. Validate Migrated Code & Data against original SAS Environment. Compare results by SAS and Databricks. Code performance Optimization. Business Logic fine Tuning. Go-Live with Databricks. Ensuring Stability and performance. Ongoing Support & Maintenance. CR management. Optimize and refine the solution. 60% Less Time 25% Less Time 50% Less Time 35% Less Time

Industry Data Models on Lakehouse Manufacturing Shop Floor to Top Floor Insights Smart Manufacturing for Real-time Decision & Execution Supply Chain Analytics Inventory Forecasting, Optimization and Replenishment Demand Forecasting Financial Planning Analytics Predictive Maintenance Analytics FSI Customer 360 Customer Analytics Financial Modeling Risk & Fraud, Threat Detection Credit Analytics Marketing Analytics Regulatory Compliance Claims Automation Retail/CPG Omnichannel Optimization Hyper Personalization In-Store Optimization Supply Chain Optimization Shopper Affinity Customer Segmentation Safety Stock Analysis Health Care Genomics &Precision  Medicine Clinical & Claims Data IoT Device Analytics Medical Image Deep Learning Predictive Analytics for Early Disease Detection Social Analytics Patient Engagement and Experience Media & Entertainment Customer Churn Prevention Audience Insights Content Personalization Recommendation Engine Performance Measurement Predictive Analytics Sentiment Analytics

Accelerated Data Governance with Unity Catalog ‹#›

Migration Approach: Why Celebal Technologies? Implementation State Proposal State Requirement Gathering & Inventory Analysis Pre-Migration Assessment Pre-Scoping Questionnaire Creation of SOW Overview of Current Architecture Key Challenges and Consideration Unity catalog Assets Setup Data and Asset Migration User Group Upgradation Testing & Validation Logical naming and hierarchies of catalogs and schemas  Cluster and Workspace Binding Storage Credentials Creation Migrate all Managed and External Tables using Utility Migrate Notebooks and Jobs using utility Migrate ACL Post the creation of tables and other assets. Create a User and Group Mapping . Migrate the workspace local groups to account groups if they already exists. Create account level groups based on requirements. Detailed Inventory Creation Access Control and Governance Planning Best Practices for Effective Migration Post Migration State Post Migration Support Supporting any changes post migration.  Closely monitoring the jobs for any failures. Continuous process monitoring and optimization suggestions KT & Handover Knowledge transfer and project handover upon completion. Sprint Wise Planning Migration Progress Monitoring Testing the migrated assets using Validation utility Sharing the Report with client and taking sign off Validate access control integrity post migration Celebal Unity Launcher Custom CT Offerings: Empowering Databricks with Customized and Automated Data Migration with Multiple Pre-build frameworks.

Migration: Hive/ Apache Ranger/Glue Migration to Unity Catalog SCIM Hive Migration UC Metastore and Managed/External Tables Centralized Identity and access management Automated Lineage UC Security Model Secure Delta Sharing Discovery Tags Data Assets and Metadata Access control and permission management Data Lineage Security Policies Data Sharing Data Classification and Tags Apache Ranger Migration Apache Ranger Catalog Policies Apache Ranger Table Level Access Control Apache Ranger Schema level Access Control Table’s PII Masking UC Catalog Policies UC Table Level Grants UC Schema level Grants Table’s PII Masking in UC

Impacts of our Pre-Built Frameworks 30% reduction in security incidents 40% increase in data retrieval 20% higher accuracy in risk assessments 50% faster data-driven decision-making 15% cost savings in data management and maintenance

Gen AI on Databricks Intelligence Platform ‹#›

Data democratized to every employee Gen AI democratized in every product + Make Gen AI Your Playground North America Australia Canada India Dubai Japan UK Singapore Malaysia Celebal's global presence serving 200+ customers around the globe  Test Refining the product Ideate Generating your Ideas Empathize Understanding people Prototype Creation and experimentation Define Figuring out the problem Enterprise CELEBAL Industry powered IP & Accelerators

Fault Detection and Diagnostics Predictive Maintenance 24x7 Contracting Smart Grids and Demand Response Energy Policy and Planning Energy Consumption Optimization Carbon Footprint Analysis Real-time Energy Market Analysis Intelligent Energy Trading Algorithms Environmental Impact Assessment Asset Performance Management Energy Reservoir Simulation Well Drilling Optimization Seismic Data Analysis Energy Consumption Forecasting Environmental Impact Assessment Geospatial Data Analysis Equipment Health Monitoring Production Forecasting Fraud Detection Oil Price Prediction Well Log Interpretation Oil & Gas Predictive Analytics for Audience Engagement Automatic Marketing Emails AI-Powered Content Creation Churn Prediction and Customer Retention VA and Chatbots Content Recommendation Systems Real-time News and Trend Analysis Speech-to-Text Transcription Services Accelerating Pre-Publication Work Contact Centre Analysis Communication Media & Telecom Trade Finance Credit Risk Modeling Anti-Money Laundering (AML) Know Your Customer (KYC) Email and Legal Reports Automation Financial Data Augmentation LC/BG Process Assessment Market Analysis and Investment Research Sentiment Analysis Document Process Automation Cross-Business Unit Information Gathering Financial Services BOM Explosion EHS Copilot Knowledge Discovery Bot Warranty and Product Performance Analysis Quality Control and Inspection Fault Detection and Diagnostics Predictive Maintenance Design Evaluation Remote Worker Assistance  Manufacturing Virtual Shopping Assistants Inventory Replenishment by Shoppers Search Feedback Analysis and Insights Generation Customer Service Chatbot Real Time Hyper- personalization Content Generation for Marketing Product Recommendations Advertising and Campaigns Brand Management Internal Communications Automatic Product Descriptions Retail & CPG Generative AI – Use Cases for every industry

Democratize LLM model for real-life use Gen AI Co-Pilot AI Extension Low Code No Code Mosaic ML: Simplified, Scalable and cost-effective training of Generative Al models Train multi-billion parameters models in hours, not days Scalable Train up to 7x faster and cheaper, no code change required Cost effective No vendor lock-in orchestrate across multiple clouds Multi-cloud Complete data privacy and full model ownership Complete Control

SAP Analytics on Databricks ‹#›

SAP Migrations Motions and Celebal’s Accelerators Complex SAP Structures with non-intuitive names Custom ABAP Logic at Extractors / BW Transformations Often Poor Documentation Challenge Rich knowledge-base to interpret / Reveres-Engineer complex SAP Structures, Logic and Data Models Accelerators help bring efficiency of 50-60% depending on the Landscape CT’s Value Prop SAP Schema /Models SAP Business Glossary & Role Based Security SAP BW / ABAP Transformations SAP HANA Views SAP ERP Extractor Enhancements SAP BODS Transformations Data Ingestion Accelerator Pre-built Data Models BW Data Model Decomposer ABAP to PySpark Converter Extractor Knowledge base BODS & HANA Decomposer Unity Catalog Databricks Lakehouse

HANA Calculation Views Decode HANA CV’s for underlying Table, Column, Attribute, Measures, Transformations, etc. Create Views and Transformations on Databricks. HANA View Migration Accelerator

SAP Security Replication to Lakehouse Data Sink Automated Security Replication in Lakehouse Source Company code and Profit Center Information within ERP Lakehouse on Databricks Company and Profit Center Metadata Info Security Schema Create Security policies and add/delete groups based on change Get group metadata to add/delete members Accessing selective data based on auto deployed security policies District Manager Regional Manager Salesperson Country Manager

Thank You

Traditional Enterprise + Modern Cloud Innovation Partnerships Core Pillars Industry Powered Co-Pilot SAP Extend & Innovate Unity Catalog Migration to Data Intelligence Platform Supply Chain Finance Logistics Procurement Azure Intelligent Enterprise Azure IoT S3 Key Partner for Lakehouse Migrations Key Partner for Unity Catalog Implementations 200+ Data Bricks Customers 15+ Petabyte -Data Migrated Multiple Success Stories & Case Studies

Celebal's expertise in Databricks Data Intelligence Platform Your data. Your Al. Your future. Data Science & Gen Al Real-time Analytics ETL & Orchestration Data Warehousing Mosaic AI Delta Live Tables Workflows Databricks SQL Use generative Al to understand the semantics of your data Data Intelligence Engine Develop generative Al applications on your data with full privacy Democratize access to insights for all users Unify your data and governance for lower TCO, faster value Unified security and governance Unity Catalog Unified data storage, management, and sharing Delta Lake

Accelerate your Migrations with CT Visa On Prem SQL Engineer ETL Engineer Cloud SQL Engineer BI Engineer Analytics Engineer

CT Visa ‹#› Representative efficiency gains – actual results will vary 55% Discovery 76% Analysis 55% ETL Code Conversion 80% History Data Migration 45% Analytics Code Conversion 65% SQL Code Conversion 70% BI Refactoring 66% Data Reconciliation 68% Report Reconciliation 46% DevOps ETL Engineer SQL Engineer Devops Engineer BI Engineer Analytics Engineer

Tool powered Migration Methodology Discovery Phase Assessment & Planning Data Migration Data Reconciliation Code Migration   Unit Testing Data Validation  Performance Tuning Deployment Post Migration Support Evaluation of current SAS Environment. Identify the scope of migration. SAS Code and Data Assessment. Infra and networking Setup. Resources planning. Extract Data from various data sources to Databricks. Determine the optimal data ingestion methodology Ensure that the Data Quality & Integrity are maintained. Data Completeness. Data Readiness. Migrate SAS code to the Equivalent Apache Spark. Migrate all workflows. Preserve Business logic & Document it. Develop test cases. Syntax & Logical error. Code Quality & Correctness. Validate Migrated Code & Data against original SAS Environment. Compare results by SAS and Databricks. Code performance Optimization. Business Logic fine Tuning. Go-Live with Databricks. Ensuring Stability and performance. Ongoing Support & Maintenance. CR management. Optimize and refine the solution. 60% Less Time 25% Less Time 50% Less Time 35% Less Time

Industry Data Models on Lakehouse Manufacturing Shop Floor to Top Floor Insights Smart Manufacturing for Real-time Decision & Execution Supply Chain Analytics Inventory Forecasting, Optimization and Replenishment Demand Forecasting Financial Planning Analytics Predictive Maintenance Analytics FSI Customer 360 Customer Analytics Financial Modeling Risk & Fraud, Threat Detection Credit Analytics Marketing Analytics Regulatory Compliance Claims Automation Retail/CPG Omnichannel Optimization Hyper Personalization In-Store Optimization Supply Chain Optimization Shopper Affinity Customer Segmentation Safety Stock Analysis Health Care Genomics &Precision  Medicine Clinical & Claims Data IoT Device Analytics Medical Image Deep Learning Predictive Analytics for Early Disease Detection Social Analytics Patient Engagement and Experience Media & Entertainment Customer Churn Prevention Audience Insights Content Personalization Recommendation Engine Performance Measurement Predictive Analytics Sentiment Analytics

Accelerated Data Governance with Unity Catalog ‹#›

Migration Approach: Why Celebal Technologies? Implementation State Proposal State Requirement Gathering & Inventory Analysis Pre-Migration Assessment Pre-Scoping Questionnaire Creation of SOW Overview of Current Architecture Key Challenges and Consideration Unity catalog Assets Setup Data and Asset Migration User Group Upgradation Testing & Validation Logical naming and hierarchies of catalogs and schemas  Cluster and Workspace Binding Storage Credentials Creation Migrate all Managed and External Tables using Utility Migrate Notebooks and Jobs using utility Migrate ACL Post the creation of tables and other assets. Create a User and Group Mapping . Migrate the workspace local groups to account groups if they already exists. Create account level groups based on requirements. Detailed Inventory Creation Access Control and Governance Planning Best Practices for Effective Migration Post Migration State Post Migration Support Supporting any changes post migration.  Closely monitoring the jobs for any failures. Continuous process monitoring and optimization suggestions KT & Handover Knowledge transfer and project handover upon completion. Sprint Wise Planning Migration Progress Monitoring Testing the migrated assets using Validation utility Sharing the Report with client and taking sign off Validate access control integrity post migration Celebal Unity Launcher Custom CT Offerings: Empowering Databricks with Customized and Automated Data Migration with Multiple Pre-build frameworks.

Migration: Hive/ Apache Ranger/Glue Migration to Unity Catalog SCIM Hive Migration UC Metastore and Managed/External Tables Centralized Identity and access management Automated Lineage UC Security Model Secure Delta Sharing Discovery Tags Data Assets and Metadata Access control and permission management Data Lineage Security Policies Data Sharing Data Classification and Tags Apache Ranger Migration Apache Ranger Catalog Policies Apache Ranger Table Level Access Control Apache Ranger Schema level Access Control Table’s PII Masking UC Catalog Policies UC Table Level Grants UC Schema level Grants Table’s PII Masking in UC

Impacts of our Pre-Built Frameworks 30% reduction in security incidents 40% increase in data retrieval 20% higher accuracy in risk assessments 50% faster data-driven decision-making 15% cost savings in data management and maintenance

Gen AI on Databricks Intelligence Platform ‹#›

Data democratized to every employee Gen AI democratized in every product + Make Gen AI Your Playground North America Australia Canada India Dubai Japan UK Singapore Malaysia Celebal's global presence serving 200+ customers around the globe  Test Refining the product Ideate Generating your Ideas Empathize Understanding people Prototype Creation and experimentation Define Figuring out the problem Enterprise CELEBAL Industry powered IP & Accelerators

Fault Detection and Diagnostics Predictive Maintenance 24x7 Contracting Smart Grids and Demand Response Energy Policy and Planning Energy Consumption Optimization Carbon Footprint Analysis Real-time Energy Market Analysis Intelligent Energy Trading Algorithms Environmental Impact Assessment Asset Performance Management Energy Reservoir Simulation Well Drilling Optimization Seismic Data Analysis Energy Consumption Forecasting Environmental Impact Assessment Geospatial Data Analysis Equipment Health Monitoring Production Forecasting Fraud Detection Oil Price Prediction Well Log Interpretation Oil & Gas Predictive Analytics for Audience Engagement Automatic Marketing Emails AI-Powered Content Creation Churn Prediction and Customer Retention VA and Chatbots Content Recommendation Systems Real-time News and Trend Analysis Speech-to-Text Transcription Services Accelerating Pre-Publication Work Contact Centre Analysis Communication Media & Telecom Trade Finance Credit Risk Modeling Anti-Money Laundering (AML) Know Your Customer (KYC) Email and Legal Reports Automation Financial Data Augmentation LC/BG Process Assessment Market Analysis and Investment Research Sentiment Analysis Document Process Automation Cross-Business Unit Information Gathering Financial Services BOM Explosion EHS Copilot Knowledge Discovery Bot Warranty and Product Performance Analysis Quality Control and Inspection Fault Detection and Diagnostics Predictive Maintenance Design Evaluation Remote Worker Assistance  Manufacturing Virtual Shopping Assistants Inventory Replenishment by Shoppers Search Feedback Analysis and Insights Generation Customer Service Chatbot Real Time Hyper- personalization Content Generation for Marketing Product Recommendations Advertising and Campaigns Brand Management Internal Communications Automatic Product Descriptions Retail & CPG Generative AI – Use Cases for every industry

Democratize LLM model for real-life use Gen AI Co-Pilot AI Extension Low Code No Code Mosaic ML: Simplified, Scalable and cost-effective training of Generative Al models Train multi-billion parameters models in hours, not days Scalable Train up to 7x faster and cheaper, no code change required Cost effective No vendor lock-in orchestrate across multiple clouds Multi-cloud Complete data privacy and full model ownership Complete Control

SAP Analytics on Databricks ‹#›

SAP Migrations Motions and Celebal’s Accelerators Complex SAP Structures with non-intuitive names Custom ABAP Logic at Extractors / BW Transformations Often Poor Documentation Challenge Rich knowledge-base to interpret / Reveres-Engineer complex SAP Structures, Logic and Data Models Accelerators help bring efficiency of 50-60% depending on the Landscape CT’s Value Prop SAP Schema /Models SAP Business Glossary & Role Based Security SAP BW / ABAP Transformations SAP HANA Views SAP ERP Extractor Enhancements SAP BODS Transformations Data Ingestion Accelerator Pre-built Data Models BW Data Model Decomposer ABAP to PySpark Converter Extractor Knowledge base BODS & HANA Decomposer Unity Catalog Databricks Lakehouse

HANA Calculation Views Decode HANA CV’s for underlying Table, Column, Attribute, Measures, Transformations, etc. Create Views and Transformations on Databricks. HANA View Migration Accelerator

SAP Security Replication to Lakehouse Data Sink Automated Security Replication in Lakehouse Source Company code and Profit Center Information within ERP Lakehouse on Databricks Company and Profit Center Metadata Info Security Schema Create Security policies and add/delete groups based on change Get group metadata to add/delete members Accessing selective data based on auto deployed security policies District Manager Regional Manager Salesperson Country Manager

Thank You