Unit I 1.1 - 1.4.pptx Storage Technologies

Storage Technologies

1. CCS367 STORAGE TECHNOLOGIES UNIT I DEPARTMENT: CSE SEMESTER : 06 Prepared by Elavarasi D. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1

2. Course Outcome CO1: Demonstrate the fundamentals of information storage management and various models of Cloud infrastructure services and deployment – K2 CO2: Illustrate the usage of advanced intelligent storage systems and RAID – K2 CO3: Interpret various storage networking architectures - SAN, including storage subsystems – K3 MZCET/CSE/VI/A&B/CCS367/ST/I/1.6 2

3. Course Outcome CO4: Understand various storage networking architectures in virtualization – K2 CO5: Examine the different role in providing disaster recovery and remote replication technologies - K2 CO6: Infer the security needs and security measures to be employed in information storage management-K2 MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 3

4. Previous Class & Todays Session Prerequisite Database Network Computer Architecture MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 4

5. Previous Class & Todays Session Todays Session 1.1 Introduction to Information Storage: Digital data and its types 1.2 Information storage 1.3 Key characteristics of data center 1.4 Evolution of computing platforms MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 5

6. UNIT III STORAGE SYSTEMS 1.1 Introduction to Information Storage: Digital data and its types 1.2 Information storage 1.3 Key characteristics of data center 1.4 Evolution of computing platforms 1.5 Information Lifecycle Management . MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 6

7. UNIT III STORAGE SYSTEMS 1.6 Third Platform Technologies: Cloud computing and its essential characteristics 1.7 Cloud services and cloud deployment models 1.8 Big data analytics 1.9 Social networking and mobile computing MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 7 7

8. UNIT III STORAGE SYSTEMS 1.10 Characteristics of third platform infrastructure and Imperatives for third platform transformation 1.11 Data Center Environment: Building blocks of a data center 1.12 Compute systems and compute virtualization and Software-defined MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 8

9. 1.1 Introduction to Information Storage: Digital data and its types Why Information Storage • “Digital universe – The Information Explosion” • 21st Century is information era • Information is being created at ever increasing rate • Information has become critical for success • We live in an on-command, on-demand world • Example: Social networking sites, e-mails, video and photo sharing website, online shopping, search engines etc MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 9

10. 1.1 Introduction to Information Storage: Digital data and its types Nearly a quarter of the world's population – roughly 1.4 billion people – will use the Internet on a regular basis in 2009. 50 billion photos taken every year Online Video 4,700,000,000 video streams monthly England has approximately 4 million surveillance cameras  1 for approximately every 14 Britons MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 10

11. 1.1 Introduction to Information Storage: Digital data and its types Storage requirements: Facebook  10,000,000,000 photos 2-3 Terabytes of photos are being uploaded to the site every day One petabyte of photo storage Serve over 15 billion photo images per day Photo traffic now peaks at over 300,000 images served per second People Needs  Work wherever, whenever, and with whatever MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 11

12. 1.1 Introduction to Information Storage: Digital data and its types Context  RIGHT Information RIGHT Time RIGHT Place Community  Maximize constituents with common interest Collaborate without boundaries Embrace culture of open innovation Going external (future) >100+ communities>no knowledgeable outsourcers MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 12

13. 1.1 Introduction to Information Storage: Digital data and its types Compliance   • Web 2.0 without risk • Manage all content types across platform • Tools for proactive/reactive discovery • Discovery/management without disrupting end-users Leverage   Optimize Protect Store Information management is a big challenge MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 13

14. 1.1 Introduction to Information Storage: Digital data and its types A Vocabulary for Measuring Information If a Grain of Sand were One Byte of Information . . . 1 Megabyte = 1 million bytes a tablespoon of sand 1 Gigabyte = 1 billion bytes patch of sand—9” square, 1’ deep 1 Terabyte = 1 trillion bytes a sandbox—24’ square, 1’ deep 1 Petabyte = 1,000 tera bytes a mile long beach—100’ wide , 1’ deep MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 14

15. 1.1 Introduction to Information Storage: Digital data and its types 1 Exabyte =1,000 petabytes the same beach 1 Zetabyte =1,000 exabytes the same beach 1 Yottabyte =1,000 zetabytes MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 15

16. 1.1 Introduction to Information Storage: Digital data and its types Data Creation Growth Projections Year Data Generated Change Over Previous Year (%) 2022* 97 zettabytes ↑ 22.78% 2023* 120 zettabytes ↑ 23.71% 2024* 147 zettabytes ↑ 22.5% 2025* 181 zettabytes ↑ 23.13% MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 16

17. 1.1 Introduction to Information Storage: Digital data and its types Data is a collection of raw facts from which conclusions may be drawn. Handwritten letters, a printed book, a family photograph, a movie on video tape, printed and duly signed copies of mortgage papers, a bank’s ledgers, and an account holder’s passbooks are all examples of data. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 17

18. 1.1 Introduction to Information Storage: Digital data and its types Before the advent of computers, the procedures and methods adopted for data creation and sharing were limited to fewer forms, such as paper and film. Today, the same data can be converted into more convenient forms such as an e-mail message, an e-book, a bitmapped image, or a digital movie . This data can be generated using a computer and stored in strings of 0s and 1s MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 18

19. 1.1 Introduction to Information Storage: Digital data and its types Data in this form is called digital data and is accessible by the user only after it is processed by a computer. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 19

20. 1.1 Introduction to Information Storage: Digital data and its types Factors that have contributed to the growth of digital data: Increase in data processing capabilities: - conversion of various types of content and media from conventional forms to digital formats. Lower cost of digital storage: Technological advances and decrease in the cost of storage devices have provided low-cost solutions MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 20

21. 1.1 Introduction to Information Storage: Digital data and its types Affordable and faster communication technology: The rate of sharing digital data is now much faster than traditional approaches. Inexpensive and easier ways to create, collect, and store all types of data , coupled with increasing individual and business needs, have led to accelerated data growth, popularly termed the data explosion. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 21

22. 1.1 Introduction to Information Storage: Digital data and its types Types of Data Data can be classified as structured or unstructured based on how it is stored and managed. Structured data is organized in rows and columns in a rigidly defined format so that applications can retrieve and process it efficiently. Structured data is typically stored using a database management system ( DBMS ) MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 22

23. 1.1 Introduction to Information Storage: Digital data and its types Data is unstructured if its elements cannot be stored in rows and columns, and is therefore difficult to query and retrieve by business applications Eg : customer contacts may be stored in various forms such as sticky notes, e-mail messages, business cards, or even digital format files such as .doc, .txt, and .pdf. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 23

24. 1.1 Introduction to Information Storage: Digital data and its types Due its unstructured nature, it is difficult to retrieve using a customer relationship management application. Unstructured data may not have the required components to identify itself uniquely for any type of processing or interpretation. MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 24

25. 1.2 Information and Storage Businesses are primarily concerned with managing unstructured data because over 80 percent of enterprise data is unstructured and requires significant storage space and effort to manage MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 25

26. 1.2 Information and Storage Information Data, whether structured or unstructured, does not fulfill any purpose for individuals or businesses unless it is presented in a meaningful form. Businesses need to analyze data for it to be of value. Information is the intelligence and knowledge derived from data. MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 26

27. 1.2 Information and Storage Information For example, a retailer identifies customers’ preferred products and brand names by analyzing their purchase patterns and maintaining an inventory of those products new business opportunities MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 27

28. 1.2 Information and Storage Information Job portal is an example job seekers post their resumes websites collect the résumés and post them on centrally accessible locations for prospective employers companies post available positions on job search sites. Job-matching software matches keywords from resume MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 28

29. 1.2 Information and Storage MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 29

30. 1.2 Information and Storage Storage Data created by individuals or businesses must be stored so that it is easily accessible for further processing . In a computing environment, devices designed for storing data are termed storage devices or simply storage . MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 30

31. 1.2 Information and Storage Storage The type of storage used varies based on the type of data and the rate at which it is created and used . Devices such as memory in a cell phone or digital camera, DVDs, CD-ROM s, and hard disks in personal computers are examples of storage devices. Businesses options - available for storing data - internal hard disks, external disk arrays and tapes MZCET/CSE/VI/A&B/CCS367/ST/I/1.2 31

32. 1.3 Key characteristics of data center MZCET/CSE/VI/A&B/CCS367/ST/I/1.3 32

33. 1.3 Key characteristics of data center Availability: All data center elements should be designed to ensure accessibility. Security: Polices, procedures, and proper integration of the data center core elements that will prevent unauthorized access to information must be established. Scalability: Data center operations should be able to allocate additional processing capabilities or storage on demand, without interrupting business operations MZCET/CSE/VI/A&B/CCS367/ST/I/1.3 33

34. 1.3 Key characteristics of data center Performance: All the core elements of the data center should be able to provide optimal performance and service all processing requests at high speed. Data integrity: Data integrity refers to mechanisms such as error correction codes or parity bits which ensure that data is written to disk exactly as it was received. MZCET/CSE/VI/A&B/CCS367/ST/I/1.3 34

35. 1.3 Key characteristics of data center Capacity: Data center operations require adequate resources to store and process large amounts of data efficiently. When capacity requirements increase, the data center must be able to provide additional capacity without interrupting availability , or, at the very least, with minimal disruption MZCET/CSE/VI/A&B/CCS367/ST/I/1.3 35

36. 1.3 Key characteristics of data center Manageability: A data center should perform all operations and activities in the most efficient manner. Manageability can be achieved through automation and the reduction of human (manual) intervention in common tasks. MZCET/CSE/VI/A&B/CCS367/ST/I/1.3 36

37. 1.4 Evolution of computing platforms The evolution of open systems and the affordability and ease of deployment that they offer made it possible for business units/departments to have their own servers and storage . storage technology evolved from non-intelligent internal storage to intelligent networked storage MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 37

38. 1.4 Evolution of computing platforms Redundant Array of Independent Disks (RAID): This technology was developed to address the cost, performance, and availability requirements of data . It continues to evolve today and is used in all storage architectures such as DAS, SAN, and so on. of limited internal storage capacity. MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 38

39. 1.4 Evolution of computing platforms Direct-attached storage (DAS): This type of storage connects directly to a server (host) or a group of servers in a cluster. Storage can be either internal or external to the server. External DAS alleviated the challenges of limited internal storage capacity. MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 39

40. 1.4 Evolution of computing platforms Storage area network (SAN): This is a dedicated, high-performance Fiber Channel (FC) network to facilitate block-level communication between servers and storage . Storage is partitioned and assigned to a server for accessing its data. SAN offers scalability, availability, performance, and cost benefits compared to DAS. MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 40

41. 1.4 Evolution of computing platforms Network-attached storage (NAS): This is dedicated storage for file serving applications. Unlike a SAN, it connects to an existing communication network (LAN) and provides file access to heterogeneous clients . Because it is purposely built for providing storage to file server applications, it offers higher scalability, availability, performance, and cost benefits compared to general purpose file servers. MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 41

42. 1.4 Evolution of computing platforms Internet Protocol SAN (IP-SAN): One of the latest evolutions in storage architecture, IP-SAN is a convergence of technologies used in SAN and NAS . IP-SAN provides block-level communication across a local or wide area network (LAN or WAN), resulting in greater consolidation and availability of data. MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 42

43. 1.4 Evolution of computing platforms MZCET/CSE/VI/A&B/CCS367/ST/I/1.4 43

44. Recall MZCET/CSE/VI/A&B/CCS367/ST/I/1.1 -1.4 1.1 Introduction to Information Storage: Digital data and its types 1.2 Information storage 1.3 Key characteristics of data center 1.4 Evolution of computing platforms 44

45. References MZCET/CSE/VI/A&B/CCS367/ST/I/1.1- 1.4 https://www.youtube.com/watch?v=Qnk2FP3_r-I https://www.youtube.com/watch?v=Amow8BJm5Go https://www.youtube.com/watch?v=zt4E9Mbp3c8 45