Demystifying Storage - Building large SANs

Yottabytes and Beyond Demystifying Storage and Building large Storage Networks Part I by Bhavin Turakhia, CEO, Directi bhavin.t@directi.com (shared under Creative Commons Attribution Share-alike License incorporated herein by reference) ( http://creativecommons.org/licenses/by-sa/3.0/ )

Why is storage important? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object]

Introduction to Hard Drives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hard Disk types SATA (Serial ATA) SAS (Serial Attached SCSI) FC (Fibre Channel) Typical Use ,[object Object],[object Object],[object Object],[object Object],[object Object],Performance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Hard drive capacities Typically - 250 GB, 500 GB, 750 GB, 1TB Typically – 73 GB, 146 GB, 300 GB, 400 GB Typically – 73 GB, 146 GB, 300 GB, 400 GB

Hard Disk types SATA (Serial ATA) SAS (Serial Attached SCSI) FC (Fibre Channel) Price per Gig (based on max drive capacity retail web price) $ 0.33 $2 $3 Misc - ,[object Object],[object Object],-

Hard Disk Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Solid State Drives ,[object Object],[object Object],[object Object]

Solid State Drives ,[object Object],[object Object],[object Object],[object Object],Advantages Disadvantages ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Introduction to RAID ,[object Object],[object Object],[object Object],HD1 HD2 HD1 HD2 RAID

Comparison of Single RAID Levels RAID 0 RAID 1 RAID 5 RAID 6 Diagram Description Striping Mirroring Striping with Parity Striping with Dual Parity Minimum Disks 2 2 3 4 Maximum Disks Controller Dependant 2 Controller Dependant Controller Dependant Array Capacity No. of Drives x Drive Capacity Drive Capacity (No. of Drives - 1) x Drive Capacity (No. of Drives - 2) x Drive Capacity

Comparison of Single RAID Levels RAID 0 RAID 1 RAID 5 RAID 6 Storage Efficiency 100% 50% (Num of drives – 1) / Num of drives (Num of drives – 2) / Num of drives Fault Tolerance None 1 Drive failure 1 Drive failure 2 Drive failures High Availability None Good Good Very Good Degradation during rebuild NA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Comparison of Single RAID Levels RAID 0 RAID 1 RAID 5 RAID 6 Random Read Performance Very Good Good Very Good Very Good Random Write Performance Very Good Good (slightly worse than single drive) Fair (Parity overhead) Poor (Dual Parity Overhead) Sequential Read Performance Very Good Fair Good Good Sequential Write Performance Very Good Good Fair Fair Cost Lowest High Moderate Moderate+

Comparison of Single RAID Levels RAID 0 RAID 1 RAID 5 RAID 6 Use Case ,[object Object],[object Object],[object Object],[object Object],Non-write intensive OLTP applications / file servers etc Non-write intensive OLTP applications / file servers etc Misc - - Parity can considerably slow down system Not supported on all RAID cards

Understanding the Parity Penalty ,[object Object],[object Object],[object Object],[object Object],+12124286429 Disk 1 Disk 2 Disk 3 Disk 4 A (01000001) B (01000010) C (01000011) {P – 01000000} Parity {P} D E F G Parity {P} H I J K Parity {P} L

Understanding the Parity Penalty ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Disk 1 Disk 2 Disk 3 Disk 4 A (01000001) B->X (01000010) -> (01011000) C (01000011) {P – 01000000}

Understanding the Parity Penalty ,[object Object],[object Object],[object Object],[object Object],[object Object]

Comparison of Nested RAID Levels RAID 10 RAID 50 Diagram Description Mirroring then Striping Striping with Parity then Striping without parity Minimum Disks Even number > 4 > 6 Maximum Disks Controller Dependant Controller Dependant Array Capacity (Size of Drive) * (Number of Drives ) / 2 (Size of Drive) * (No. of Drives In Each RAID 5 Set - 1) * (No of RAID 5 Sets)

Comparison of Nested RAID Levels RAID 10 RAID 50 Storage Efficiency 50% ((No. of Drives In Each RAID 5 Set - 1) / No. of Drives In Each RAID 5 Set) Fault Tolerance Multiple drive failure as long as 2 drives from same RAID 1 set do not fail Multiple drive failure as long as 2 drives from same RAID 5 set do not fail High Availability Excellent Excellent Degradation during rebuild Minor ,[object Object],[object Object],[object Object]

Comparison of Nested RAID Levels RAID 10 RAID 50 Read Performance Very Good Very Good Write Performance Very Good Good Use Case OLTP / OLAP applications Medium-write intensive OLTP / OLAP applications

Nested RAID Misc Notes ,[object Object],[object Object],[object Object]

RAID Considerations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

RAID Considerations ,[object Object],[object Object],[object Object],[object Object],[object Object]

Passive Disk Enclosure based DAS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Passive Disk Enclosure based DAS ,[object Object],[object Object],[object Object],[object Object],[object Object]

Passive Disk Enclosure based DAS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Active Disk Enclosure based DAS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Active Disk Enclosure based DAS ,[object Object],[object Object],[object Object],[object Object]

Logical Volumes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SAN ,[object Object],[object Object],[object Object],[object Object],[object Object]

SAN ,[object Object],[object Object],[object Object]

SAN ,[object Object],[object Object]

SAN ,[object Object],[object Object],[object Object],[object Object]

Throughput Calculations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[Considerably exaggerated hyperbole given that the combined space of all computers in the world today (2007) doesn’t add up to 1 Yottabyte (2 ^ 80 bytes). Infact the entire worlds storage is projected to hit 988 exabytes (2 ^ 60) by 2010] [6 th Sep 2007 - http://www.networkworld.com/newsletters/stor/2007/0903stor2.html – Nanotech breakthrough could put entire YouTube contents on an iPod-size device]

Part II sneak preview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Shameless HR Propaganda Slide ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],http://careers.directi.com | http://wiki.directi.com | http://cosmos.directi.com Personal Blog: http://bhavin.directi.com Mail: [email_address]

Demystifying Storage - Building large SANs

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Demystifying Storage - Building large SANs

Similar to Demystifying Storage - Building large SANs (20)

More from Directi Group

More from Directi Group (20)

Recently uploaded

Recently uploaded (20)

Demystifying Storage - Building large SANs