IBM TotalStorage IP 200512 sanomasa@jp.ibm.com 1 SANIPSAN 2 1
3 4 2
CPU 5 FDDHDD 2 3 6 3
OS i-node 7 HDD RAID RAID HDD HDD RAID HBA HDD HDD HDD HDD HDD HDD RAID HBAHost Bus Adapter: HDD HDD 8 4
RAID 2 SCSI LUN HBA RAID HDD HDD 9 HDD 10 5
HDDHard Disk Drive 11 FBACKD 2 FBA () => Block Block Block CKD IBM 3380 IBM 3390 Count Key Data(Block) 12 6
HDDCHS Cylinder/Head/SectorC/H/S CylinderHead Sector3 HDD 11 () HDD HDD512 Block Block 13 HDDLBA Logical Block AddressingLBA LBA IDE28Big Drive48 SCSI32 IDEBIOS CHS LBA(128GB) 8 2 3 Block Block Block 4 5 6 Block Block Block 7 8 9 Block Block Block 0 1 2 Block Block Block 14 7
1 CHS 816 20%50% CHS Block Block Block Block Block Block 15 HGST Ultrastar 146Z10 16 8
HDD HDD B1 B2 Bn HDD SCSI B1 B2 Bn & HDD HDDHDD 17 HDD 18 9
HDD LBAIDE HDDSCSI HDD HDD 19 HDD1 E-IDE ATAEnhanced Integrated Drive Electronics Western DigitalIDEATAIDE2 224CD-ROM E-IDE IDE528MB8.4GB ANSIATA-2 ATAPI SCSISmall Computer System Interface ANSIShugart Seagate TechnologySASI SCSI-2SCSI-3 20 10
HDD2 FCP Fibre Channel Protocol: SCSI over Fibre Channel Fibre ChannelSCSI& SCSI-3 MB/s SAN SSA : Serial Storage Architecture IBMSCSI SCSI-3160MB/s 25m96 (STP) 2.5km Fibre Channel IBM TotalStorage Enterprise Storage Server (ESS) IBM TotalStorage 7133 21 HDD3 Serial ATA IDE(ATA) 200011Serial ATA Working Group Serial ATAUltra ATAATA ATA ATAUltra ATA/133133MB/s Serial ATAUltra SATA/15001.5Gbps1.4 Serial ATA23Gbps6Gbps 22 11
2 2 147.8GB=137.6GB HDD 1K=1,000 OS 1k=1,024= 2 10 G=1,024 3 =(2 10 ) 3 =2 30 23 KMG K=1,024=2 10 HDDK=1,000 K () M () LAN 1,024 2 10 1,048,576 (2 10 ) 2 =2 20 HDD 10G () 1,073,741,824 (2 10 ) 3 =2 30 1,000 10 3 1,000,000 (10 3 ) 2 =10 6 1,000,000,000 (10 3 ) 3 =10 9 3.5 1.44MB M=1,024,000=1,0241,000=2 10 10 3 24 12
25 HDD HDD HDD () RAID // LUN 26 13
IOPS : Input Output per Second 1/ RAIDHDD MB/s, GB/s 1MB(GB)/ HDDHDD RAID HDD 27 HDD HDD SCSI 28 14
SCSI iscsi ESCON FICON SCSI SSA ATA Serial ATA 29 SCSI25m 10km 100km IP SCSI15 FC-AL127 1600 SCSI FC-AL FCP 30 15
2 A B 2FC-AL 31 2FC-AL 2 GBIC IBM EXP700 GBIC ESM Board ESM Board GBIC GBIC (Fibre Link) D R I V E D R I V E D R I V E D R I V E A B (Fibre Link) D R I V E D R I V E D R I V E D R I V E D R I V E D R I V E 32 16
HDD Read only cache (Read/Write cache) HDD 33 1 3 A B A B Write data 2 Write data copy AB AB AB AB 4 34 17
12ms 1020ms 1ms10ms 80 1ms 80 10ms 20 2.8ms 35 A A B B HBA HBA HBA HBA 36 18
/LUN RAIDRAID Array HDD Hot Spare Drive Logical Drive/LUN: Logical Unit Number RAID OS1 37 LUN LUN-V LUN-W LUN-X LUN-Y LUN-Z LUN "V" LUN "W" 3+P RAID-5 LUN "X" RAID-0 LUN "Y" LUN "Z" 2+2 RAID-10 RAIDLUN 38 19
(LUN) SCSI 3 39 3 40 20
41 (1) (4) (1) (2) (3) (4) (2) (3) 42 21
IBM DS8000 Metro Mirror 103Km 103KmRPQ DWDM DWDM 103K IBM DS8000 Global Mirror DWDM DWDM DWDM DWDM 43 RAID 44 22
RAID RAID=Redundant Array of Independent Disks Redundant Array of Inexpensive Disks HDD Independent HDD HDD HDD HDDHDD HDD1HDD HDD 45 RAID RAID0RAID56 RAID 0 RAID 1 RAID 2 ECC RAID 3 + RAID 4 + RAID 5 + RAID 10, RAID 1+0 RAID 1 RAID 0 RAID0 RAID RAID1 RAID3 RAID5 46 23
RAID 0 HDD HDD HDD HDD 1HDDHDD HDD1HDD RAIDRAID 1 2 3 4 5 6 1 1 5 9 13 2 6 10 14 3 7 11 15 4 8 12 16 A B 47 RAID 1 2HDD 11 2HDD 1 2 2 1 2 3 4 1 2 3 4 1 2 3 4 1 48 24
RAID 1E RAID 13 1HDDHDD RAID150% 1 2 1 2 3 1 2 3 4 1 2 3 4 1 3 4 6 2 1 5 4 3 2 6 5 RAID1: RAID1E: 3 49 RAID 10 RAID10 RAID 1RAID 0 RAID 150% RAID 10 : 6 RAID A A1 B4 C7 A2 B5 C8 A3 B6 C9 A1 B4 C7 A2 B5 C8 A3 B6 C9 B C 50 25
RAID 2 ECC RAID 1 5 9 13 2 6 10 14 3 7 11 15 4 8 12 16 ECC ECC ECC ECC ECC ECC ECC ECC ECC ECC ECC ECC 51 HDD-1 HDD-2 Parity x y x XOR y 00110000 00000011 00110011 0 0 0 1 0 1 1 0 1 1 1 0 HDD-2 HDD-2? HDD-1 HDD-1 00110000 00110000 (0x30) (0x30) XOR XOR HDD-2 HDD-2 00000011 00000011 (0x03) (0x03) -------------------------------------------------------------------- -------------------------------------------------------------------- 00110011 00110011 (0x33) (0x33) HDD-1 HDD-1 00110000 00110000 (0x30) (0x30) XOR XOR 00110011 00110011 (0x33) (0x33) -------------------------------------------------------------------- -------------------------------------------------------------------- HDD-2 HDD-2 00000011 00000011 (0x03) (0x03) 52 26
RAID 3 1 10 1 1 2 3 4 RAID-3 1=1 RAID 1 4 7 10 2 5 8 11 3 6 9 12 P P P P P 53 RAID 4 RAID 3 1 2 3 RAID 1 4 7 10 2 5 8 11 3 6 9 12 P P P P P 54 27
RAID 5 RAID 4 RAID 1 3HDD 1 RAID5 RAID5 P 4 7 10 1 P 8 11 2 5 P 12 3 6 9 P P 55 RAID 80% 10%10% RAID RAID 0 100% RAID 1 50% RAID 1E 50% RAID 3 67% - 94% RAID 5 67% - 94% 56 28
HDD HDD HDD IDE SCSI FC 57 RAID RAID1RAID5HDDHDD HDD HDDRebuild RAID1 1 0 1 0 1 0 0 1 0 RAID5 HDDParity 58 29
HDDHDD RAID 0 3RAID51 2 P 3 5 P 1 P 6 7 2 4 P 8 P 3 5 P 2 4 P 8 1 P 6 7 P HDD 59 RAID RAID Windows 2000 ServerRAID1 RAID5 RAID RAIDRAID OSSCSI RAIDRAID SAN RAID 60 30
RAID Windows 2000 Windows NTFS RAID 61 RAID RAID PCIRAID RAID RAID SCSI 62 31
63 /root /user#1 /user#2 /user#3 i-node 64 32
/root /user#1 /user#2 /user#3 65 I/O 66 33
SCSI 67 SCSI (Small Computer System Interface) SCSI HDD HDDCDDVD 8+1 SCSI ID MSB DB(7) / SCSI ID=7 DB(6) / SCSI ID=6 DB(5) / SCSI ID=5 ANSI NCITSX3 T10 DB(4) / SCSI ID=4 SCSI-2 : ANSI X3.131-1994 DB(3) / SCSI ID=3 SCSI-3 : ANSI X3.270-1996 DB(2) / SCSI ID=2 DB(1) / SCSI ID=1 DB(0) / SCSI ID=0 LSB DB(P) : 68 34
SCSI (HBA) HDD 1:1 SCSI 15 69 SCSI (F) (A) (SEL) (Read/Write) 70 35
SCSI 71 SCSI SCSI + : (Logical UnitLUN) : 8/ 8/ SCSI 72 36
LUNLogical Unit Number) LUN LUNSCSI HDD LUNOS 9601564 LUN SCSI 1/0 1/1 2/0 2/1 15/0 15/1 64 LUN 1/63 2/63 15/63 15 73 SCSISCSI-2 SCSI SCSI-1 1994(ANSI) 2 Fast SCSI(Fast Narrow SCSI) 8 10MB/s 8 Fast Wide SCSI 16 20MB/s 16 3m12m(LVD) 25m(HVD) SCSI-2 74 37
75 76 38
2 77 SCSISCSI-3 SCSI SCSI-2 SCSI(SCSI) Ultra SCSIFibre ChannelSSAIEEE 1394 SCSI SCSI-3 (SCSI-3 Primary Command : SPC) 78 39
SCSI-3 Ultra SCSI Ultra SCSI 820MB/s Wide Ultra SCSI 1640MB/s 8 1.5m43m Ultra2 SCSI Ultra2 SCSIWide Ultra2 SCSI 40MB/s80MB/s 12m(LVD)25m(HVD) Ultra3 SCSI 160MB/sUltra3 SCSI(Ultra160 SCSI)320MB/s Ultra320 SCSI 79 SCSILVDHVD SCSI HVD (High Voltage Differential) LVD (Low Voltage Differential) SE (Single-Ended) SCSI 40MB/sec 80MB/sec 2 5V 2 3.3V 1 SCSILVD/SEHVD SCSI /68 HD68 High Density 68 pin SCSI 0.8mm VHDCI 80 40
SCSI HVD Point-to-point 25m 25m LVD Point-to-point 25m 12m 0 12m 25m 81 SCSI P (68) Q (68) SCSI ID Fast Ultra Ultra2 Ultra3 Narrow - 8 1.5MB/s 5MB/s 10MB/s 20MB/s 40MB/s 80MB/s Wide - 16-10MB/s 20MB/s 40MB/s 80MB/s 160MB/s 82 41
SCSI over Fibre Channel 83 SCSI SCSI 1 (DAS) SCSI-3 SCSI Fibre Channel 200 MB/s 10 km 2 24 SAN 84 42
Fibre Channel 2 (: SCSI, FICON, HIPPI, IP, IPI-3, ATM, ) FCPSCSISCSI SCSI FCP 85 FCP SAN 100-200MB/sec 200-400MB/sec 10km 30m 500m 10km 100 Km Point-to-point Arbitrated Loop FC-AL127 1600 SCSI 86 43
FC-0 FC-4 FC-3 FC-2 FC-1 FC-0 / / 1Gbps 1.0625Gb/s 2Gbps 2.125Gb/s 10Gbps 87 a ba b 88 44
SMF 10m1 1 LX MMF 50m 62.5m LEDSX 250m 125m 9m 250m 125m 50m 65m 89 SC Gigabit EthernetFibre Channel IEC 60874-14 11 TXRX2 LC Gigabit EthernetFibre Channel PUSH/PULL MT-RJ Gigabit Ethernet PUSH/PULL 21 90 45
FC-1 FC-4 FC-3 FC-2 FC-1 FC-0 / / 8b/10b 10 1Gbps100MB/s 2Bbps200MB/s 91 FC-2 2112 FC-4 FC-3 FC-2 / FC-1 / FC-0 92 46
SOF SOF 4 4 2112 2112 24 64 64 2048 2048 CRC CRC 4 4 EOF EOF 4 4 Word 0 1 2 3 4 5 Bits 31-24 Bits 23-16 ID Originator Exchange ID Bits 15-8 Bits 7-0 Destination ID (Address) Source ID (Address) Responder Exchange ID SOF Start Of Frame EOF End Of Frame 93 3 1 ACK 2 3 SAN 94 47
FC-3 FC-4 FC-3 FC-2 / FC-1 / FC-0 95 Fibre Channel ULP SCSIIPHIPPIIPI-3ATMULPUpper Level Protocol FC-4 FC-3 SCSI-FCP SCSI FC-2 / FC-1 / FC-0 96 48
Fibre Channel3 Point to Point Arbitrated Loop Switched Fabric 97 Point to Point Point-to-point Full Duplex 100 MB/s Disk 200 MB/sec (100MB/sec x 2) 100 MB/s Server 100 MB/s 100 MB/s 98 49
FC-ALFibre Channel Arbitrated Loop 127 1 1 8AL_PAArbitrated Loop Physical Address 2 HUB AL_PA 2HUB Managed HUB Unmanaged HUB 1 99 Fibre Channel Switched Fabric 100-200 MB/sec 1600 10km Fabric 100 50
FC F-port HBA E-port N-port HBA NL-port HBA FL-port N N N N F F F F FC E E FC F F F FL N N N NL NL 101 Fibre Channel HBA HBAHost Bus Adapter PCIPCI-X OS OSSCSI CPU 1 HBAHBAHBA QLogic QLA2300 64bit 66/133MHz PCI-X32/64bit 33/66MHz PCI 400MB/s(Full Duplex) 1Gb/2Gb FC-AL/Point-to-Point/ FLF 102 51
/WDM 10km WDMWavelength Division Multiplexing WDM WDM SONET ADM SONET ADM MUX & DEMUX MUX & DEMUX 103 CWDMDWDM 0.8nm DWDM = Dense Wavelength Division Multiplexing 20nm CWDM = Coarse Wavelength Division Multiplexing / / / CWDM 416416Gbps (1060nm) 1050km DWDM 641281Tbps (0.8nm) 100km 104 52
105 1 106 53
LTO Linier Tape Open Seagate HP IBM LTO-G1LTO-G22 DLT / Super DLT LTO Quantam DLT Super DLT AIT, PetaSite 4mm/8 DATQIC 107 (Herical Scan) Start/Stop 8mm, 4mm DAT DTF AIT PetaSite (Longitudinal) Start/Stop DLT IBM 3480 IBM 3490 IBM 3590 IBM 3592 TS1120 LTO 108 54
8mm4mmDAT Read B Write B Write A Read A 8mm 4-5 109 LTO Write heads Read(verify) heads Write heads 110 55
1 2 3 116 IBM 3480 18200MB/ IBM 3590-E 256 30GB/ IBM LTO Ultrium 384100GB/ IBM LTO Ultrium 2 512200GB/ IBM LTO Ultrium 3 704400GB/ 111 LTO Surface Control Guiding LTO Edge Guiding LTO / 112 56
IBM 113 SCSI LVD IASCSI SCSI HVD UNIXSCSI SAN 114 57
115 58