IBM存储ppt详细介绍.ppt

存储虚拟化及异构存储管理,金 微J IBM资深存储系统专员,议 题,存储系统的挑战“虚拟存储”的方方面面虚拟控制器SVCSAN文件系统,数据迅速膨胀!,指数级的扩容。一级存储逼近PB级所有信息都在数字化数据访问要求 24/7数据安全保存的时间要求越来越长,存储系统战略,技术,产品,解决方式,Disk,Tape,SAN,NAS,Software,InfrastructureSimplification,BusinessContinuity,ILM,Architecture,Virtualisation,CommonBuilding Blocks,OpenStandards,存储系统功能架构,Orchestration,Storage InfrastructureManagement,HierarchicalStorageManagement,ArchiveManagement,RecoveryManagement,Storage Virtualization,Advanced Replication Services,Hardware Infrastructure,Tape,Disk,Storage Networking,Content Management,存储虚拟化,VE Console,Productivity Center,Virtual Resource Access,Workload&performance managersResource management,modeling,mapping,Virtual Resource Management,Virtual Resources,Resource virtualisersPartitioning,virtual machines,I/O,networks,VTS,IBM Server&Storage Systems,Virtual Planning Tools,System z9zSeries,pSeries,xSeries,BladeCenter,TotalStorage,OpenPower,iSeries,Enterprise Workload Manager,VE Console,IBM Director 5.10,Resource Dependency Service 2.1,IBM TotalStorage Productivity Center,虚拟化的概念,Efficient utilisation of physical resourcesDynamic changes to virtual resources,Horizontal growthInvestment protection,Enhanced functionImproved availability,Non-disruptive maintenanceNon-disruptive upgrades,存储虚拟化的方方面面,DS/TS,StorageSubsystem,SAN VolumeController,SAN FilesystemNAS,StorageNetwork,p5 Hypervisor,AIX,LVM,Server,OperatingSystem,VIOS,p5 虚拟化I/O,POWER5 Hypervisor,文件系统虚拟化,DS/TS,StorageSubsystem,SAN VolumeController,SAN FilesystemNAS,StorageNetwork,p5 Hypervisor,AIX,LVM,Server,OperatingSystem,VIOS,SAN 文件系统,DS,Legacy,WindowsServer,C:,LinuxServer,/filesystem,AIXServer,/filesystem,Storage Network,TotalStorage SAN 文件系统:异构文件共享策略驱动的文件管理灵活性和伸缩性,当前的SAN:本地文件系统，没有共享基于服务器的分散式管理,SAN磁盘卷的虚拟化,DS/TS,StorageSubsystem,SAN VolumeController,SAN FilesystemNAS,StorageNetwork,p5 Hypervisor,AIX,LVM,Server,OperatingSystem,VIOS,SAN Volume Controller SAN 卷控制器,SAN,SVC,VirtualDisk,VirtualDisk,Server,VirtualDisk,Server,VirtualDisk,Continuous Data Replication,SVC 异构存储的灾备,Server,Server,Storage Network,Server,Server,SVC,Storage Network,SVC,Continuous Data Replication,Continuous Data Replication,Site A,Site B,SVC 数据迁移,Storage Network,Server,将SVC植入SAN部署新的存储系统透明的将数据从旧存储迁移到新存储上,存储设备的虚拟化,DS,StorageSubsystem,SAN VolumeController,SAN FilesystemNAS,StorageNetwork,p5 Hypervisor,AIX,LVM,Server,OperatingSystem,VIOS,DS8000 设计目标,支持数据持续化无中断访问确保数据一致性支持广泛的操作系统平台在各种苛刻条件下，保持平衡的高性能(持续传输率和IO响应时间)无中断地性能和容量升级提供本地和远程保持数据完整性的复制功能,DS8000 结构,N-waySMP,N-waySMP,Fault Tolerant Switch Fabric,HostAdapters,HostAdapters,HostAdapters,HostAdapters,HostAdapters,HostAdapters,ReadCache,Write Cache,ReadCache,Write Cache,DeviceAdapters,DeviceAdapters,DS8000 LPAR,DS8300 LPAR,HostAdapters,HostAdapters,HostAdapters,HostAdapters,HostAdapters,HostAdapters,N-waySMP,N-waySMP,Fault Tolerant Switch Fabric,HostAdapters,HostAdapters,HostAdapters,ReadCache,Write Cache,ReadCache,Write Cache,DeviceAdapters,DeviceAdapters,LUN/卷虚拟化,LUN 虚拟扩展LUN 可以在不影响RAID阵列上其他LUN的情况下进行创建和删除LUN可以跨多个RAID阵列进行分配最大的 LUN 可以增加到 2 TBLUN 的大小可以调整(产品正式推出后)CKD 卷扩展64K 柱面卷,扩展池,IBM NAS 的虚拟化:,物理设备池,Disks,Disks,Disks,控制器：虚拟卷,NAS虚拟化提供:隔绝存储物理设备提高资源利用率提供多种连接方式提供多种使用数据的方式,与应用界面:NAS文件、iSCSI 磁盘,IBM 虚拟磁带库TS7510虚拟带库控制器,作用：缩短备份窗口（每秒600MB）提高备份数据的可用性虚拟技术：可扩至46TB的带库缓存虚拟至多128个带库、1024驱动器和8192卷磁带网络远程复制、数据压缩和加密支持开放和主机平台,IBM TotalStorage SAN 卷控制器详解,RAIDcontroller 2,RAID controller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,MD 4,MD 3,MD 2,MD 1,MD 8,MD 7,MD 6,MD 5,物理设备配置的改变直接影响到主机和应用的可用性,Managed disks,SCSI LUNs,SCSI LUNs 仍然沿用 1-to-1 映射方式，它们仍然认为映射到服务器了 但其实是映射到了 SAN Volume Controller的 Managed disk,VD 4,VD 3,VD 2,VD 1,VD 7,VD 6,VD 5,Virtual disks,Hosts 仍然采用映射 LUNs 的方式，仍然仍然以为是物理磁盘 其实是符合应用需要的容量和性能的虚拟磁盘卷,Storage Software,The SVC storage software controls the mapping of Virtual disks to Managed disks,High Perf,Low Cost,Managed disks 集中到 Managed Disk Groups，以分类不同的存储设备,The SAN Volume Controller“隔绝”存储设备改变对服务器的影响,映射选项跨多个Managed disks条带化在一个或多个 Managed disk上顺序存放Image mode 一对一的映射,SANVolume Controller,SVC 4.1 支持平台不断更新中,SAN with 4Gbps fabric,HitachiThunder920095xxV9520V,HPEVA3000/50004000/60008000,IBMDSDS4K/6KDS8000DS4800,HitachiLightning9980V9970V9910/9960,HPMA/EMA80001200016000,EMCSymm8000DMX,EMC/DellCLARiiONFC4700CX2/3/4/5/6/700,MicrosoftMSCSMPIO,VSS,GDSx64,IBMAIXHACMP/XDGPFS/VIO,SunSolaris 10VCS ClusteringSUN Cluster,HP/UX 11iV2TRU64OpenVMSServiceGuardClustering,Linux(Intel/Power/zLinux)RHEL/SUSEW/LVMRHEL AS 4Ia32,x64,System p,IBMBladeCenterWin/Linux/VMWare/AIXOPM/FCS/IBS,SAN,SANVolume Controller,Continuous CopyMetro MirrorGlobal Mirror,VMWareWin/NW guests,Point-in-time CopyFull volumeCopy on write,IBMESS,FAStT,NovellNetWareClustering,Sun9910/99609970/9980,HPXP48,128512,1024,.,1024Hosts,CiscoMcData,iSCSI to hostsVia Cisco IPS,New,New,New Engines,Array-based copy services,New,New,HitachiTagmaStoreUSP,NSC55,IBMN series5200,5500,New,NetAppFAS3020,3050,New,SAN Volume Controller,SAN Volume Controller,RAIDcontroller 2,RAID controller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,TotalStorage SAN 卷控制器数据复制,RAIDcontroller 4,RAID controller 3,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,SAN Metro Mirror“outside the box”,SAN 数据迁移“跨箱子”,SAN 瞬间复制“跨箱子”,SAN Volume Controller,SAN Volume Controller,RAIDcontroller 2,RAID controller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,TotalStorage SAN卷控制器数据复制,RAIDcontroller 4,RAID controller 3,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,跨设备的数据一致性组设定,仍然想保留原有磁盘复制功能？SVC可以,谁是存储性能测试SPC1的性能冠军？,IBM SVC 3.1高据榜首,IBM TotalStorage SAN File SystemDFSMS 在开放环境下的实现,1988年首先在 IBM 大型机上实现 存储系统管理所有数据资产和存储资产通过策略自动管理数据z/OS 操作系统标准功能 知道 DFSMS吗?SAN File System 有类似的功能:可管理性Manageability高效性Efficiency成本控制Cost业务连续性Business Continuity,Metadata store,IP Network,Metadata Server,SAN File System详解,Appl,SFS Client,Storage Area Network,File Open request,MetaData request,MetaData,File Open Response,File Data I/O,Application makes“File Open”request.This is intercepted by SAN File System Client and directed to Metadata server.,Metadata server gets Meta Data(file location,permissions,locks,attributes)stored on system location on SAN,Metadata server verifies available locks and responds to“File Open”request,SAN File System Client verifies security permissions and provides access to file,Metadata Server,User data,VFS/IFS Interface,Application conducts direct I/O with storage device on SAN.Achieves near local file performance,Application is unaware that“File Open”request was processed by the SAN File System Client and Metadata server,DS8000,DS4100S-ATA,IBM TotalStorage SAN 文件系统,SAN,SANFile System,存储池容量池按照业务要求分类可恢复性要求 性能成本其他,IBM TotalStorage SAN 文件系统,SAN,SANFile System,数据生命周期管理策略按照业务要求摆放文件,IBM TotalStorage SAN文件系统,SAN,SANFile System,数据生命周期管理策略Disk-to-disk 分层管理(在存储池之间透明的移动数据)文件过期/删除文件碎片整理(redistributes files across available space),IBM TotalStorage SAN文件系统,SAN,SANFile System,服务器集中简化服务器集中减少服务中断,BackupServer,IBM TotalStorage SAN文件系统,SAN,SANFile System,Bkupagent,Bkupagent,Bkupagent,Bkupagent,更好的效率备份病毒扫描其他?,今天的存储“供给”流程,FileSystem,FileSystem,FileSystem,FileSystem,Database,SAN,DatabaseAdministrator,SystemAdministrator,StorageAdministrator,Check for more spaceon the file system,ContactSystem admin,Observetablespace is full,Check for more spaceon server,ContactStorage admin,Find available LUN(s)If none exist,allocate new ones,Find the best LUN(s)for the application,Assign the LUN(s)to the applicationserver HBA(s),Adjust switchzones,Find availablePoint-in-time andRemote copy target(s),Match source/targetpairs,ContactSystem admin,Inform the server thatnew storageis available,Expand thevolume group,Expand thefile system,ContactDBA,Create a newdatafile,Expand thetablespace,IBM TotalStorage SAN文件系统简化存储供给,Database,SAN,DatabaseAdministrator,SFSAdministrator,Create a newdatafile,Observetablespace is full,Monitor storagepool utilization,Expand thetablespace,SANFile System,FileSystem,FileSystem,FileSystem,FileSystem,Apply quotasif necessary,当今SAN的利用率,每个服务器有自己独立的文件系统而且需要分别配置和管理每个服务器要分配LUN资源管理成堆的 LUNs物理设备可能无法完全共享平均利用率:52%(Industry Average:40%-50%),FileSystem,FileSystem,FileSystem,FileSystem,SAN,200GB Storage115GB Data58%Utilization,50GB Storage36GB Data72%Utilization,100GB Storage25GB Data25%Utilization,IBM TotalStorage SAN文件系统提高存储利用率,SAN,SFSadmin,只需配置和管理一个文件系统，需要使用管理LUN资源减少LUNs 按照业务要求添加到存储池存储资源的使用和分配更加简单和有效平均利用率:93%,High Performance 2TB Storage1.9TB Data95%Utilization,Medium Perf4TB Storage3.6TB Data90%Utilization,Low Performance4TB Storage3.8TB Data95%Utilization,SANFile System,FileSystem,FileSystem,FileSystem,FileSystem,虚拟化存储结构,SAN,SANVolume Controller,SANFile System,VirtualDisk,VirtualDisk,VirtualDisk,VirtualDisk,SANVolume Controller,为数据库文件扩展可用空间,将共享的目率移动到新的设备上,所有这一切对服务器机和应用透明,VirtualizedFile System,VirtualizedDisk,更换旧设备,IBM TotalStorage SAN File System,IBM TotalStorage SAN Volume Controller,IBMDS6000,IBMDS8000,IBMDS4000,IBMDS6000,HDS9950V,这些名字你很熟悉？他们都在SVC,