Net 装机维护 UniversalSASandACPCablingGuide.docx

《Net 装机维护 UniversalSASandACPCablingGuide.docx》由会员分享，可在线阅读，更多相关《Net 装机维护 UniversalSASandACPCablingGuide.docx（80页珍藏版）》请在三一文库上搜索。

1、NetAppxSASDiskShelvesUniversalSASandACPCablingGuideNetApp, Inc.495 East Java Drive Sunnyvale, CA 94089 U.S.Part number: 215-05500_D0September 2013Telephone:+1(408)822-6000Fax:+1(408)822-4501Supporttelephone:+1(888)463-8277Web:Feedback:doccommentsTableofContents3ContentsSAScablingfornewstoragesystems

2、5SAScablingrules5GeneralSAScablingrules5OnboardSASportrules8Shelf-to-shelfconnectionrules9Controller-to-shelf-connectionrules10Controller-to-controllerrule(FAS22xxsystemsonly)15CablingSASconnections15CompletingtheSAScablingworksheet15SAScablingworksheetrulesandtemplate16SampleSAScablingworksheetfora

3、32xx17SampleSAScablingworksheetforanHApair(non32xx,FAS22xx,orFAS20xx)19CablingSASports21SAScablingexamples26ExamplesofSAScablingforHApairswithquad-portHBAs26ExamplesofSAScablingforsingle-controllerconfigurationswithquad-portHBAs31ExamplesofSAScablingfor32xxsystems35ExamplesofSAScablingforPCMsystems3

4、7ExamplesofSAScablingforFAS2050systems44ExamplesofSAScablingforFAS2040systems48ACPcablingfornewstoragesystems51ACPcablingrules51GeneralACPcablingrules51ACPconnectivityrules51CablingACPconnections52CablingACPonsystemswithexternalSASstorage52CablingACPonPCMsystemswithnoexternalSASstorage59ACPcablingex

5、amples60ExamplesofACPcablingforHApairs60ExamplesofACPcablingforsingle-controllerconfigurations64GlossaryDocumentupdaterecord71Copyrightinformation73Trademarkinformation74Howtosendyourcomments75Index76SASCablingfornewStOrageSyStemSFornewstoragesysteminstallations,youmustunderstandthecablingrulesbefor

6、ecablingtheSASconnectionsforthediskshelves.Note:AlthoughthecablingrulesinthisdocumentapplytostretchMetroClustersystemswithSASdiskshelvesdirectlyattachedtothecontrollers,specificcablingproceduresforstretchMetroClustersystemsusingSASopticalcablescanbefoundintheConfiguringastretchMetroClustersystemwith

7、SASdiskshelvesandSASopticalcablesdocument.Note:Cablinginformationforhot-addingorreplacingSASdiskshelvesisintheInstallationandSerViCeGuideforyourdiskshelfmodel.AlldocumentscanbefoundontheNetAppSupportSSAScablingrulesYoucancableSASdiskshelvestostoragesystemsthathaveSASHBAsand/oronboardSASportsbyapplyi

8、ngtheSAScablingrules.GeneralSAScablingrulesYouneedtoknowthegeneralSAScablingmlesgoverningsupportedconfigurations,cables,andSASportconnectionsonthediskshelves.AllHApairconfigurationsmustusemultipathHA,withthefollowingexceptions:FAS2040systemsusesingle-pathHA.FAS22xxsystemswithnoexternalSASstoragecanu

9、sesingle-pathHA,whichrequiresnoexternalcabling.However,therecommendedconfigurationistoenablemultipathHfortheinternaldisksbyconnectingtheSASportsofonecontrollermoduletotheSASportsofthepartner.Note:AmultipathHAconfigurationhavingexternalshelvesrequirestwoportsoneachcontrollerforeachstackofdiskshelves.

10、EvenifthestackconsistsofonediskShe优twoportsoneachcontrollerarerequired.Allsingle-controllerconfigurationsmustusedual-path,withthefollowingexceptions:FAS2040systemsusesingle-path. FAS22xxsystemshavetheinternaldiskscabledassingle-path,butthesystemcanuseeithersingle-pathordual-pathconnectivitytotheexte

11、rnalshelves;botharesupported.Dual-pathprovidesgreaterresiliency,butwhendual-pathisused,DataONTAP8.1.xissuesoccasionalwarningstotheconsolebecausemixedpathsaredetected.Toavoidthewarnings,single-pathconnectionstotheexternalSASstorageareasupportedoptionintheseconfigurations.OnlyMetroClustersystemswithdi

12、skshelvesdirectlyattachedtothecontrollerscanuseSASopticalcables.Forexample,MetroClustersystemsusingFibreBridge6500NbridgesuseSAScoppercables.TheSAScablescanbeSAScopper,SASoptical,oramixdependingonwhetherornotyoursystemmeetstherequirementsforusingthetypeofcable.IfyouareusingamixofSAScoppercablesandSA

13、Sopticalcables,thefollowingrulesapply:Shelf-to-shelfconnectionsinastackmustbeallSAScoppercablesorallSASopticalcables.Iftheshelf-to-shelfconnectionsareSASopticalcables,theshelf-to-controllerconnectionstothatstackmustalsobeSASopticalcables. Iftheshelf-to-shelfconnectionsareSAScoppercables,theshelf-to-

14、controllerconnectionstothatstackcanbeSASopticalcablesorSAScoppercables.ThecableQSFPconnectorendconnectstoadiskshelforaSASportonacontroller.TheSAScableQSFPconnectorsarekeyed;whenorientedcorrectlyintoaSASport,theQSFPconnectorclicksintoplaceandthediskshelfSASportLNKLEDilluminatesgreen.Donotforceaconnec

15、torintoaport.ThefollowingillustrationshowsaQSFPconnector:Note:TheQSFPconnectorshownhasapulltabforreleasingtheconnectorfromaSASport;however,QSFPconnectorscanhaveadifferentreleasemechanism.DiskshelvesconnectedwithSASopticalcablesrequireaversionofdiskshelffirmwarethatsupportsSASopticalcables.Bestpracti

16、ceistoupdatealldiskshelvesinthestoragesystemwiththelatestversionofdiskshelffirmware.Note:DonotrevertdiskshelffirmwaretoaversionthatdoesnotsupportSASopticalcables.SASopticalmultimodeQSFP-to-QSFPcablescanbeusedforcontrollcr-to-shelfandshelf-to-shelfconnections,andareavailableinlengthsupto50meters.Ifyo

17、uareusingSASopticalmultimodeMPOcableswithMPOQSFPmodules,thefollowingparametersapply: Youcanusethesecablesforcontroller-to-shelfandshelf-to-shelfconnections. Thelengthofasinglecablecannotexceed150metersfor0M4and100metersforOM3.Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelasts

18、helf)cannotexceed510meters.Thetotalpathincludesthesetofbreakoutcables,patchpanels,andinter-panelcables.IfyouareusingSASopticalmultimodebreakoutcables,thefollowingparametersapply:Youcanusethesecablesforcontroller-to-shelfandshelf-to-shelfconnections.Ifyouusemultimodebreakoutcablesforashelf-to-shelfco

19、nnection,youcanonlyuseitoncewithinastackofdiskshelves.YoumustuseSASopticalmultimodeQSFP-to-QSFPorMPOcableswithMPOQSFPmodulestoconnecttheremainingshelf-to-shelfconnections. Thepoint-to-point(QSFP-to-QSFP)pathofanymultimodecablecannotexceed150metersforOM4and100metersforOM3.Thepathincludesthesetofbreak

20、outcables,patchpanels,andinter-panelcables. Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelastshelf)cannotexceed510meters.Thetotalpathincludesthesetofbreakoutcables,patchpanels,andinter-panelcables. Uptoonepairofpatchpanelscanbeusedinapath. Youneedtosupplythepatchpanelsandinte

21、r-panelcables.Theinter-panelcablesmustbethesamemodeastheSASopticalbreakoutcable:multimode. YoureceivedasetofQSFP-to-MPOcablemoduleswitheachsetofSASopticalbreakoutcables,whichyoumustattachtotheMPOendofeachSASopticalbreakoutcable.ThebreakoutcableshaveSC,LC,orMTRJconnectorsontheoppositeend,whichconnect

22、toapatchpanel. Youmustconnectalleight(fourpairs)oftheSC,LC,orMTRJbreakoutconnectorstothepatchpanel.IfyouareusingSASopticalsinglemodebreakoutcables,thefollowingparametersapply:Note:SASopticalsinglemodebreakoutcablescanonlybeusedinMetroClustersystems. Youcanusethesecablesforcontroller-to-shelfconnecti

23、ons.Shelf-to-shelfconnectionsusemultimodeQSFP-to-QSFPcablesormultimodeMPOcableswithMPOQSFPmodules. Thepoint-to-point(QSFP-to-QSFP)pathofasinglesinglemodecablecannotexceed500meters. Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelastshelf)cannotexceed510meters.Thetotalpathinclud

24、esthesetofbreakoutcables,patchpanels,andinter-panelcables.Uptoonepairofpatchpanelscanbeusedinapath.,Youneedtosupplythepatchpanelsandinter-panelcables.Theinter-panelcablesmustbethesamemodeastheSASopticalbreakoutcable:singlemode.,Youmustconnectalleight(fourpairs)oftheSC,LC,orMTRJbreakoutconnectorstoth

25、epatchpanel.QSFP-to-mini-SAScoppercablesareusedforFAS2050configurationsonly,andconnectdiskshelvestothedual-portmini-SASHBAsonthecontroller.ThefollowingillustrationshowstheQSFP-to-mini-SAScableconnectors:SASportsonthediskshelfaredesignatedbyasquareorcirclesymbol.KMACPSASUCSquareportsarcalwayscabledto

26、circleports,andcircleportsarealwayscabledtosquareports.Nevercablesquareportstosquareportsorcircleportstocircleports.ThefollowingillustrationshowssquareandcircleportlabelingonanIOM.OnboardSASportrulesStoragesystemsthathavecontrollerswithonboardSASportsmustfollowaspecificportidentificationrule.Foralls

27、ystemsexceptFAS2040,anonboardHBAisdefinedasoccupyingPClslotO,witheachportnamedwithsequentiallyincreasingletters(0a,Ob,Oc,andsoon).ThisistoensurethattheSAScablingrulesapplytoallSASHBAsonacontroller,whetherinaphysicalPClslot(slot1-N)oronboardthebasecontroller.Thefollowingexampleshowsacontrollerwithone

28、onboardSASHBAinslot0andthreeSASHBAsinphysicalPCIslots1,2,and3.ForFAS2040systems,theonboardSASportlabeledOdshouldbetreatedasifitwereslot0porta.TreatingtheportasOaenablesyoutoapplyalltheSAScablingrules.(DataONTAPcontinuestorecognizethisportas0d.)ThefollowingexampleshowstheFAS2040exception:2040controll

29、erOaOdShelf-to-shelfconnectionrulesWhenyouhavemorethanonediskshelfinastackofdiskshelves,theshelvesinthestackmustbeconnectedtoeachother(daisy-chained).Thediskshelvesaredaisy-chainedinthefollowingway:IOMAcircleportisconnectedtothenextIOMAsquareport.IOMBcircleportisconnectedtothenextIOMBsquareport.Note

30、Squareportsarealwayscabledtocircleports,andcircleportsarealwayscabledtosquareports.Nevercablesquareportstosquareportsorcircleportstocircleports.Thefollowingillustrationshowsadaisy-chainedstackofdiskshelveswiththeIOMsarrangedside-by-side,similartohowaDS2246diskshelfisoriented.Thefollowingillustratio

31、nshowsadaisy-chainedstackofdiskshelveswiththeIOMsarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented.Stack”threeshelvesController-to-shelf-connectionrulesEachcontrollerconnectstothefirstandlastdiskshelfineachstackinthesystemthroughthecontrollerSASports.ThecontrollerSASAandCportsconnectto

32、thefirstdiskshelfsquareports.ThecontrollerSASBandDportsconnecttothelastdiskshelfcircleports.ThesecontrollerSASportscanbeonaSASHBAinaphysicalPCIslot(slot1-N)oronthebasecontroller.TheSAScablingalgorithmdescribedinthisdocumentbalancesSAScablingbetweentheonboardSASports(asapplicable)andSASHBportstoprovi

33、dehighlyavailablestorage-controllerconfigurations.Thiscablingalgorithmmeetsthefollowinggoals:Providesasingle,easilyunderstooduniversalalgorithmforallSASproductsandconfigurations.Isverifiablebyconfiguration-checkingsoftwareandtools.Providesmaximumpossibleresiliencetomaintainavailabilityandminimizethe

34、relianceoncontrollertakeovers.nydeviationsfromthealgorithmarenotrecommended;deviationsmayreducereliability,universality,andcommonality.Note:Ifyoursystemcablingisnotcompliantwiththerulesinthisguide,itisrecommendedthatyoucorrectthecablingduringamaintenancewindow.AandCportconnectionsControllerSASportsA

35、andCareconnectedtothefirstdisk-shelfsquareportineachstackofdiskshelves.TheAandCportsoncontroller1/AconnecttoIOMA.TheAandCportsoncontroller2/BconnecttoIOMB.Forexample,thefollowingillustrationshowshowcontrollerportsAandCareconnectedtodiskshelvesthathavetheIOMsarrangedsidebyside,similartohowaDS2246disk

36、shelfisoriented:Controller1/AController2/BECCCE(ZDJcCPocE臼Forexample,thefollowingillustrationshowshowcontrollerportsAandCarcconnectedtodiskshelvesthathavetheIOMsarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented:Conlroller 1/AIOMA IOM BStack 1 IACP SASController 2/BStack 2ACPFirst shelf

37、LastShCHControllerSASportsAandCareconnectedtothedisk-shelfstacksinsequentialorderofthePCIslots(slot0,slot1,slot2,andsoon)onthecontroller.Forexample,acontrollerwithslots1,2,and3occupiedwithquad-portSASHBAsiscabledinorderofslotsandportsla,2a,3a,lc,2c,3c:ControllerForexample,acontrollerwithslots0,I,and

38、2occupied(slot0beinganonboardportandslot1andslot2beingquad-portSASHBAs)iscabledinorderofslotsandports0a,la,2a,lc,2c:BandDportconnectionsControllerSASportsBandDareconnectedtothelastdisk-shelfcircleportineachstackofdiskshelves.TheBandDportsoncontroller1/AconnecttoIOMB.TheBandDportsoncontroller2/Bconne

39、cttoIOMA.Forexample,thefollowingillustrationshowshowcontrollerportsBandDareconnectedtodiskshelvesthathavetheIOMsarrangedsidebyside,similartohowaDS2246diskshelfisoriented:Controller 1/AController 2/BForexample,thefollowingillustrationshowshowcontrollerportsBandDareconnectedtodiskshelvesthathavetheIOM

40、sarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented:Controller VAController 2旧ControllerSASportsBandDareconnectedtothedisk-shelfstacksbyoffsettingtheorderofthePCIslotsbyonesothatthefirstportonthefirstslotiscabledlast.Thecablingoffsetensuressystemresiliency.Forexample,acontrollerwiththre

41、equad-portSASHBAsinslots1,2,and3iscabledinorderofslotsandports2b,3b,Id,2d,3d,lb:Forexample,acontrollerwithslots0,1,and2occupied(slot0beinganonboardportandslot1and2beingquad-portSASHBAs)iscabledinorderofslotsandportslb,2b,Id,2d,Ob:ControllerSbtoSkMlSkM2AAAAcontrollerwithonequad-portHBAiscabledinorder

42、ofportIdandthenlb:ControllerStackcablingsequenceControllersarecabledtothestacksaccordingtothesequenceofthestacks,suchasstack1,stack2,stack3,andsoon.FAS20xxconfigurationsForsingle-controllerFAS20xxconfigurations,thecontrollerisinSlotB(thebottomslot);therefore,thecontrolleriscabledasifitwerecontroller

43、2B.IfasecondcontrollerisaddedtomakethisanHApairconfiguration,thenewcontrolleriscabledascontroller1A.Controller-to-controllerrule(FAS22xxsystemsonly)OnFAS22xxsystemsinHApairswithnoexternalstorage,externalcablesshouldconnecttheSASportsonthetwocontrollermodulestoenablemultipathHAfortheinternaldisks.Cab

44、lingSASconnectionsCablingtheSASconnectionsinvolvescompletingtheSAScablingworksheettoidentifytheSASportsthatneedtobecabledtothediskshelves,andapplyingtheworksheetwhenfollowingthecablingprocedure.CompletingtheSAScablingworksheetByusingtheSAScablingworksheettolisttheslotsandSASportsforeachcontroller,yo

45、ucansimplifythecablingtask.AboutthistaskYoucanreferencetheappropriateSampleSAScablingworksheetwhenrecordingyourinformation.Steps1. PrintoutacopyoftheSAScablingworksheettemplatetorecordyourinformation.2. Readthecablingworksheetrulesandbesuretounderstandthem.3. MakealistofallSASAportsandthenallSASCpor

46、tsoneachcontrollerinyourconfiguration.ExampleAcontrollerwiththreequad-portSASHBAsislistedasla,2a,3a,lc,2c,3c.Acontrollerwithonequad-portSASHBAislistedasla,lc.AFAS2050withonedual-portSASHBAislistedasla.AFAS2040islistedas0a.A32xxdualenclosure(withtwoonboardSASportsandonequad-port)islistedas0a,la,lc.4.

47、 IfyouhaveaFAS2040gotoStep5;otherwise,listtheremainingportsbycompletingthefollowingsubsteps:a)MakealistofallSASBportsandthenallSASDportsoneachcontrollerinyourconfiguration(inthegrayed-outcellsoftheworksheet).ExampleAcontrollerwiththreequad-portSASHBAsislistedaslb,2b,3b,Id,2d,3d.Acontrollerwithonequad-portSASHBAislistedaslb,Id.AFAS2050withonedual-portSASHBAislistedaslb.A32xxdualenclosure(withtwoonboardSASportsandonequad-port)islistedasOb,lb,Id.b)Rewritethelist(