1、NetAppxSASDiskShelvesUniversalSASandACPCablingGuideNetApp, Inc.495 East Java Drive Sunnyvale, CA 94089 U.S.Part number: 215-05500_D0September 2013Telephone:+1(408)822-6000Fax:+1(408)822-4501Supporttelephone:+1(888)463-8277Web:Feedback:doccommentsTableofContents3ContentsSAScablingfornewstoragesystems
2、5SAScablingrules5GeneralSAScablingrules5OnboardSASportrules8Shelf-to-shelfconnectionrules9Controller-to-shelf-connectionrules10Controller-to-controllerrule(FAS22xxsystemsonly)15CablingSASconnections15CompletingtheSAScablingworksheet15SAScablingworksheetrulesandtemplate16SampleSAScablingworksheetfora
3、32xx17SampleSAScablingworksheetforanHApair(non32xx,FAS22xx,orFAS20xx)19CablingSASports21SAScablingexamples26ExamplesofSAScablingforHApairswithquad-portHBAs26ExamplesofSAScablingforsingle-controllerconfigurationswithquad-portHBAs31ExamplesofSAScablingfor32xxsystems35ExamplesofSAScablingforPCMsystems3
4、7ExamplesofSAScablingforFAS2050systems44ExamplesofSAScablingforFAS2040systems48ACPcablingfornewstoragesystems51ACPcablingrules51GeneralACPcablingrules51ACPconnectivityrules51CablingACPconnections52CablingACPonsystemswithexternalSASstorage52CablingACPonPCMsystemswithnoexternalSASstorage59ACPcablingex
5、amples60ExamplesofACPcablingforHApairs60ExamplesofACPcablingforsingle-controllerconfigurations64GlossaryDocumentupdaterecord71Copyrightinformation73Trademarkinformation74Howtosendyourcomments75Index76SASCablingfornewStOrageSyStemSFornewstoragesysteminstallations,youmustunderstandthecablingrulesbefor
6、ecablingtheSASconnectionsforthediskshelves.Note:AlthoughthecablingrulesinthisdocumentapplytostretchMetroClustersystemswithSASdiskshelvesdirectlyattachedtothecontrollers,specificcablingproceduresforstretchMetroClustersystemsusingSASopticalcablescanbefoundintheConfiguringastretchMetroClustersystemwith
7、SASdiskshelvesandSASopticalcablesdocument.Note:Cablinginformationforhot-addingorreplacingSASdiskshelvesisintheInstallationandSerViCeGuideforyourdiskshelfmodel.AlldocumentscanbefoundontheNetAppSupportSSAScablingrulesYoucancableSASdiskshelvestostoragesystemsthathaveSASHBAsand/oronboardSASportsbyapplyi
8、ngtheSAScablingrules.GeneralSAScablingrulesYouneedtoknowthegeneralSAScablingmlesgoverningsupportedconfigurations,cables,andSASportconnectionsonthediskshelves.AllHApairconfigurationsmustusemultipathHA,withthefollowingexceptions:FAS2040systemsusesingle-pathHA.FAS22xxsystemswithnoexternalSASstoragecanu
9、sesingle-pathHA,whichrequiresnoexternalcabling.However,therecommendedconfigurationistoenablemultipathHfortheinternaldisksbyconnectingtheSASportsofonecontrollermoduletotheSASportsofthepartner.Note:AmultipathHAconfigurationhavingexternalshelvesrequirestwoportsoneachcontrollerforeachstackofdiskshelves.
10、EvenifthestackconsistsofonediskShe优twoportsoneachcontrollerarerequired.Allsingle-controllerconfigurationsmustusedual-path,withthefollowingexceptions:FAS2040systemsusesingle-path. FAS22xxsystemshavetheinternaldiskscabledassingle-path,butthesystemcanuseeithersingle-pathordual-pathconnectivitytotheexte
11、rnalshelves;botharesupported.Dual-pathprovidesgreaterresiliency,butwhendual-pathisused,DataONTAP8.1.xissuesoccasionalwarningstotheconsolebecausemixedpathsaredetected.Toavoidthewarnings,single-pathconnectionstotheexternalSASstorageareasupportedoptionintheseconfigurations.OnlyMetroClustersystemswithdi
12、skshelvesdirectlyattachedtothecontrollerscanuseSASopticalcables.Forexample,MetroClustersystemsusingFibreBridge6500NbridgesuseSAScoppercables.TheSAScablescanbeSAScopper,SASoptical,oramixdependingonwhetherornotyoursystemmeetstherequirementsforusingthetypeofcable.IfyouareusingamixofSAScoppercablesandSA
13、Sopticalcables,thefollowingrulesapply:Shelf-to-shelfconnectionsinastackmustbeallSAScoppercablesorallSASopticalcables.Iftheshelf-to-shelfconnectionsareSASopticalcables,theshelf-to-controllerconnectionstothatstackmustalsobeSASopticalcables. Iftheshelf-to-shelfconnectionsareSAScoppercables,theshelf-to-
14、controllerconnectionstothatstackcanbeSASopticalcablesorSAScoppercables.ThecableQSFPconnectorendconnectstoadiskshelforaSASportonacontroller.TheSAScableQSFPconnectorsarekeyed;whenorientedcorrectlyintoaSASport,theQSFPconnectorclicksintoplaceandthediskshelfSASportLNKLEDilluminatesgreen.Donotforceaconnec
15、torintoaport.ThefollowingillustrationshowsaQSFPconnector:Note:TheQSFPconnectorshownhasapulltabforreleasingtheconnectorfromaSASport;however,QSFPconnectorscanhaveadifferentreleasemechanism.DiskshelvesconnectedwithSASopticalcablesrequireaversionofdiskshelffirmwarethatsupportsSASopticalcables.Bestpracti
16、ceistoupdatealldiskshelvesinthestoragesystemwiththelatestversionofdiskshelffirmware.Note:DonotrevertdiskshelffirmwaretoaversionthatdoesnotsupportSASopticalcables.SASopticalmultimodeQSFP-to-QSFPcablescanbeusedforcontrollcr-to-shelfandshelf-to-shelfconnections,andareavailableinlengthsupto50meters.Ifyo
17、uareusingSASopticalmultimodeMPOcableswithMPOQSFPmodules,thefollowingparametersapply: Youcanusethesecablesforcontroller-to-shelfandshelf-to-shelfconnections. Thelengthofasinglecablecannotexceed150metersfor0M4and100metersforOM3.Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelasts
18、helf)cannotexceed510meters.Thetotalpathincludesthesetofbreakoutcables,patchpanels,andinter-panelcables.IfyouareusingSASopticalmultimodebreakoutcables,thefollowingparametersapply:Youcanusethesecablesforcontroller-to-shelfandshelf-to-shelfconnections.Ifyouusemultimodebreakoutcablesforashelf-to-shelfco
19、nnection,youcanonlyuseitoncewithinastackofdiskshelves.YoumustuseSASopticalmultimodeQSFP-to-QSFPorMPOcableswithMPOQSFPmodulestoconnecttheremainingshelf-to-shelfconnections. Thepoint-to-point(QSFP-to-QSFP)pathofanymultimodecablecannotexceed150metersforOM4and100metersforOM3.Thepathincludesthesetofbreak
20、outcables,patchpanels,andinter-panelcables. Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelastshelf)cannotexceed510meters.Thetotalpathincludesthesetofbreakoutcables,patchpanels,andinter-panelcables. Uptoonepairofpatchpanelscanbeusedinapath. Youneedtosupplythepatchpanelsandinte
21、r-panelcables.Theinter-panelcablesmustbethesamemodeastheSASopticalbreakoutcable:multimode. YoureceivedasetofQSFP-to-MPOcablemoduleswitheachsetofSASopticalbreakoutcables,whichyoumustattachtotheMPOendofeachSASopticalbreakoutcable.ThebreakoutcableshaveSC,LC,orMTRJconnectorsontheoppositeend,whichconnect
22、toapatchpanel. Youmustconnectalleight(fourpairs)oftheSC,LC,orMTRJbreakoutconnectorstothepatchpanel.IfyouareusingSASopticalsinglemodebreakoutcables,thefollowingparametersapply:Note:SASopticalsinglemodebreakoutcablescanonlybeusedinMetroClustersystems. Youcanusethesecablesforcontroller-to-shelfconnecti
23、ons.Shelf-to-shelfconnectionsusemultimodeQSFP-to-QSFPcablesormultimodeMPOcableswithMPOQSFPmodules. Thepoint-to-point(QSFP-to-QSFP)pathofasinglesinglemodecablecannotexceed500meters. Thetotalend-to-endpath(sumofpoint-to-pointpathsfromthecontrollertothelastshelf)cannotexceed510meters.Thetotalpathinclud
24、esthesetofbreakoutcables,patchpanels,andinter-panelcables.Uptoonepairofpatchpanelscanbeusedinapath.,Youneedtosupplythepatchpanelsandinter-panelcables.Theinter-panelcablesmustbethesamemodeastheSASopticalbreakoutcable:singlemode.,Youmustconnectalleight(fourpairs)oftheSC,LC,orMTRJbreakoutconnectorstoth
25、epatchpanel.QSFP-to-mini-SAScoppercablesareusedforFAS2050configurationsonly,andconnectdiskshelvestothedual-portmini-SASHBAsonthecontroller.ThefollowingillustrationshowstheQSFP-to-mini-SAScableconnectors:SASportsonthediskshelfaredesignatedbyasquareorcirclesymbol.KMACPSASUCSquareportsarcalwayscabledto
26、circleports,andcircleportsarealwayscabledtosquareports.Nevercablesquareportstosquareportsorcircleportstocircleports.ThefollowingillustrationshowssquareandcircleportlabelingonanIOM.OnboardSASportrulesStoragesystemsthathavecontrollerswithonboardSASportsmustfollowaspecificportidentificationrule.Foralls
27、ystemsexceptFAS2040,anonboardHBAisdefinedasoccupyingPClslotO,witheachportnamedwithsequentiallyincreasingletters(0a,Ob,Oc,andsoon).ThisistoensurethattheSAScablingrulesapplytoallSASHBAsonacontroller,whetherinaphysicalPClslot(slot1-N)oronboardthebasecontroller.Thefollowingexampleshowsacontrollerwithone
28、onboardSASHBAinslot0andthreeSASHBAsinphysicalPCIslots1,2,and3.ForFAS2040systems,theonboardSASportlabeledOdshouldbetreatedasifitwereslot0porta.TreatingtheportasOaenablesyoutoapplyalltheSAScablingrules.(DataONTAPcontinuestorecognizethisportas0d.)ThefollowingexampleshowstheFAS2040exception:2040controll
29、erOaOdShelf-to-shelfconnectionrulesWhenyouhavemorethanonediskshelfinastackofdiskshelves,theshelvesinthestackmustbeconnectedtoeachother(daisy-chained).Thediskshelvesaredaisy-chainedinthefollowingway:IOMAcircleportisconnectedtothenextIOMAsquareport.IOMBcircleportisconnectedtothenextIOMBsquareport.Note
30、Squareportsarealwayscabledtocircleports,andcircleportsarealwayscabledtosquareports.Nevercablesquareportstosquareportsorcircleportstocircleports.Thefollowingillustrationshowsadaisy-chainedstackofdiskshelveswiththeIOMsarrangedside-by-side,similartohowaDS2246diskshelfisoriented.Thefollowingillustratio
31、nshowsadaisy-chainedstackofdiskshelveswiththeIOMsarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented.Stack”threeshelvesController-to-shelf-connectionrulesEachcontrollerconnectstothefirstandlastdiskshelfineachstackinthesystemthroughthecontrollerSASports.ThecontrollerSASAandCportsconnectto
32、thefirstdiskshelfsquareports.ThecontrollerSASBandDportsconnecttothelastdiskshelfcircleports.ThesecontrollerSASportscanbeonaSASHBAinaphysicalPCIslot(slot1-N)oronthebasecontroller.TheSAScablingalgorithmdescribedinthisdocumentbalancesSAScablingbetweentheonboardSASports(asapplicable)andSASHBportstoprovi
33、dehighlyavailablestorage-controllerconfigurations.Thiscablingalgorithmmeetsthefollowinggoals:Providesasingle,easilyunderstooduniversalalgorithmforallSASproductsandconfigurations.Isverifiablebyconfiguration-checkingsoftwareandtools.Providesmaximumpossibleresiliencetomaintainavailabilityandminimizethe
34、relianceoncontrollertakeovers.nydeviationsfromthealgorithmarenotrecommended;deviationsmayreducereliability,universality,andcommonality.Note:Ifyoursystemcablingisnotcompliantwiththerulesinthisguide,itisrecommendedthatyoucorrectthecablingduringamaintenancewindow.AandCportconnectionsControllerSASportsA
35、andCareconnectedtothefirstdisk-shelfsquareportineachstackofdiskshelves.TheAandCportsoncontroller1/AconnecttoIOMA.TheAandCportsoncontroller2/BconnecttoIOMB.Forexample,thefollowingillustrationshowshowcontrollerportsAandCareconnectedtodiskshelvesthathavetheIOMsarrangedsidebyside,similartohowaDS2246disk
36、shelfisoriented:Controller1/AController2/BECCCE(ZDJcCPocE臼Forexample,thefollowingillustrationshowshowcontrollerportsAandCarcconnectedtodiskshelvesthathavetheIOMsarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented:Conlroller 1/AIOMA IOM BStack 1 IACP SASController 2/BStack 2ACPFirst shelf
37、LastShCHControllerSASportsAandCareconnectedtothedisk-shelfstacksinsequentialorderofthePCIslots(slot0,slot1,slot2,andsoon)onthecontroller.Forexample,acontrollerwithslots1,2,and3occupiedwithquad-portSASHBAsiscabledinorderofslotsandportsla,2a,3a,lc,2c,3c:ControllerForexample,acontrollerwithslots0,I,and
38、2occupied(slot0beinganonboardportandslot1andslot2beingquad-portSASHBAs)iscabledinorderofslotsandports0a,la,2a,lc,2c:BandDportconnectionsControllerSASportsBandDareconnectedtothelastdisk-shelfcircleportineachstackofdiskshelves.TheBandDportsoncontroller1/AconnecttoIOMB.TheBandDportsoncontroller2/Bconne
39、cttoIOMA.Forexample,thefollowingillustrationshowshowcontrollerportsBandDareconnectedtodiskshelvesthathavetheIOMsarrangedsidebyside,similartohowaDS2246diskshelfisoriented:Controller 1/AController 2/BForexample,thefollowingillustrationshowshowcontrollerportsBandDareconnectedtodiskshelvesthathavetheIOM
40、sarrangedoneabovetheother,similartohowaDS4243diskshelfisoriented:Controller VAController 2旧ControllerSASportsBandDareconnectedtothedisk-shelfstacksbyoffsettingtheorderofthePCIslotsbyonesothatthefirstportonthefirstslotiscabledlast.Thecablingoffsetensuressystemresiliency.Forexample,acontrollerwiththre
41、equad-portSASHBAsinslots1,2,and3iscabledinorderofslotsandports2b,3b,Id,2d,3d,lb:Forexample,acontrollerwithslots0,1,and2occupied(slot0beinganonboardportandslot1and2beingquad-portSASHBAs)iscabledinorderofslotsandportslb,2b,Id,2d,Ob:ControllerSbtoSkMlSkM2AAAAcontrollerwithonequad-portHBAiscabledinorder
42、ofportIdandthenlb:ControllerStackcablingsequenceControllersarecabledtothestacksaccordingtothesequenceofthestacks,suchasstack1,stack2,stack3,andsoon.FAS20xxconfigurationsForsingle-controllerFAS20xxconfigurations,thecontrollerisinSlotB(thebottomslot);therefore,thecontrolleriscabledasifitwerecontroller
43、2B.IfasecondcontrollerisaddedtomakethisanHApairconfiguration,thenewcontrolleriscabledascontroller1A.Controller-to-controllerrule(FAS22xxsystemsonly)OnFAS22xxsystemsinHApairswithnoexternalstorage,externalcablesshouldconnecttheSASportsonthetwocontrollermodulestoenablemultipathHAfortheinternaldisks.Cab
44、lingSASconnectionsCablingtheSASconnectionsinvolvescompletingtheSAScablingworksheettoidentifytheSASportsthatneedtobecabledtothediskshelves,andapplyingtheworksheetwhenfollowingthecablingprocedure.CompletingtheSAScablingworksheetByusingtheSAScablingworksheettolisttheslotsandSASportsforeachcontroller,yo
45、ucansimplifythecablingtask.AboutthistaskYoucanreferencetheappropriateSampleSAScablingworksheetwhenrecordingyourinformation.Steps1. PrintoutacopyoftheSAScablingworksheettemplatetorecordyourinformation.2. Readthecablingworksheetrulesandbesuretounderstandthem.3. MakealistofallSASAportsandthenallSASCpor
46、tsoneachcontrollerinyourconfiguration.ExampleAcontrollerwiththreequad-portSASHBAsislistedasla,2a,3a,lc,2c,3c.Acontrollerwithonequad-portSASHBAislistedasla,lc.AFAS2050withonedual-portSASHBAislistedasla.AFAS2040islistedas0a.A32xxdualenclosure(withtwoonboardSASportsandonequad-port)islistedas0a,la,lc.4.
47、 IfyouhaveaFAS2040gotoStep5;otherwise,listtheremainingportsbycompletingthefollowingsubsteps:a)MakealistofallSASBportsandthenallSASDportsoneachcontrollerinyourconfiguration(inthegrayed-outcellsoftheworksheet).ExampleAcontrollerwiththreequad-portSASHBAsislistedaslb,2b,3b,Id,2d,3d.Acontrollerwithonequad-portSASHBAislistedaslb,Id.AFAS2050withonedual-portSASHBAislistedaslb.A32xxdualenclosure(withtwoonboardSASportsandonequad-port)islistedasOb,lb,Id.b)Rewritethelist(
