1、NetAppxClusteredDataONTAP8.2SANConfigurationGuideNetApp, Inc.495 East Java Drive Sunnyvale, CA 94089 U.S.Part number: 215-07954-A0May 2013Telephone:+1(408)822-60Fax:+1(408)822-4501Supporttelephone:+1(888)463-8277Web:Feedback:doccommentsContentsiSCSIconfigurations6Recommendednumberofpathstoavoidsingl
2、epointsoffailure6Single-networkandmulti-nctworksingle-nodeconfigurationinaniSCSISAN6Single-networkHApairinaniSCSISAN9Multi-networkHApairinaniSCSISAN10Direct-attachedsingle-nodeconfigurationsinaniSCSISAN11VLANsforiSCSIconfigurations12StaticVLANs12DynamicVLANs12FibreChannelconfigurations13Recommendedn
3、umberofpathstoavoidsinglepointsoffailure13FConboardandexpansionportcombinations14FibreChannelsupportedhopcounts15FibreChannelsupportedspeeds15FibreChannelswitchconfigurationbestpractices16HostInultipathingsoftwarerequirements1662xxsupportedfibrechannelconfigurations1662xxtargetportconfigurationrecom
4、mendations1762xxSingle-nodeconfigurations1762xx:Single-fabricHAconfigurations1962xx:MultifabricHAconfigurations206040and6080supportedfibrechannelconfigurations226040and6080targetportconfigurationrecommendations2260xxSingle-nodeconfigurations226040and6080:Single-fabricHAconfigurations246040and6080:Mu
5、ltifabricHApair2632xxsupportedfibrechannelconfigurations2732xxtargetportconfigurationrecommendations2732xxSingle-nodeconfigurations2832xx:Single-fabricHAconfigurations2932xx:MultifabricHAconfigurations3031xxsupportedfibrechannelconfigurations3231xxtargetportconfigurationrecommendations323IxxSingle-n
6、odeconfigurations3231xx:Single-fabricHApair3431xx:MultifabricHApair35FAS2240Supportedconfigurations36FAS2240Single-fabricSingle-nodeconfigurations37FAS2240Multifabricsingle-nodeconfigurations38FibreChanneloverEthernetoverview39Recommendednumberofpathstoavoidsinglepointsoffailure39FCoEinitiatorandtar
7、getcombinations40FibreChanneloverEthernetsupportedhopcount40FibreChanneloverEthernetsupportedconfigurations41FCoEinitiatortoFCtargetconfiguration41FCoEend-to-endconfiguration43FCoEmixedwithFC44FCoEmixedwithIPstorageprotocols46FibreChannelandFCoEzoning48WorldWideName-basedzoning48Individualzones49Sin
8、gle-fabriczoning49Dual-fabricHApairzoning50FCandFCoELIFsonthesameportneedtobeinseparatezones52SharedSANconfigurations53ALUAConfigurations54ConfigurationlimitsforFC,FCoE,andiSCSIconfigurations55SANconfigurationsalwaysuseFlexVolvolumes55SupportednumberofnodesforSANconfigurations55SANConfigurationlimit
9、parametersanddefinitions55HostoperatingsystemlimitsforSANconfigurations57SANconfigurationlimits59SANconfigurationlimitsspecificallyfortheFAS222061FCswitchconfigurationlimits62Calculatingqueuedepth63SettingqueuedepthsonAIXhosts65SettingqueuedepthsonHP-UXhosts65SettingqueuedepthsonSolarishosts66Settin
10、gqueuedepthsonVMwarehosts67SettingqueuedepthsonWindowshosts68Copyrightinformation69Trademarkinformation70Howtosendyourcomments71Index72iSCSICOnfigUratiOnSNetwork-attachediSCSIconfigurationsthatuseHApairsarcsupportedforclusteredDataONTAP.StartingwithclusteredDataONTAP8.2,single-nodeconfigurationsarea
11、lsosupported.ForclusteredDataONTAP,youneedtocreateoneormoreiSCSIpathstoeachstoragecontrollerthatcanaccessagivenLUN.ThispathsetupdiffersfrompreviousversionsofDataONTAPoperatingin7-Mode.ForclusteredDataONTAP,portsonapartnernodedonotassumetheIPaddressesofthefailedpartner.Instead,theMPlOsoftwareonthehos
12、tisresponsibleforselectingthenewpaths.ThisbehaviorisverysimilartoFibreChannelpathfailover.InaniSCSIenvironment,youcanconnectEthernetswitchesinanyvendor-supportedconfiguration.Ethernetswitchonly(NoFCoEswitchesorFCoEtrafficinthedatapath)countsarenotalimitationinEthernetiSCSIconfigurations.Forspecificr
13、ecommendationsandbestpractices,seetheEthernetswitchvendorsdocumentation.ForWindowsiSCSImultipathingoptions,seeTR-4080BestPracticesforScalableSANinDataONTAP8.2Cluster-Mode.RelatedinformationNetAppInteroperabilityMatrix-TR-4080:BestPracticesforScalableSANinDataONTAP8.2Cluster-Mode.pdfRecommendednumber
14、ofpathstoavoidsinglepointsoffailureYoushouldhaveaminimumof2pathsperLUNconnectingtoeachnodeinyourcluster.Thiseliminatessinglepointsoffailureandenablesthesystemtosurvivecomponentfailures.Ifyouhavemorethanfournodesinyourclusterormorethanfourtargetportsinanyofyournodes,portsetscanbeusedtolimitthenumbero
15、fpathsthatcanbeusedtoaccessLUNsonyourcontrollers.Single-networkandmulti-networksingle-nodeconfigurationinaniSCSISANYoucanconnecthoststoasingle-nodethatusestheiSCSIprotocoloverasingleIPnetworkoroveramultipleIPnetwork.Thenetworkcanconsistofoneormoreswitches.EachnodecanhavemultipleiSCSIconnectionstothe
16、network.Thenumberofportsavailabledependsonthestoragecontrollermodel.Thefollowingfigureshowsasingle-networkconfiguration.Multi-networkconfigurationsarealsosupported.Controller1IAttributeFullyredundantTypeofnetworkDifferenthostoperatingsystemsMultipathingrequiredTypeofconfigurationValueNo,duetothesing
17、lenetworkSinglenetworkYes,withmultiple-hostconfigurationsYes,ifmultipleconnectionsperhostareconfiguredSinglenodeSingle-networkHApairinaniSCSISANYoucanconnecthoststoHApaircontrollersthatusetheiSCSIprotocoloverasingleIPnetwork.Thenetworkcanconsistofoneormoreswitches.EachcontrollercanhavemultipleiSCSIc
18、onnectionstothenetwork.Thenumberofportsavailabledependsonthestoragecontrollermodel.ThefollowingfigureshowstwoEthernetconnectionstothenetworkperstoragecontroller.Dependingonthecontrollermodel,moreconnectionsarepossible.Figure2:iSCSIsingle-networkHApairAttributeValueFullyredundantNo,duetothesinglenetw
19、orkAttributeTypeofnetworkDifferenthostoperatingsystemsMultipathingrequiredTypeofconfigurationValueSinglenetworkYes,withmultiple-hostconfigurationsYes,ifmultipleconnectionsperhostareconfiguredHApairMulti-networkHApairinaniSCSISANYoucanconnecthoststoHApaircontrollersthatusetheiSCSIprotocolovermultiple
20、IPnetworks.Tobefullyredundant,aminimumoftwoconnectionstoseparatenetworkspercontrollerisnecessarytoprotectagainstNIC,network,andcablingfailure.Thehostwillrequiremultipathingsoftwaretobeinstalledandconfigured.Host 1Host 2HostNController 1ebeaebController2Figure3:iSCSImulti-networkHApairAttributeValueF
21、ullyredundantYesTypeofnetworkMulti-networkDifferenthostoperatingsystemsYes,withmultiple-hostconfigurationsI ValueAttributeMultipathingrequiredYesTypeofconfigurationHApairDirect-attachedsingle-nodeconfigurationsinaniSCSISANYoucanconnecthostsusingiSCSIdirectlytocontrollers.Thenumberofhoststhatcanbedir
22、ectlyconnectedtoacontrollerorpairofcontrollersdependsonthenumberofavailableEthernetports.Host 2Host 1Host NNote:Direct-attachedconfigurationsarenotsupportedinHApairs.1111ET11Controller 1Controller 1Controller 1Figure4:iSCSIdirect-attachedsingle-nodeconfigurationsAttributeValueFullyredundantNo,duetot
23、hesinglenodeTypeofnetworkNone,direct-attachedDifferenthostoperatingsystemsYes,withmultiple-hostconfigurationsMultipathingrequiredYes,ifmultipleconnectionsperhostareconfiguredTypeofconfigurationSinglenodeVLANsforiSCSIconfigurationsAVLANconsistsofagroupofswitchportsgroupedtogetherintoabroadcastdomain.
24、AVLANcanbeonasingleswitchoritcanspanmultipleswitchchassis.StaticanddynamicVLANsenableyoutoincreasesecurity,isolateproblems,andlimitavailablepathswithinyourIPnetworkinfrastructure.ReasonsforimplementingVLANsWhenyouimplementVLANsinlargeIPnetworkinfrastructures,youderivethefollowingbenefits:Increasedse
25、curity.VLANsenableyoutoleverageexistinginfrastructurewhilestillprovidingenhancedsecuritybecausetheylimitaccessbetweendifferentnodesofanEthernetnetworkoranIPSAN.ImprovedEthernetnehvorkandIPSANreliabilitybyisolatingproblems.Reductionofproblemresolutiontimebylimitingtheproblemspace.Reductionofthenumber
26、ofavailablepathstoaparticulariSCSItargetport.Reductionofthemaximumnumberofpathsusedbyahost.Havingtoomanypathsslowsreconnecttimes.Ifahostdoesnothaveamultipathingsolution,youcanuseVLANstoallowonlyonepath.StaticVLANsStaticVLANsareport-based.TheswitchandswitchportareusedtodefinetheVLANanditsmembers.Stat
27、icVLANsofferimprovedsecuritybecauseitisnotpossibletobreachVLANsusingmediaaccesscontrol(MAC)spoofing.However,ifsomeonehasphysicalaccesstotheswitch,replacingacableandreconfiguringthenetworkaddresscanallowaccess.Insomeenvironments,itiseasiertocreateandmanagestaticVLANsthandynamicVLANs.Thisisbecausestat
28、icVLANsrequireonlytheswitchandportidentifiertobespecified,insteadofthe48-bitMACaddress.Inaddition,youcanlabelswitchportrangeswiththeVLANidentifier.DynamicVLANsDynamicVLANsareMACaddress-based.YoucandefineaVLANbyspecifyingtheMACaddressofthemembersyouwanttoinclude.DynamicVLANsprovideflexibilityanddonot
29、requiremappingtothephysicalportswherethedeviceisphysicallyconnectedtotheswitch.YoucanmoveacablefromoneporttoanotherwithoutreconfiguringtheVLAN.13FibreChannelconfigurationsFabric-attachedFCconfigurationsthatuseHApairsaresupportedforclusteredDataONTAP.StartingwithclusteredDataONTAP8.2,single-nodefabri
30、cconfigurationsarealsosupported.Formultiple-hostconfigurations,hostscanusedifferentoperatingsystems,suchasWindowsorUNIX.Hostsrequirethatasupportedmultipathingsolutionbeinstalledandconfigured.HApairswithmultiple,physicallyindependentstoragefabrics(minimumoftwo)arerecommendedforSANsolutions.Thisprovid
31、esredundancyatthefabricandstoragesystemlayers.Redundancyisparticularlyimportantbecausetheselayerstypicallysupportmanyhosts.TheuseOfheterogeneousFCswitchfabricsisnotsupported,exceptinthecaseofembeddedbladeswitches.Forspecificexceptions,seetheInteroperabilityMatrixontheNetAppSupportSite.Cascade,mesh,a
32、ndcore-edgefabricsareallindustry-standardmethodsofconnectingFCswitchestoafabric,andallaresupported.Afabriccanconsistofoneormultipleswitches,andthestoragecontrollerscanbeconnectedtomultipleswitches.Note:ThefollowingsectionsshowdetailedSANconfigurationdiagramsforeachtypeofstoragesystem.Forsimplicity,t
33、hediagramsshowonlyasinglefabricor,inthecaseofthedual-fabricconfigurations,twofabrics.However,itispossibletohavemultiplefabricsconnectedtoasinglestoragesystem.Inthecaseofdual-fabricconfigurations,evenmultiplesoffabricsarcsupported.RelatedinformationNetAppInteroperabilityMatrix-Recommendednumberofpath
34、stoavoidsinglepointsoffailureYoushouldhaveaminimumof2pathsperLUNconnectingtoeachnodeinyourcluster.Thiseliminatessinglepointsoffailureandenablesthesystemtosurvivecomponentfailures.Ifyouhavemorethanfournodesinyourclusterormorethanfourtargetportsinanyofyournodes,portsetscanbeusedtolimitthenumberofpaths
35、thatcanbeusedtoaccessLUNsonyourcontrollers.FConboardandexpansionportcombinationsYoucanusestoragecontrolleronboardFCportsasbothinitiatorsandtargets.YoucanalsoaddstoragecontrollerFCportsonexpansionadaptersandusethemasinitiatorsortargets.Note:TheXl132A-R6andX2056-R6FCHBAforthe62xxseriessystemsaretheonl
36、ycardsthatcanbeconfiguredwithinitiatorsandtargetsonthesamecard.Thefollowingtablelistssupportedcombinations:OnboardportsExpansionportsSupported?Initiator+TargetNoneYesInitiator+TargetTargetonlyYesInitiator+TargetInitiatoronlyYesInitiator+TargetInitiator+TargetYesInitiatoronlyTargetonlyYesInitiatoronl
37、yInitiator+TargetYesInitiatoronlyInitiatoronlyYes,butnoFCSANsupportInitiatoronlyNoneYes,butnoFCSANsupportTargetonlyInitiatoronlyYesTargetonlyInitiator+TargetYesTargetonlyTargetonlyYes,butnoFCdiskshelf,V-Seriesconfigurations,orFCtapesupportTargetonlyNoneYes,butnoFCdiskshelf,V-Seriesconfigurations,orF
38、CtapesupportRelatedconceptsConfigurationlimitsforFC,FCoE,andiSCSIconfigurationsonpage55RelatedreferencesFCoEinitiatorandtargetcombinationsonpage40FibreChannelsupportedhopcountsThemaximumsupportedFChopcountbetweenahostandstoragesystemdependsonswitchsupplierandstoragesystemsupportforFCconfigurations.T
39、hehopcountisdefinedasthenumberofswitchesinthepathbetweentheinitiator(host)andtarget(storagesystem).CiscoalsoreferstothisvalueasthediameteroftheSANfabric.Thefollowingtablelistssupportedhopcounts:ISwitchsupplierSupportedhopcountBrocade7forFC5forFCoECisco7Upto3oftheswitchescanbeFCoEswitches.FibreChanne
40、lsupportedspeedsFibreChanneltargetportscanbeconfiguredtorunatdifferentspeeds.Youshouldsetthetargetportspeedtomatchthespeedofthedevicetowhichitconnects.Youshouldsettheportspeedtomatchthespeedofthedeviceconnectedtotheport.Thisisinsteadofusingautonegotiation;aportsettoautonegotiationcantakelongertoreco
41、nnectafteratakeover/givebackorotherinterruption.Youshouldalsosetallportsusedbyagivenhosttothesamespeed.4-GbtargetportsYoucanconfigure4-Gbonboardportsand4-Gbexpansionadapterstorunatthefollowingspeeds.Eachcontrollerandexpansionadapterportcanbeconfiguredindividually.Thisallowsconfigurationwithadifferen
42、tspeedfromtheotherportsasneeded. 4Gb 2Gb 1Gb8-GbtargetportsYoucanconfigure8-Gbonboardportsand8-Gbexpansionadapterstorunatthefollowingspeeds.Eachcontrollerandexpansionadapterportcanbeconfiguredindividually.Thisallowsconfigurationwithadifferentspeedfromtheotherportsasneeded.8Gb4Gb2GbFibreChannelswitch
43、configurationbestpracticesAfixedlinkspeedsettingworksbest,especiallyforlargefabrics,becauseitprovidesthebestperformanceforfabricrebuilds.Inlargefabrics,fixedlinkspeedscancreatesignificanttimesavings.Althoughautonegotiationprovidesthegreatestflexibility,itdoesnotalwaysperformasexpected.Also,itaddstim
44、etotheoverallfabric-buildsequencebecausetheFCporthastoautonegotiate.AllswitchesconnectedintothefabrichavetosupportNPIVandhaveitenabled.ForFCandiSCSIbestpractices,refertoTR-4080:BestPracticesforScalableSANinClusteredDataONTAP8.2.Note:Wheresupported,itworksbesttosettheswitchporttopologytoF(point-to-po
45、int).ClusteredDataONTAPusesNPlVtopresentFibreChanneltargetstoafabric.MakesuretouseanNPlV-CapableswitchandtoenableNPlVfunctionality.Fordetailsonwhichenvironmentsaresupported,seetheonlineNetAppInteroperabilityMatrix.RelatedinformationNetAppInteroperabilityMatrix-HostmultipathingsoftwarerequirementsMul
46、tipathingsoftwareisrequiredonahostanytimeitcanaccessaLUNthroughmorethanonepath.ThemultipathingsoftwarepresentsasingledisktotheoperatingsystemforallpathstoaLUN.Withoutmultipathingsoftware,theoperatingsystemcouldtreateachpathasaseparatedisk,whichcanleadtodatacorruption.MultipathingsoftwareisalsoknownasMPIO(multipathI/O)software.Foroperatingsystemsupportformultipathingsoftware,seetheInteroperabilityMatrix.62xxsupportedfibrechannelconfigurations62xxcontrollersaresupportedinclustersofH
