1、NetApp,AddingasecondcontrollermoduletocreateanHApairoperatinginclusteredDataONTAPUpgradingastand-alonecontrollermoduletoatwo-nodcclusterinanHApairisamultistcpprocessinvolvingbothhardwareandsoftwarechangesthatmustbeperformedintheproperorder.BeforeyoubeginAnexistingcontrollermodulemustbeinstalled,conf
2、igured,andoperatinginclusteredDataONTAP8.2.Thiscontrollermoduleisreferredtoastheexistingcontrollermodule;theexamplesinthisprocedurehavetheconsolepromptcxistingctlr.Thecontrollermodulethatisbeingaddedisreferredtoasthenewcontrollermodule;theexamplesinthisprocedurehavetheconsolepromptnewctlr.Thenewcont
3、rollermodulemustbereceivedfromNetAppaspartoftheupgradekit.ThisproceduredoesnotapplytomovingacontrollermodulefromapreexistingsystemorasystemthatwaspreviouslyinanHApair.Yoursystemmusthaveanemptyslotavailableforthenewcontrollermodulewhenupgradingtoasingle-chassisHApair(aHApairinwhichbothcontrollermodul
4、esresideinthesamechassis.Note:Thisconfigurationisnotsupportedonallsystems.Youmusthaverackspaceandcablesforthenewcontrollermodulewhenupgradingtoadual-chassisHApair(anHApairinwhichthecontrollermodulesresideinseparatechassis.Note:Thisconfigurationisnotsupportedonallsystems.Eachcontrollermodulemustbecon
5、nectedtothenetworkthroughitseaportor,ifyoursystemhasone,theeOMport.AboutthistaskThisproceduredocsnotapplytosystemsoperatingin7-Modc.Thisprocedurecantakeoveranhour,withadditionaltimeneededtoinitializethedisks.Thetimetoinitializethedisksdependsonthesizeofthedisks.Steps1. Preparingfortheupgradeonpage22
6、 PreparingtoaddacontrollermodulewhenusingStorageEncryptiononpage23. Preparingclusterportsontheexistingcontrollermoduleonpage44. Preparingthenetbootserveronpage55. SettingtheHAmodeontheexistingcontrollermoduleonpage66. Shuttingdowntheexistingcontrolleronpage67. Installingandcablingthenewcontrollermo
7、duleonpage78. NetbootingandsettingupDataONTAPonthenewcontrollermoduleonpage89. ConfiguringandcablingCNAports(FAS80xxsystemsonly)onpage1110. InstallinglicensesforthenewcontrollermoduleonpageI211. VerifyingstoragefailoveronbothcontrollermodulesandsettingclusterHAonpageI212. Installingthefirmwareaftera
8、ddingasecondcontrollermoduleonpage1313. SettingupStorageEncryptiononthenewcontrollermoduleonpage13215-07711_BOCopjighto2014NetApp,Inc.Allrightsreserved.Web:Feedback:doccommcnts14. VerifyingtheconfigurationwiththeConfigAdvisoronpage15PreparingfortheupgradeTopreparefortheupgradetoanHApair,youmustmakes
9、urethatyoursystemmeetsallrequirementsandthatyouhaveallrequiredinformat沁n.Steps1. Ensurethatyoursystemhasatleastthreeunowneddisksforthenewcontrollermodulebyenteringthefollowingcommandontheexistingcontrollermodule:storagediskshow-ownershipTwodisksarerequiredforfilesysteminstallationandthethirdisaspare
10、Thesethreeareinadditiontoasparediskfortheexistingcontrollermodule.Ifyouarcaddingdisksordiskshelvestoyoursystem,seetheDataONTAPStorageManagementGuideforyourversionofDataONTAPontheNetAppSupportSite.Note:Youmustsettheauto_assignoptiontooffontheexistingcontrollermodulebeforeaddinganynewdisks.SeetheClus
11、teredDataONTAPPhysicalStorageManagementGuideontheNetAppSupportSiteformoreinformation.2. Ensurethatyouhavecablesreadyforthefollowingconnections:,Clusterconnections.Ifyouarecreatingatwo-nodeswitchlesscluster,youwillneedtwocablestoconnectthecontrollermodules.Otherwiseyouwillneedfourcables,twoIbreachcon
12、trollermodulesconnectionstotheclusternetworkswitch.HAinterconnectconnections,ifthesystemisinadual-chassisHApair.Storageconnectionstothediskshelves.3. Ensurethatyouhaveaserialportconsoleavailableforthecontrollermodules.4. ReviewtheSiteRequirementsGuideontheNetAppSupportSiteandgatherallIPaddressesando
13、thernetworkparametersforthenewcontrollermodule.PreparingtoaddacontrollermodulewhenusingStorageEncryptionIftheexistingcontrollermoduleisconfiguredforStorageEncryption,youmustgatherinformationfromthesystemandrekeytheself-cncryptingdisks(SEDs)beforeaddingthenewcontrollermodule.AboutthistaskYoumustenter
14、thecommandsinthestepsbelowinthenodeshell.Formoreinformationaboutthenodeshell,seetheClusteredDataONTAPSystemAdministrationGuideforClusterAdministrators.Steps1. EnterthefollowingcommandandnotethekeyIDsonalldiskdrivesthatareusingStorageEncryption:diskencryptshowExampleThecommanddisplaysthestatusofeachS
15、CIACnCryPtingdisk:storage-systemdiskencryptshowDiskKeyIDLocked?Oc.00.1080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED3Yes0c.00.0080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED3YesOc.00.3 0c.00.4 0c.00.20c.00.5YesYesYesYes080CFOC8000000000100000000000000A948EEB604F4598
16、ADFFB185B5BB7FED3080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED3080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED3080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED32. Enterthefollowingcommandandnoteallthenecessarycertificatefiles(client.pern,client_privat
17、e.pem,andip_address_key_server_Ch.pern)thathavebeeninstalled:keymgrlistcert1.aterintheprocedureyouneedtoinstallthesesamecertificatefilesonthenewpartnercontrollermodule.3. EnterthefollowingcommandtoidentifytheIPaddressofthekeyservers:key_managershowAllexternalkeymanagementserversassociatedwiththestor
18、agesystemarelisted.Laterintheprocedureyouneedtoaddthesesamekeyser,ersonthenewpartnercontrollermodule.ExampleThefollowingcommanddisplaysallexternalkeymanagementserversassociatedwiththestoragesystem:storage-systemkey_managershow172.18.99.1754. EnterthefollowingcommandandcheckthatthekeyIDslistedmatchth
19、oseshownbythediskencryptshowcommandinstep1:key_managerqueryExampleThefollowingcommandchecksthestatusofallkeymanagementserverslinkedtothestoragesystemanddisplaysadditionalinformation:storage-systemkey_managerqueryKeyserver172.18.99.175reports4keys.KeytagKeyIDstorage-system080CF0C80.storage-system080C
20、F0C80.storage-system080CF0C80.storage-system080CF0C80.5. Backupalldataonallaggregatesusingstandardmethodsforyoursite.6. EnterthefollowingcommandtoresettheauthenticationkeyonthedrivesusingStorageEncryptiontotheirManufacturingSystemID(MSID):diskencryptrekeyOxO*7. ExaminetheCLlcommandoutputtoensurethat
21、therearenodiskencryptrekeyfailures.PreparingclusterportsontheexistingcontrollermoduleBeforeinstallingthenewcontrollermodule,youmustconfigureclusterportsontheexistingcontrollermodulesotheycanprovideclustercommunicationwiththenewcontrollermodule.Ifyouarecreatingatwo-nodeswitchlesscluster(withnocluster
22、networkswitches),youmustenabletheswitchless-clusternetworkingmode.AboutthistaskFordetailedinformationaboutport,LIF,andnetworkconfigurationinclusteredDataONTAP,seetheClusteredDataONTAPNetworkManagementGuideonthetheNetAppSupportSite.Steps1. Determinewhichportsshouldbeusedasthenodesclusterports.Forali
23、stofthedefaultportrolesforyourplatform,seetheHardwareU.TheInstallationandSetupInstructionsforyourplatformontheNctAppSupportSalsohaveinformationabouttheportsforclusternetworkconnections.2. Foreachclusterport,usethenetworkinterfacemodifycommandtochangethehomeportofanydataLlFsonthatporttoadataport.Exam
24、pleThisexamplechangesthehomeportofadataLIFtoadataport:Clusterl:networkinterfacemodify-Iifdatalifl-vservervsl-home-portelb3. ForeachLIFmodifiedinthepreviousstep,usethenetworkinterfacerevertcommandtorevertittoitsnewhomeport.ExampleThisexamplerevertstheLlFdatalifltoitsnewhomeportofelb:Clusterl:networki
25、nterfacerevert-Iifdatalifl-vservervsl4. Foreachportthatyouidentifiedasaclusterport,usethenetworkportmodifycommandtomodifytheroletoclusterandsettheMTUtothedefaultvalueof9000.ExampleThisexamplechangestheeladataporttoaclusterport:Clusterl:networkportmodify-nodelocal-portela-rolecluster-mtu90005. Usethe
26、networkinterfacecreatecommandtocreateclusterLIFsontheclusterports.ExampleThisexamplecreatesaclusterLIFononeofthenodesclusterports.The-autoparameterconfigurestheLIFtousealinklocalIPaddress:clusterl:networkinterfacecreate-vservermgmtl-Iifclusl-rolecluster-home-nodenodeO-home-portela-autotrue6. Ifthecl
27、usterusescluster-networkswitches,youmustusethenetworkrouting-gropsroutecommandtocreatearoutinggroup.Youcanskipthisstepifyouarecreatingatwo-nodeswitchlesscluster.ExampleThisexamplecreatesarouteintheroutinggroupc192.168.1.0/24:Clusterl:networkr。Uting-groupsroutecreate-vservermgmtl-routing-groupcl92.16
28、8.1.0/24-destination0.0.0.0/0-gateway192.168.1.17. Ifyouarccreatingatwo-nodcswitchlcsscluster,enabletheswitchlcss-clustcrnetworkingmode:a) Issuethefollowingcommandateithernodesprompttochangetotheadvancedprivilegelevel:set-privilegeadvancedYoucanrespondywhenpromptedtocontinueintoadvancedmode.Theadvan
29、cedmodepromptappears(*).b) Enableswitchless-clustermode:networkoptionsswitchless-clustermodify-enabledtruec) Issuethefollowingcommandtoreturntotheadminprivilegelevel:set-privilegeadminPreparingthenetbootserverYoumustdownloadthecorrectDataONTAPnetbootimagefromtheNetAppSupportSitetothenetbootserverand
30、knowitsIPaddress.Beforeyoubegin YoumusthaveanHTTPserverthatyoucanaccesswiththesystembeforeandafteraddingthenewcontrollermodule. YoumusthaveaccesstotheNetAppSupportS.Thisenablesyoutodownloadthenecessarysystemfiles.Aboutthistask YoumustdownloadthenecessarysystemfilesforyourplatformandversionofDataONTA
31、PfromthetheNetAppSupportS.BothcontrollermodulesintheHApairmustrunthesameversionofDataONTAP.Steps1. Downloadandextractthefileusedforperformingthenetbootofyoursystem:a) Downloadtheappropriatenetboot.tgzfileforyourplatfbnfromtheNetAppSupportSitetoaweb-accessibledirectory.b) Changetothewcb-acccssiblcdir
32、ectory.c) Extractthecontentsofthenetboot.tgzfiletothetargetdirectorybyenteringthefollowingcommand:tar-zxvfnetboot.tgzYourdirectorylistingshouldcontainthefollowingdirectory:netboot/2. Downloadtheimage.tgzfilefromtheNetAppSupportSitetotheweb-accessibledirectory.Yourdirectorylistingshouldcontainthefoll
33、owingfileanddirectory:image.tgznetboot/3. DeterminetheIPaddressoftheexistingcontrollermodule.Thisaddressisreferredtolaterinthisprocedureasip-address-of-existingcontroller.4. Pingip-address-of-existingcontrollertoensurethattheaddressisreachable.SettingtheHAmodeontheexistingcontrollermoduleYoumustuset
34、hestoragefailovermodifycommandtosetthemodetoHAontheexistingcontrollermodule.TheHAmodevalueisenabledafteryourebootthecontrollermoduleasdirectedlaterinthisprocedure.Step1. Enterthefollowingcommandfortheexistingnode:storagefailovermodify-modeha-nodeeisting-node-nameShuttingdowntheexistingcontrollerYoum
35、ustperformacleanshutdownoftheexistingcontrollertoensurethatalldatahasbeenwrittentodisk.Youmustalsodisconnectthepowersupplies.Steps2. Enterthefollowingcommandsfromtheexistingcontrollersprompt:haltlocalAfteryouissuethecommand,waituntilthesystemstopsattheLOADERprompt.Attention:Youmustperformacleansyste
36、mshutdownbeforereplacingsystemcomponentstoavoidlosingunwrittendataintheNVRAMorNVMEM:InaFAS22xxsystem,theNVMEMLEDismarkedwithabatterysymbolandislocatedonthecontrollermoduletotheleftofthelabelshowingtheMACaddress.ThisLEDblinksifthereisunwrittendataintheNVRAM.IfthisLEDisflashingredafteryouenterthehaltc
37、ommand,rebootyoursystemandtryhaltingitagain.Ina32xxsystem,theNVMEMLEDislocatedonthecontrollermoduletotherightofthenetworkports,markedwithabatterysymbol.ThisLEDblinksifthereisunwrittendataintheNVRAM.IfthisLEDisflashingredafteryouenterthehaltcommand,rebootyoursystemandtryhaltingitagain.Ina62xx,theNVME
38、MLEDislocatedonthecontrollermoduletotherightofthenetworkports,markedwithabatterysymbol.ThisLEDshowsblinksifthereisunwrittendataintheNVRAM.IfthisLEDisflashingredafteryouenterthehaltcommand,rebootyoursystemandtryhaltingitagain.InaFAS80xx,theNVMEMLEDislocatedonthecontrollermoduletotherightofthenetworkp
39、orts,markedwithabatterysymbol.ThisLEDshowsblinksifthereisunwrittendataintheNVRAM.IfthisLEDisflashinggreenafteryouenterthehaltcommand,rebootyoursystemandtryhaltingitagain.3. Ifyouarenotalreadygrounded,properlygroundyourself4. Turnoffthepowersuppliesanddisconnectthepower,usingthecorrectmethodforyoursy
40、stemandpower-supplytype:Ifyoursystemuses.Then.ACpowersuppliesUnplugthepowercordsfromthepowersource,andthenremovethepowercords.DCpowersuppliesRemovethepowerattheDCsource,andremovetheDCwires,ifnecessary.InstallingandcablingthenewcontrollermoduleYoumustphysicallyinstallthenewcontrollermoduleinthechassi
41、sandcableit.Steps1. Ifyouarenotalreadygrounded,properlygroundyourself2. IfyouhaveanI/Oexpansionmodule(IOXM)moduleinyoursystemandarccreatingasingle-chassisHApair,youmustuncableandremovetheIOXM.Youcanthenusetheemptybayforthenewcontrollermodule.However,thenewconfigurationwillnothavetheextraI/Oprovidedb
42、ytheIOXM.3. Ifyouhavea60xxsystem,movetheNVRAMadapterintheexistingcontrollertoslot1.ThisisrequiredforthesystemtooperateinanHApair.4. Physicallyinstallthenewcontrollermoduleand,ifnecessary,additionalfans:IfyouareaddingacontrollerThenperformthesesteps.module.Toanemptybaytocreateasingle-chassisHApairand
43、thesystembelongstooneofthefollowingplatforms:3Ixx 6210 6220a. Installthreeadditionalfansinthechassistocoolthenewcontrollermodule:a. Removethebezelbyusingbothhandstoholditbytheopeningsoneachside,andthenpullthebezelawayfromthechassisuntilitreleasesfromthefourballstudsonthechassisframe.b. Removetheblan
44、kplatethatcoversthebaythatwillcontainthenewfans.c. InstallthefansasdescribedintheReplacingafanmoduledocumentforyoursystemontheNetAppSupportS.b. Removetheblankplateintherearofthechassisthatcoverstheemptybaythatwillcontainthenewcontrollermodule.C,Gentlypushthecontrollermodulehalfvayintothechassis.Seel
45、hcsystemsHardwareOverviewontheNclAppSupportSforanillustration.ToanemptybaytocreateasinglechassisHApairandthesystembelongstooneofthefollowingplatforms:FAS22xx32xxFAS80xxa. Removetheblankplateintherearofthechassisthatcoverstheemptybaythatwillcontainthenewcontrollermodule.b. Gentlypushthecontrollermodu
46、lehalfvayintothechassis.Topreventthecontrollermodulefromautomaticallybooting,donotfullyseatitinthechassisuntillaterinthisprocedure.SeethesystemsHardware0ven,iewontheNetppSupportSforanillustration.InaseparatechassisfromitsHApartnertocreateadual-chassisHInstallthenewsystemintherackorsystemcabinet.pair
47、5. CabletheHAinterconnectifyouhaveadual-chassisHApair.6. ExceptfortheCNAportsandclusternetworkports,cabletheportsonthenewcontrollermodule,includingtheHAinterconnectifyouhaveadual-chassisHApair.IfthenewcontrollerhasCNAports,donotcablethemuntilyouverifytheirconfigurationasdescribedlaterinthisprocedure.Sccthesystem,sInstallationandSetupInstructions,theClusteredDataONTAPHigh-AvailabilityConfigurationGuideforyourversionofDataONTAP,and,ifapplicable,theUniversalSASandACPCablingGuide.7. Cabletheclusternetworkc
