vSAN环境RAID卡固件升级
由于海花岛屿环境目前未投入生产，本次目标为一次性升级内外网共13台vSAN主机的RAID SAS3416 Controller固件
以下为升级过程。
升级之前注意事项
首先从 vCenter 转到 “vSAN 运行状况‘对象运行状况’”检查，确保没有不可访问的对象。
或者SSH登录群集中任意一台ESXi主机运行 “esxcli vsan debug object health summary get"
然后，请执行以下操作：
- 关闭在 VSAN 群集上运行的所有虚拟机
通过以下方法之一将所有节点置于维护模式：
通过 Web Client 直接连接到每个节点 > 右键单击节点 > 进入维护模式且不执行任何操作
- 从每个节点的 CLI 运行 esxcli system maintenanceMode set -e true -m noAction
* 提前把固件下载并上传至共享Datastore, 示例为NFS目录
先升级其中一台主机
升级一台主机，以检验升级是否成功，重启之后能够看到硬盘组件等工作正常。
通过SSH登录ESXi执行以下命令
## time /opt/lsi/storcli/storcli /c0 download file=/vmfs/volumes/NFS/xxx-SAS3416-xxx.rom && reboot time /opt/lsi/storcli/storcli /c0 download file=/vmfs/volumes/hhdvsanDatastore-DMZ01/Firmware-Driver-Upgrade-stuff/HuaWei_SAS3416_nopad.rom [root@ESXP-D18U04-DMZ-01:/vmfs/volumes/vsan:5261ecb6e94485d0-349c730b617155b0/da20645f-d0c4-2108-b33f-c4447d851238] time /opt/lsi/storcli/storcli /c0 show Generating detailed summary of the adapter, it may take a while to complete. CLI Version = 007.1316.0000.0000 Mar 12, 2020 Operating system = VMkernel 6.7.0 Controller = 0 Status = Success Description = None Product Name = SAS3416 Serial Number = 025KML10L1000974 SAS Address = 560d75556a394000 PCI Address = 00:1c:00:00 System Time = 09/18/2020 03:29:18 Mfg. Date = 00/00/00 Controller Time = 09/18/2020 03:30:33 FW Package Build = 50.3.0-1025 BIOS Version = 7.03.02.1_4.17.08.00_0x07030402 FW Version = 5.030.01-1218 Driver Name = lsi-mr3 Driver Version = 7.703.13.00 Current Personality = RAID-Mode Vendor Id = 0x1000 Device Id = 0x15 SubVendor Id = 0x19E5 SubDevice Id = 0xD214 Host Interface = PCI-E Device Interface = SAS-12G Bus Number = 28 Device Number = 0 Function Number = 0 Domain ID = 0 JBOD Drives = 8 JBOD LIST : ========= ---------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ---------------------------------------------------------------------------- 69:2 5 JBOD - 1.455 TB SAS SSD N N 512B HWE52SS31T6M002N U - 69:3 2 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:4 3 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:5 0 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:6 4 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:7 1 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:8 6 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:9 7 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - ---------------------------------------------------------------------------- ID=JBOD Target ID|EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|Onln=Online| Offln=Offline|Intf=Interface|Med=Media Type|SeSz=Sector Size Physical Drives = 8 PD LIST : ======= ---------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ---------------------------------------------------------------------------- 69:2 5 JBOD - 1.455 TB SAS SSD N N 512B HWE52SS31T6M002N U - 69:3 2 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:4 3 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:5 0 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:6 4 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:7 1 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:8 6 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - 69:9 7 JBOD - 2.910 TB SAS SSD N N 512B HWE52SS33T2M002N U - ---------------------------------------------------------------------------- EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|DG=DriveGroup DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded UBUnsp=UBad Unsupported|Rbld=Rebuild Enclosures = 1 Enclosure LIST : ============== -------------------------------------------------------------------- EID State Slots PD PS Fans TSs Alms SIM Port# ProdID VendorSpecific -------------------------------------------------------------------- 69 OK 16 8 0 0 0 0 1 - SGPIO -------------------------------------------------------------------- EID=Enclosure Device ID |PD=Physical drive count |PS=Power Supply count|
# time esxcli software vib install -d /vmfs/volumes/hhdvsanDatastore-DMZ01/Firmware-Driver-Upgrade-stuff/RAID-3408iMR_3416iMR-ESXi6.5-lsi_mr3-7.713.0 7.00-offline_bundle-x86_64.zip Installation Result
- Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective. Reboot Required: true VIBs Installed: BCM_bootbank_lsi-mr3_7.713.07.00-1OEM.650.0.0.4598673 VIBs Removed: Avago_bootbank_lsi-mr3_7.703.13.00-1OEM.650.0.0.4598673 VIBs Skipped:
real 0m 16.97s user 0m 0.31s sys 0m 0.00s }}}
重启之后如无问题，则可执行同时升级剩下的12个节点RAID Controller的操作
同时升级 RAID Controller Firmware
通过mobaXterm或类似工具同时登录12台vSAN主机，开启MultiExec模式，执行如下命令
time /opt/lsi/storcli/storcli /c0 download file=/tmp/HuaWei_SAS3416_nopad.rom time esxcli software vib install -d /tmp/RAID-3408iMR_3416iMR-ESXi6.5-lsi_mr3-7.713.07.00-offline_bundle-x86_64.zip
检查升级后的版本
- by iBMC
ipmcget -t storage -d ctrlinfo -v 0
- by ESXi Cli
storcli /c0 show Generating detailed summary of the adapter, it may take a while to complete. CLI Version = 007.1316.0000.0000 Mar 12, 2020 Operating system = VMkernel 6.7.0 Controller = 0 Status = Success Description = None Product Name = SAS3416 Serial Number = 025KML10L1000974 SAS Address = 560d75556a394000 PCI Address = 00:1c:00:00 System Time = 09/18/2020 03:45:51 Mfg. Date = 00/00/00 Controller Time = 09/18/2020 03:45:50 FW Package Build = 50.6.3-0109 BIOS Version = 7.06.02.2_0x07060502 FW Version = 5.060.01-2262 Driver Name = lsi-mr3 Driver Version = 7.713.07.00 Vendor Id = 0x1000 Device Id = 0x15 SubVendor Id = 0x19E5 SubDevice Id = 0xD214 Host Interface = PCI-E Device Interface = SAS-12G Bus Number = 28 Device Number = 0 Function Number = 0 Domain ID = 0 JBOD Drives = 8 # esxcli vsan debug controller list [root@ESXP-D18U04-DMZ-01:~] esxcli vsan debug controller list Device Name: vmhba1 Device Display Name: Intel Corporation Lewisburg SATA AHCI Controller Used By VSAN: false PCI ID: 8086/a1d2/8086/7270 Driver Name: vmw_ahci Driver Version: 1.2.8-1vmw.670.3.73.14320388 Max Supported Queue Depth: 992 Firmware Version: N/A Device Name: vmhba0 Device Display Name: Intel Corporation Lewisburg SATA AHCI Controller Used By VSAN: false PCI ID: 8086/a182/8086/7270 Driver Name: vmw_ahci Driver Version: 1.2.8-1vmw.670.3.73.14320388 Max Supported Queue Depth: 992 Firmware Version: N/A Device Name: vmhba3 Device Display Name: Broadcom MegaRAID Tri-Mode SAS3508 Used By VSAN: false PCI ID: 1000/0016/19e5/d215 Driver Name: lsi_mr3 Driver Version: 7.713.07.00-1OEM.650.0.0.4598673 Max Supported Queue Depth: 4065 Firmware Version: 5.060.00-2262 Device Name: vmhba2 Device Display Name: Broadcom MegaRAID Tri-Mode SAS3416 Used By VSAN: true PCI ID: 1000/0015/19e5/d214 Driver Name: lsi_mr3 Driver Version: 7.713.07.00-1OEM.650.0.0.4598673 Max Supported Queue Depth: 1505 Firmware Version: 5.060.01-2262
如无问题，则准备执行退出维护模式操作。
检查vSAN集群状态
使用以下选项之一连接到每个 ESXi 主机并退出维护模式：
- 使用vCenter Web Client
- 从 ESXi shell 使用以下命令：esxcli system maintenanceMode set -e false
然后从 vCenter 转到 “vSAN 运行状况”，检查是否有异常。
- 如无异常，打开 vSAN 群集中其余虚拟机的电源即可。