Whenever I get time to dig into the actual cause (a reboot fixed it; I do not like problems disappearing by themselves).
I got these errors:
A reboot resolved the first, which might be caused by the /bootbank
pointing to /tmp
:
[root@ESXi-X9SRI-F:~] ls -la /bootbank lrwxrwxrwx 1 root root 4 May 20 08:44 /bootbank -> /tmp [root@ESXi-X9SRI-F:~] ls -la /tmp total 36 drwxrwxrwt 1 root root 512 Jun 23 06:13 . drwxr-xr-x 1 root root 512 Jun 17 13:13 .. -rw------- 1 root root 40 Jun 23 06:15 probe.session -rw-r--r-- 1 root root 14188 Jun 23 06:01 state.tgz drwx------ 1 root root 512 Jun 23 04:44 vmware-root [root@ESXi-X9SRI-F:~] ls -la /tmp/vmware-root/ total 8 drwx------ 1 root root 512 Jun 23 04:44 . drwxrwxrwt 1 root root 512 Jun 23 06:13 .. [root@ESXi-X9SRI-F:~] cd ..
Normally, this points to a valid filesystem:
[root@ESXi-X9SRI-F:~] ls -la /bootbank lrwxrwxrwx 1 root root 49 Jun 23 06:29 /bootbank -> /vmfs/volumes/69ab34ee-f2e2bd4a-e013-a62e6975b9e7 [root@ESXi-X9SRI-F:~] du -h `readlink /bootbank` 146.7M /vmfs/volumes/69ab34ee-f2e2bd4a-e013-a62e6975b9e7
Research links
Cannot be live installed
: finding boot device (in practice adf -h
is easier if you just have one USB stick to boot from)No space left on device
(combined in the above search with “ESXi” and “profile update”)- [WayBack] ESXI 6.7 profile update: No space left on device
:aligrant.com
- [WayBack] Fresh ESXi 6.7 install; Error 28 No space left issue during latest update | ServeTheHome and ServeThe.Biz Forums
- [WayBack] ESXi/ESX error: No free space left on device
- [WayBack] Solved: Vmware Esxi Update No Space Left On Dev… |VMware Communities
- [WayBack] Solved: Failing while doing Esx 6.5 patch updat… |VMware Communities
- [WayBack] VMWARE: Cannot update host with ESXCLI due to error OSError: [Errno 28] No space left on device – martinsblog.dk (choose a non-USB SWAP device)
- [WayBack] ESXI 6.7 profile update: No space left on device
This was while applying patches using the [WayBack] VMware ESXi 6.7.0 Patch History pop-ups:
- ESXi-6.7.0-20190604001-standard
# Cut and paste these commands into an ESXi shell to update your host with this Imageprofile # See the Help page for more instructions # esxcli network firewall ruleset set -e true -r httpClient esxcli software profile update -p ESXi-6.7.0-20190604001-standard \ -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml esxcli network firewall ruleset set -e false -r httpClient # # Reboot to complete the upgrade
- ESXi-6.7.0-20190504001-standard
# Cut and paste these commands into an ESXi shell to update your host with this Imageprofile # See the Help page for more instructions # esxcli network firewall ruleset set -e true -r httpClient esxcli software profile update -p ESXi-6.7.0-20190504001-standard \ -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml esxcli network firewall ruleset set -e false -r httpClient # # Reboot to complete the upgrade
The swap settings were exactly the same:
- Working
- Failing
The USB devices were the same too:
- Working
- Failing
The failing system had even more partition space than the working system:
Working Failing
So was quite baffled that pointing the swap space pointing to a datastore solved the problem:
- Working
- Working too
You can also request this from the shell (via [WayBack] VMware vSphere 5.1):
[root@ESXi-X9SRI-F:~] esxcli sched swap system get
Datastore Active: true
Datastore Enabled: true
Datastore Name: QVO860_960GB
Datastore Order: 1
Hostcache Active: false
Hostcache Enabled: true
Hostcache Order: 0
Hostlocalswap Active: false
Hostlocalswap Enabled: true
Hostlocalswap Order: 2
Empty bootbank
Quoted in full as it cannot be archived in the WayBack machine nor Archive.is: Bootbanks mounts to /tmp folder and configuration changes are lost after rebooting of ESXi 6.0 Server (2148321)
Last Updated: 1/31/2019Categories: TroubleshootingSymptoms
- Configuration changes on the ESXi is lost after rebooting the server.
- Bootbank and altbootbank points to /tmp folder instead of pointing to the ESXi installed partition (this can be confirmed by running ls -l on root (“/”) folder)
Cause
This issue happens if there is a delay in Fabric Login during the ESXi Boot process. By default, there is 3 Second timeout for Fabric login.If Fabric Login takes more than 3 seconds, claiming the devices and discovering the LUNs happens parallelly and some LUNs will not be claimed on time during the boot process. If the boot LUN is not claimed before mounting the bootbank, ESXi boot process will mount bootbank and altbootbank to /tmp.Resolution
VMware introduced a new boot configuration parameter on ESXi 6.0 Patch 4 to handle the delay in Fabric logins.
To resolve this issue, follow the steps:
- To mount the bootbank to proper LUN, run this command on ESXi:
localcli –plugin-dir=/usr/lib/vmware/esxcli/int/ boot system restore –bootbanks- Upgrade ESXi to Patch 4 (Build number 4600944) available VMware Downloads.
- Connect to the Server KVM Console.
- During the ESXi boot process, press Shift+O and append the boot parameter devListStabilityCount=10 (its 10 Seconds, can be different value depending on flogi delay in the environment).
- After the boot process, append the devListStabilityCount=10 entry in the /bootbank/boot.cfg file.Note: This step is to ensure that change is persistent.
Related Information
Following log from ESXi boot, HBA Link is UP and it took more than 3 seconds for the Fabric login completion (flogi succeeded) and Claim rules are enabled after 3rd Second :2016-05-13T11:07:45.610Z cpu24:33363)<7>fnic : 1 :: link up2016-05-13T11:07:45.610Z cpu24:33363)<6>host1: libfc: Link up on port ( 0)2016-05-13T11:07:45.752Z cpu15:33365)<7>fnic : 2 :: link up2016-05-13T11:07:45.752Z cpu15:33365)<6>host2: libfc: Link up on port ( 0)2016-05-13T11:07:46.754Z cpu0:33369)<6>usb 1-1: suspended2016-05-13T11:07:46.754Z cpu0:33369)<6>usb 1-1: suspended2016-05-13T11:07:48.019Z cpu0:33315)ScsiClaimrule: 2463: Enabling claimrules for MPplugins.2016-05-13T11:07:49.465Z cpu0:33351)<6>usb usb1: suspended2016-05-13T11:07:49.465Z cpu0:33351)<6>usb usb1: suspended2016-05-13T11:07:49.620Z cpu26:33353)<6>host1: Assigned Port ID 163692016-05-13T11:07:49.620Z cpu26:33353)<7>fnic : 1 :: set port_id 16369 fp 0x439e41ccebc82016-05-13T11:07:49.620Z cpu26:33353)<6>host1: fip: received FLOGI LS_ACC using non-FIP mode2016-05-13T11:07:49.620Z cpu26:33353)<7>fnic : 1 :: update_mac 0x439e41ccec41M2016-05-13T11:07:49.620Z cpu26:33353)<7>fnic : 1 :: FLOGI reg issued fcid 16369 map 0 dest 0x43915249bcfaM2016-05-13T11:07:49.622Z cpu11:33158)<7>fnic : 1 :: flog reg succeededNote: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.
—jeroen
Somehow the USB boot device had disappeared cannot be live installed
:
[root@ESXi-X9SRI-F:~] esxcli software profile update -p ESXi-6.7.0-20190604001-standard \
> -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml
[StatelessError]
The transaction is not supported: VIB VMW_bootbank_misc-drivers_6.7.0-2.48.13006603 cannot be live installed. VIB VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-9vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_ixgben_1.4.1-18vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_lsi-msgpt3_17.00.01.00-3vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_lsi-msgpt2_20.00.05.00-1vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_lsu-lsi-drivers-plugin_1.0.0-1vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nfnic_4.0.0.17-0vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_i40en_1.3.1-23vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nvme_1.2.2.27-1vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_ne1000_0.8.4-2vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nmlx4-core_3.17.13.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nmlx4-rdma_3.17.13.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_qlnativefc_3.1.8.0-4vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_brcmfcoe_11.4.1078.19-12vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nmlx5-rdma_4.17.13.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nmlx4-en_3.17.13.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_esx-update_6.7.0-2.60.13981272 cannot be live installed. VIB VMW_bootbank_vmkusb_0.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_esx-base_6.7.0-2.60.13981272 cannot be live installed. VIB VMware_bootbank_elx-esx-libelxima.so_11.4.1184.1-2.48.13006603 cannot be live installed. VIB VMW_bootbank_lsi-msgpt35_09.00.00.00-1vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_cpu-microcode_6.7.0-2.55.13644319 cannot be live installed. VIB VMware_bootbank_vsan_6.7.0-2.60.13805960 cannot be live installed. VIB VMW_bootbank_lsi-mr3_7.708.07.00-2vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_igbn_0.1.1.0-4vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_nmlx5-core_4.17.13.1-1vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_bnxtnet_20.6.101.7-21vmw.670.2.48.13006603 cannot be live installed. VIB VMW_bootbank_lpfc_11.4.33.18-12vmw.670.2.48.13006603 cannot be live installed. VIB VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-8vmw.670.0.0.8169922 cannot be removed live. VIB VMware_bootbank_elx-esx-libelxima.so_11.4.1184.0-0.0.8169922 cannot be removed live. VIB VMW_bootbank_nmlx5-rdma_4.17.9.12-1vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_nmlx5-core_4.17.9.12-1vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_nvme_1.2.2.17-1vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_lsi-msgpt3_16.00.01.00-3vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_lsi-msgpt2_20.00.04.00-5vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_ixgben_1.4.1-16vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_nfnic_4.0.0.14-0vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_bnxtnet_20.6.101.7-11vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_nmlx4-en_3.17.9.12-1vmw.670.0.0.8169922 cannot be removed live. VIB VMware_bootbank_esx-update_6.7.0-1.28.10302608 cannot be removed live. VIB VMW_bootbank_i40en_1.3.1-22vmw.670.1.28.10302608 cannot be removed live. VIB VMware_bootbank_esx-base_6.7.0-1.28.10302608 cannot be removed live. VIB VMW_bootbank_ne1000_0.8.4-1vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_nmlx4-core_3.17.9.12-1vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_nmlx4-rdma_3.17.9.12-1vmw.670.0.0.8169922 cannot be removed live. VIB VMware_bootbank_native-misc-drivers_6.7.0-0.0.8169922 cannot be removed live. VIB VMW_bootbank_lsi-msgpt35_03.00.01.00-12vmw.670.1.28.10302608 cannot be removed live. VIB VMware_bootbank_cpu-microcode_6.7.0-1.28.10302608 cannot be removed live. VIB VMW_bootbank_brcmfcoe_11.4.1078.5-11vmw.670.1.28.10302608 cannot be removed live. VIB VMW_bootbank_igbn_0.1.0.0-15vmw.670.0.0.8169922 cannot be removed live. VIB VMW_bootbank_misc-drivers_6.7.0-0.0.8169922 cannot be removed live. VIB VMW_bootbank_lsi-mr3_7.702.13.00-5vmw.670.1.28.10302608 cannot be removed live. VIB VMware_bootbank_qlnativefc_3.0.1.0-5vmw.670.0.0.8169922 cannot be removed live. VIB VMware_bootbank_vsan_6.7.0-1.28.10290435 cannot be removed live. VIB VMW_bootbank_lpfc_11.4.33.3-11vmw.670.1.28.10302608 cannot be removed live.
Please refer to the log file for more details.
[root@ESXi-X9SRI-F:~]
[root@ESXi-X9SRI-F:~] df -h
Filesystem Size Used Available Use% Mounted on
VMFS-6 465.5G 70.4G 395.1G 15% /vmfs/volumes/EVO860_500GB
VMFS-6 931.2G 237.9G 693.4G 26% /vmfs/volumes/QVO860_960GB
After a reboot, the USB is there, but still not enough room No space left on device
:
[root@ESXi-X9SRI-F:~]
[root@ESXi-X9SRI-F:~] esxcli software profile update -p ESXi-6.7.0-20190604001-standard \
> -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-index.xml
[InstallationError]
[Errno 28] No space left on device
vibs = VMware_locker_tools-light_10.3.5.10430147-12986307
Please refer to the log file for more details.
[root@ESXi-X9SRI-F:~] df -h
Filesystem Size Used Available Use% Mounted on
VMFS-6 465.5G 70.4G 395.1G 15% /vmfs/volumes/EVO860_500GB
VMFS-6 931.2G 237.9G 693.4G 26% /vmfs/volumes/QVO860_960GB
vfat 249.7M 146.7M 103.0M 59% /vmfs/volumes/69ab34ee-f2e2bd4a-e013-a62e6975b9e7
vfat 249.7M 4.0K 249.7M 0% /vmfs/volumes/7a4993e5-424d872e-2f65-ab5b598caf77
vfat 285.8M 200.0K 285.6M 0% /vmfs/volumes/5c9a6e4f-a0e61648-2a89-0025907d9d5c
[root@ESXi-X9SRI-F:~]
Finally it worked: I had to point the (already enabled SWAP) to a datastore.
[root@ESXi-X9SRI-F:~] esxcli sched swap system get
Datastore Active: true
Datastore Enabled: true
Datastore Name: QVO860_960GB
Datastore Order: 1
Hostcache Active: false
Hostcache Enabled: true
Hostcache Order: 0
Hostlocalswap Active: false
Hostlocalswap Enabled: true
Hostlocalswap Order: 2
[root@ESXi-X9SRI-F:~] esxcli software profile update -p ESXi-6.7.0-20190604001-standard -d https://hostupdate.vmware.com/software/VUM/PRODUCTION/main/vmw-depot-
index.xml
Update Result
Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
Reboot Required: true
VIBs Installed: VMW_bootbank_bnxtnet_20.6.101.7-21vmw.670.2.48.13006603, VMW_bootbank_brcmfcoe_11.4.1078.19-12vmw.670.2.48.13006603, VMW_bootbank_i40en_1.3.1-23vmw.670.2.48.13006603, VMW_bootbank_igbn_0.1.1.0-4vmw.670.2.48.13006603, VMW_bootbank_ixgben_1.4.1-18vmw.670.2.48.13006603, VMW_bootbank_lpfc_11.4.33.18-12vmw.670.2.48.13006603, VMW_bootbank_lsi-mr3_7.708.07.00-2vmw.670.2.48.13006603, VMW_bootbank_lsi-msgpt2_20.00.05.00-1vmw.670.2.48.13006603, VMW_bootbank_lsi-msgpt35_09.00.00.00-1vmw.670.2.48.13006603, VMW_bootbank_lsi-msgpt3_17.00.01.00-3vmw.670.2.48.13006603, VMW_bootbank_misc-drivers_6.7.0-2.48.13006603, VMW_bootbank_ne1000_0.8.4-2vmw.670.2.48.13006603, VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.670.2.48.13006603, VMW_bootbank_nfnic_4.0.0.17-0vmw.670.2.48.13006603, VMW_bootbank_nmlx4-core_3.17.13.1-1vmw.670.2.48.13006603, VMW_bootbank_nmlx4-en_3.17.13.1-1vmw.670.2.48.13006603, VMW_bootbank_nmlx4-rdma_3.17.13.1-1vmw.670.2.48.13006603, VMW_bootbank_nmlx5-core_4.17.13.1-1vmw.670.2.48.13006603, VMW_bootbank_nmlx5-rdma_4.17.13.1-1vmw.670.2.48.13006603, VMW_bootbank_nvme_1.2.2.27-1vmw.670.2.48.13006603, VMW_bootbank_sfvmk_1.0.0.1003-6vmw.670.2.48.13006603, VMW_bootbank_vmkusb_0.1-1vmw.670.2.48.13006603, VMware_bootbank_cpu-microcode_6.7.0-2.55.13644319, VMware_bootbank_elx-esx-libelxima.so_11.4.1184.1-2.48.13006603, VMware_bootbank_esx-base_6.7.0-2.60.13981272, VMware_bootbank_esx-ui_1.33.3-13454473, VMware_bootbank_esx-update_6.7.0-2.60.13981272, VMware_bootbank_lsu-lsi-drivers-plugin_1.0.0-1vmw.670.2.48.13006603, VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-9vmw.670.2.48.13006603, VMware_bootbank_native-misc-drivers_6.7.0-2.48.13006603, VMware_bootbank_qlnativefc_3.1.8.0-4vmw.670.2.48.13006603, VMware_bootbank_vmware-esx-esxcli-nvme-plugin_1.2.0.36-2.48.13006603, VMware_bootbank_vsan_6.7.0-2.60.13805960, VMware_bootbank_vsanhealth_6.7.0-2.60.13805961, VMware_locker_tools-light_10.3.5.10430147-12986307
VIBs Removed: VMW_bootbank_bnxtnet_20.6.101.7-11vmw.670.0.0.8169922, VMW_bootbank_brcmfcoe_11.4.1078.5-11vmw.670.1.28.10302608, VMW_bootbank_i40en_1.3.1-22vmw.670.1.28.10302608, VMW_bootbank_igbn_0.1.0.0-15vmw.670.0.0.8169922, VMW_bootbank_ixgben_1.4.1-16vmw.670.1.28.10302608, VMW_bootbank_lpfc_11.4.33.3-11vmw.670.1.28.10302608, VMW_bootbank_lsi-mr3_7.702.13.00-5vmw.670.1.28.10302608, VMW_bootbank_lsi-msgpt2_20.00.04.00-5vmw.670.1.28.10302608, VMW_bootbank_lsi-msgpt35_03.00.01.00-12vmw.670.1.28.10302608, VMW_bootbank_lsi-msgpt3_16.00.01.00-3vmw.670.1.28.10302608, VMW_bootbank_misc-drivers_6.7.0-0.0.8169922, VMW_bootbank_ne1000_0.8.4-1vmw.670.1.28.10302608, VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.670.0.0.8169922, VMW_bootbank_nfnic_4.0.0.14-0vmw.670.1.28.10302608, VMW_bootbank_nmlx4-core_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx4-en_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx4-rdma_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx5-core_4.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx5-rdma_4.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nvme_1.2.2.17-1vmw.670.1.28.10302608, VMW_bootbank_vmkusb_0.1-1vmw.670.1.28.10302608, VMware_bootbank_cpu-microcode_6.7.0-1.28.10302608, VMware_bootbank_elx-esx-libelxima.so_11.4.1184.0-0.0.8169922, VMware_bootbank_esx-base_6.7.0-1.28.10302608, VMware_bootbank_esx-ui_1.30.0-9946814, VMware_bootbank_esx-update_6.7.0-1.28.10302608, VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-8vmw.670.0.0.8169922, VMware_bootbank_native-misc-drivers_6.7.0-0.0.8169922, VMware_bootbank_qlnativefc_3.0.1.0-5vmw.670.0.0.8169922, VMware_bootbank_vmware-esx-esxcli-nvme-plugin_1.2.0.34-1.28.10302608, VMware_bootbank_vsan_6.7.0-1.28.10290435, VMware_bootbank_vsanhealth_6.7.0-1.28.10290721, VMware_locker_tools-light_10.3.2.9925305-10176879
VIBs Skipped: VMW_bootbank_ata-libata-92_3.00.9.2-16vmw.670.0.0.8169922, VMW_bootbank_ata-pata-amd_0.3.10-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-atiixp_0.4.6-4vmw.670.0.0.8169922, VMW_bootbank_ata-pata-cmd64x_0.2.5-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-hpt3x2n_0.3.4-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-pdc2027x_1.0-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-serverworks_0.4.3-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-sil680_0.4.8-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-via_0.3.3-2vmw.670.0.0.8169922, VMW_bootbank_block-cciss_3.6.14-10vmw.670.0.0.8169922, VMW_bootbank_bnxtroce_20.6.101.0-20vmw.670.1.28.10302608, VMW_bootbank_char-random_1.0-3vmw.670.0.0.8169922, VMW_bootbank_ehci-ehci-hcd_1.0-4vmw.670.0.0.8169922, VMW_bootbank_elxiscsi_11.4.1174.0-2vmw.670.0.0.8169922, VMW_bootbank_elxnet_11.4.1095.0-5vmw.670.1.28.10302608, VMW_bootbank_hid-hid_1.0-3vmw.670.0.0.8169922, VMW_bootbank_iavmd_1.2.0.1011-2vmw.670.0.0.8169922, VMW_bootbank_ima-qla4xxx_2.02.18-1vmw.670.0.0.8169922, VMW_bootbank_ipmi-ipmi-devintf_39.1-5vmw.670.1.28.10302608, VMW_bootbank_ipmi-ipmi-msghandler_39.1-5vmw.670.1.28.10302608, VMW_bootbank_ipmi-ipmi-si-drv_39.1-5vmw.670.1.28.10302608, VMW_bootbank_iser_1.0.0.0-1vmw.670.1.28.10302608, VMW_bootbank_lpnic_11.4.59.0-1vmw.670.0.0.8169922, VMW_bootbank_misc-cnic-register_1.78.75.v60.7-1vmw.670.0.0.8169922, VMW_bootbank_mtip32xx-native_3.9.8-1vmw.670.1.28.10302608, VMW_bootbank_nenic_1.0.21.0-1vmw.670.1.28.10302608, VMW_bootbank_net-bnx2_2.2.4f.v60.10-2vmw.670.0.0.8169922, VMW_bootbank_net-bnx2x_1.78.80.v60.12-2vmw.670.0.0.8169922, VMW_bootbank_net-cdc-ether_1.0-3vmw.670.0.0.8169922, VMW_bootbank_net-cnic_1.78.76.v60.13-2vmw.670.0.0.8169922, VMW_bootbank_net-e1000_8.0.3.1-5vmw.670.0.0.8169922, VMW_bootbank_net-e1000e_3.2.2.1-2vmw.670.0.0.8169922, VMW_bootbank_net-enic_2.1.2.38-2vmw.670.0.0.8169922, VMW_bootbank_net-fcoe_1.0.29.9.3-7vmw.670.0.0.8169922, VMW_bootbank_net-forcedeth_0.61-2vmw.670.0.0.8169922, VMW_bootbank_net-igb_5.0.5.1.1-5vmw.670.0.0.8169922, VMW_bootbank_net-ixgbe_3.7.13.7.14iov-20vmw.670.0.0.8169922, VMW_bootbank_net-libfcoe-92_1.0.24.9.4-8vmw.670.0.0.8169922, VMW_bootbank_net-mlx4-core_1.9.7.0-1vmw.670.0.0.8169922, VMW_bootbank_net-mlx4-en_1.9.7.0-1vmw.670.0.0.8169922, VMW_bootbank_net-nx-nic_5.0.621-5vmw.670.0.0.8169922, VMW_bootbank_net-tg3_3.131d.v60.4-2vmw.670.0.0.8169922, VMW_bootbank_net-usbnet_1.0-3vmw.670.0.0.8169922, VMW_bootbank_nhpsa_2.0.22-3vmw.670.1.28.10302608, VMW_bootbank_ntg3_4.1.3.2-1vmw.670.1.28.10302608, VMW_bootbank_nvmxnet3-ens_2.0.0.21-1vmw.670.0.0.8169922, VMW_bootbank_nvmxnet3_2.0.0.29-1vmw.670.1.28.10302608, VMW_bootbank_ohci-usb-ohci_1.0-3vmw.670.0.0.8169922, VMW_bootbank_pvscsi_0.1-2vmw.670.0.0.8169922, VMW_bootbank_qcnic_1.0.2.0.4-1vmw.670.0.0.8169922, VMW_bootbank_qedentv_2.0.6.4-10vmw.670.1.28.10302608, VMW_bootbank_qfle3_1.0.50.11-9vmw.670.0.0.8169922, VMW_bootbank_qfle3f_1.0.25.0.2-14vmw.670.0.0.8169922, VMW_bootbank_qfle3i_1.0.2.3.9-3vmw.670.0.0.8169922, VMW_bootbank_qflge_1.1.0.11-1vmw.670.0.0.8169922, VMW_bootbank_sata-ahci_3.0-26vmw.670.0.0.8169922, VMW_bootbank_sata-ata-piix_2.12-10vmw.670.0.0.8169922, VMW_bootbank_sata-sata-nv_3.5-4vmw.670.0.0.8169922, VMW_bootbank_sata-sata-promise_2.12-3vmw.670.0.0.8169922, VMW_bootbank_sata-sata-sil24_1.1-1vmw.670.0.0.8169922, VMW_bootbank_sata-sata-sil_2.3-4vmw.670.0.0.8169922, VMW_bootbank_sata-sata-svw_2.3-3vmw.670.0.0.8169922, VMW_bootbank_scsi-aacraid_1.1.5.1-9vmw.670.0.0.8169922, VMW_bootbank_scsi-adp94xx_1.0.8.12-6vmw.670.0.0.8169922, VMW_bootbank_scsi-aic79xx_3.1-6vmw.670.0.0.8169922, VMW_bootbank_scsi-bnx2fc_1.78.78.v60.8-1vmw.670.0.0.8169922, VMW_bootbank_scsi-bnx2i_2.78.76.v60.8-1vmw.670.0.0.8169922, VMW_bootbank_scsi-fnic_1.5.0.45-3vmw.670.0.0.8169922, VMW_bootbank_scsi-hpsa_6.0.0.84-3vmw.670.0.0.8169922, VMW_bootbank_scsi-ips_7.12.05-4vmw.670.0.0.8169922, VMW_bootbank_scsi-iscsi-linux-92_1.0.0.2-3vmw.670.0.0.8169922, VMW_bootbank_scsi-libfc-92_1.0.40.9.3-5vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid-mbox_2.20.5.1-6vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid-sas_6.603.55.00-2vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid2_2.00.4-9vmw.670.0.0.8169922, VMW_bootbank_scsi-mpt2sas_19.00.00.00-2vmw.670.0.0.8169922, VMW_bootbank_scsi-mptsas_4.23.01.00-10vmw.670.0.0.8169922, VMW_bootbank_scsi-mptspi_4.23.01.00-10vmw.670.0.0.8169922, VMW_bootbank_scsi-qla4xxx_5.01.03.2-7vmw.670.0.0.8169922, VMW_bootbank_shim-iscsi-linux-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-iscsi-linux-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libata-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libata-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfc-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfc-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfcoe-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfcoe-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-3-0_6.7.0-0.0.8169922, VMW_bootbank_smartpqi_1.0.1.553-12vmw.670.1.28.10302608, VMW_bootbank_uhci-usb-uhci_1.0-3vmw.670.0.0.8169922, VMW_bootbank_usb-storage-usb-storage_1.0-3vmw.670.0.0.8169922, VMW_bootbank_usbcore-usb_1.0-3vmw.670.0.0.8169922, VMW_bootbank_vmkata_0.1-1vmw.670.0.0.8169922, VMW_bootbank_vmkfcoe_1.0.0.1-1vmw.670.1.28.10302608, VMW_bootbank_vmkplexer-vmkplexer_6.7.0-0.0.8169922, VMW_bootbank_vmw-ahci_1.2.3-1vmw.670.1.28.10302608, VMW_bootbank_xhci-xhci_1.0-3vmw.670.0.0.8169922, VMware_bootbank_esx-dvfilter-generic-fastpath_6.7.0-0.0.8169922, VMware_bootbank_esx-xserver_6.7.0-0.0.8169922, VMware_bootbank_lsu-hp-hpsa-plugin_2.0.0-16vmw.670.1.28.10302608, VMware_bootbank_lsu-intel-vmd-plugin_1.0.0-2vmw.670.1.28.10302608, VMware_bootbank_lsu-lsi-lsi-mr3-plugin_1.0.0-13vmw.670.1.28.10302608, VMware_bootbank_lsu-lsi-megaraid-sas-plugin_1.0.0-9vmw.670.0.0.8169922, VMware_bootbank_lsu-lsi-mpt2sas-plugin_2.0.0-7vmw.670.0.0.8169922, VMware_bootbank_lsu-smartpqi-plugin_1.0.0-3vmw.670.1.28.10302608, VMware_bootbank_rste_2.0.2.0088-7vmw.670.0.0.8169922
[root@ESXi-X9SRI-F:~] reboot