Hi,
I noticed some strange behavior of ESXi nodes in our cluster. The cluster is self looks healthy.
We are running VMware ESXi, 6.7.0, 15160138.
But at some point, some nodes started to become unresponsive. After checking the vmkernel.log file , I saw a these entries:
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 256/256, iofiltervpd (764) childEmin/eMinLimit: 6397/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 512/512, iofiltervpd (764) childEmin/eMinLimit: 6397/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 256/256, iofiltervpd (764) childEmin/eMinLimit: 6397/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 33/33, iofiltervpd (764) childEmin/eMinLimit: 6398/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 256/256, iofiltervpd (764) childEmin/eMinLimit: 6398/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 512/512, iofiltervpd (764) childEmin/eMinLimit: 6398/6400
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 471: Admission failure in path: iofiltervpd/ioFilterVPServer.2100010/uw.2100010
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 478: UserWorld ‘ioFilterVPServer’ with cmdline ‘/usr/lib/vmware/iofilter/bin/ioFilterVPServer’
2020-10-19T02:55:46.299Z cpu36:2100010)MemSchedAdmit: 489: uw.2100010 (4538) extraMin/extraFromParent: 256/256, iofiltervpd (764) childEmin/eMinLimit: 6398/6400
So I placed the nodes in maintenance mode,no running vms and still the node become unresponsive and back up again.
Performed a reboot, same result. I’ve at least 2 nodes now in the cluster behaving this strange. But the log entry I saw on more nodes.
I found something about “iofiltervpd/ioFilterVPServer” this has something to do with the storage provider.
Does anyone have a clue, where to look or what it could be?
Thanks!