As ALUA storage was being used, the following error was also reported in the messages file:
VxVM vxdmp V-5-3-1391 APM for array type ALUA is not available
During the upgrade hard links are created for the apm modules. Typically /lib is a symlink to /usr/lib, so the links can be created successfully. However on these systems /usr was a separate partition
# df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 123G 0 123G 0% /dev
tmpfs 123G 0 123G 0% /dev/shm
tmpfs 123G 29M 123G 1% /run
tmpfs 123G 0 123G 0% /sys/fs/cgroup
/dev/mapper/rhel-root 10G 202M 9.8G 2% / <<<<<<
/dev/mapper/rhel-usr 20G 5.0G 16G 25% /usr <<<<<<
/dev/mapper/rhel-opt 50G 2.6G 48G 6% /opt
...
which means that /etc and /lib will belong to different partitions and this will cause the hard link creation for the apm modules to fail with the "Invalid cross-device link" error.
The VxVM code has been modified to create symlinks rather than hardlinks.
The fix is present in the VxVM 7.3.1.3303 and VxVM 7.4.2.1902 hotfixes and will be included in the next P patches for these versions and VxVM 7.4.1