CPI Enhancement: When performing Veritas PHASED upgrades users may forget to rename the /etc/llttab.save back to /etc/llttab
Article ID: 100050793
Updated On:
Description
Description
When performing Veritas Phased Upgrades, users are advised to rename the /etc/llttab file to /etc/llttab.save to prevent VCS LLT services from starting at boot-time.
If the user forgets to rename to rename the /etc/llttab.save file back to /etc/llttab, the incorrect product component maybe identified by the CPI installer, preventing the /etc/VRTSvcs/conf/config/types.cf file from being updated.
Veritas Cluster Server (VCS) has many upgrade paths available via the CPI installer framework.
If you are on an unsupported operating system version, ensure that you first upgrade to a supported version of the operating system.
Ensure you have downloaded the latest CPI patch.
Figure 1.0
CPI Enhancement:
Veritas engineering have released a CPI enhancement via CPI_7.4.2_P12.pl patch to confirm the /etc/llttab file exists as part of the CPI pre-checks, the CPI patch is available on the Veritas Download Center (DC):
https://downloads.infoscale.com/infoscale/REL600675?q=UPD740268
Incident details:
* 4042890 (Tracking ID: 4043075)
SYMPTOM:
After performing a phased upgrade of InfoScale, the product installer fails to update the types.cf file.
DESCRIPTION:
You can rename the /etc/llttab file before an OS upgrade and revert to the original configuration after the OS upgrade and before you start the InfoScale stack upgrade. However, if you do not revert the renamed /etc/llttab file, the product installer fails to identify that VCS is configured on the mentioned systems and proceeds with upgrade. Consequently, the installer does not update the .../config/types.cf file.
RESOLUTION:
This hotfix updates the product installer to avoid such a situation. It displays an error and exits after the precheck tasks if the /etc/llttab file is missing and the other VCS configuration files are available on the mentioned systems.
New messaging:
The following errors were discovered on the systems:
CPI ERROR V-9-0-0 /etc/llttab file is missing on the system , which may cause unknown errors. Please correct VCS configuration and re-run the installer.
Phased Upgrade Steps Summary:
Figure 2.0
SUBCLUSTER#1
1.] Rename /etc/llttab to /etc/llttab.save on subcluster#1 nodes
2.] Upgrade OS on subcluster#1
3.] Rename /etc/llttab.save back to /etc/llttab on subcluster#1 nodes
4.] Start the CPI installer using the latest CPI patch 7.4.2_P12.pl on subcluster#1 nodes
Sample syntax:
# ./installer -noipc -require /root/7.4.2-CPI/patches/CPI_7.4.2_P12.pl -patch_path /root/7.4.2.1200/ linuxvm04 linuxvm05
NOTE: The installer is launched from within the directory containing the base 7.4.2 InfoScale software.
The latest 7.4.2 public patches are downloaded & extracted to the directory /root/7.4.2.1200.
5.] Once the InfoScale 7.4.2 Upgrade is complete for subcluster#1 nodes, reboot those systems to be sure the subcluster#1 nodes reboot fine following the Veritas Upgrade.
The types.cf will be updated on subcluster#1 nodes only
[root@linuxvm04 ~]# grep -i BindUmount /etc/VRTSvcs/conf/config/types.cf
static str ArgList[] = { MountPoint, BlockDevice, FSType, MountOpt, FsckOpt, SnapUmount, CkptUmount, BindUmount, OptCheck, CreateMntPt, MntPtPermission, MntPtOwner, MntPtGroup, AccessPermissionChk, RecursiveMnt, VxFSMountLock, CacheRestoreAccess }
boolean BindUmount = 1
[root@linuxvm05 ~]# grep -i BindUmount /etc/VRTSvcs/conf/config/types.cf
static str ArgList[] = { MountPoint, BlockDevice, FSType, MountOpt, FsckOpt, SnapUmount, CkptUmount, BindUmount, OptCheck, CreateMntPt, MntPtPermission, MntPtOwner, MntPtGroup, AccessPermissionChk, RecursiveMnt, VxFSMountLock, CacheRestoreAccess }
boolean BindUmount = 1
SUBCLUSTER#2
6.] Rename /etc/llttab to /etc/llttab.save on subcluster#2 nodes
7.] Stop the Cluster
# hastop -all
8.] Start VCS on subcluster#1 nodes only
[root@linuxvm04 ~]# hastart
[root@linuxvm05 ~]# hastart
[root@linuxvm05 ~]# hastatus -sum
-- SYSTEM STATE
-- System State Frozen
A linuxvm04 RUNNING 0
A linuxvm05 RUNNING 0
A linuxvm06 UNKNOWN 0
A linuxvm07 UNKNOWN 0
9.] Ensure VCS ServiceGroups now start on subcluster#1 nodes only
10.] Start OS Upgrade on subcluster#2 nodes
11.] Rename /etc/llttab.save back to /etc/llttab on subcluster #2 nodes
If you forget to rename the file back, CPI will now alert you
[root@linuxvm06 ~]# ls /etc/llttab*
/etc/llttab.save
[root@linuxvm07 ~]# ls /etc/llttab*
/etc/llttab.save
Sample CPI installer output
[root@linuxvm04 rhel7_x86_64]# ./installer -noipc -require /root/7.4.2-CPI/patches/CPI_7.4.2_P12.pl -patch_path /root/7.4.2.1200/ linuxvm06 linuxvm07
Veritas InfoScale Storage and Availability Solutions 7.4.2 Install Program
linuxvm06 linuxvm07
Copyright (c) 2020 Veritas Technologies LLC. All rights reserved. Veritas and the Veritas Logo are trademarks or registered trademarks of Veritas Technologies LLC or its affiliates in the
U.S. and other countries. Other names may be trademarks of their respective owners.
The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial computer software documentation" as defined in FAR Sections 12.212 and DFARS Section
227.7202.
Logs are being written to /opt/VRTStmp/installer-202107061338TJc while installer is in progress.
Veritas InfoScale Storage and Availability Solutions 7.4.2 Install Program
linuxvm06 linuxvm07
Task Menu:
P) Perform a Pre-Installation Check I) Install a Product
C) Configure a Product Component G) Upgrade a Product
O) Perform a Post-Installation Check U) Uninstall a Product
L) License a Product S) Start a Product
D) View Product Descriptions X) Stop a Product
R) View Product Requirements ?) Help
Enter a Task: [P,I,C,G,O,U,L,S,D,X,R,?] G
Veritas InfoScale Storage and Availability Solutions 7.4.2 Upgrade Program
linuxvm06 linuxvm07
1) Full Upgrade
2) Rolling Upgrade
3) Online Upgrade [VCS only]
b) Back to previous menu
Select the method by which you want to upgrade the product: [1-3,b,q] (1) 1
Veritas InfoScale Storage and Availability Solutions 7.4.2 Upgrade Program
linuxvm06 linuxvm07
Logs are being written to /opt/VRTStmp/installer-202107061338TJc while installer is in progress
Verifying systems: 100%
Estimated time remaining: (mm:ss) 0:00 8 of 8
Checking system communication ................................................................................................................................................... Done
Checking release compatibility .................................................................................................................................................. Done
Checking installed product ...................................................................................................................................................... Done
Checking platform version ....................................................................................................................................................... Done
Checking prerequisite patches and rpms ........................................................................................................................................ Failed
Checking file system free space ................................................................................................................................................. Done
Checking configured component ................................................................................................................................................... Done
Performing product prechecks .................................................................................................................................................... Done
The following required OS rpms were not found on linuxvm06:
libhbalinux.x86_64 libhbaapi.x86_64
The following required OS rpms were not found on linuxvm07:
libhbalinux.x86_64 libhbaapi.x86_64
The installer provides some guidance about how to install OS rpms using native methods, like yum, or how to manually install the required OS rpms.
1) Install the missing required OS rpms with yum, if yum is configured on the systems
2) Install the missing required OS rpms manually, (detailed steps are provided)
3) Do not install the missing required OS rpms
How would you like to install the missing required OS rpms? [1-3,q,?] (1) 1
The installation may take a few minutes, be patient.
Install the missing OS rpms with yum on linuxvm06 .......................................................................................................................... Done
Install the missing OS rpms with yum on linuxvm07 .......................................................................................................................... Done
Press [Enter] to continue:
Veritas InfoScale Enterprise 7.4.2 Upgrade Program
linuxvm06 linuxvm07
Logs are being written to /opt/VRTStmp/installer-202107061338TJc while installer is in progress
Verifying systems: 100%
Estimated time remaining: (mm:ss) 0:00 8 of 8
Checking system communication ................................................................................................................................................... Done
Checking release compatibility .................................................................................................................................................. Done
Checking installed product ...................................................................................................................................................... Done
Checking platform version ....................................................................................................................................................... Done
Checking prerequisite patches and rpms .......................................................................................................................................... Done
Checking file system free space ................................................................................................................................................. Done
Checking configured component ................................................................................................................................................... Done
Performing product prechecks .................................................................................................................................................... Done
System verification checks completed
The following errors were discovered on the systems:
CPI ERROR V-9-0-0 /etc/llttab file is missing on the system linuxvm06, which may cause unknown errors. Please correct VCS configuration and re-run the installer.
NOTES:
Why is the error not reported for both nodes:
If had is running, CPI checks the configured component on both the nodes...and error is displayed for both the nodes
If had is not running CPI only checks one node for configured component and display an error for one node
This is CPI design.
12.] Start the CPI installer using the latest CPI patch 7.4.2_P12.pl for subcluster#2 nodes
# ./installer -noipc -require /root/7.4.2-CPI/patches/CPI_7.4.2_P12.pl -patch_path /root/7.4.2.1200/ linuxvm06 linuxvm07
13.] When complete, reboot the subcluster#2 nodes
14.] Verify all nodes are able to join the cluster back
# hastatus -sum
-- SYSTEM STATE
-- System State Frozen
A linuxvm04 RUNNING 0
A linuxvm05 RUNNING 0
A linuxvm06 RUNNING 0
A linuxvm07 RUNNING 0
Issue/Introduction
CPI Enhancement: When performing Veritas PHASED upgrades users may forget to rename the /etc/llttab.save back to /etc/llttab
