Feb 20 22:28:15 my_server_1 odm: [ID 732962 kern.notice] ODM INFO V-41-6-23 joined at protocol version 3, cluster exclusive mode
The issue is caused by incorrect license installed on at least of of the RAC cluster notes.
File /dev/odm/cluster shows ODM is in "enabled exclusive" status.
#cat /dev/odm/cluster
cluster status: enabled exclusive
For an Oracle RAC cluster to function properly, each node in the cluster needs to have the same ISRAC (InfoScale for Oracle RAC) license installed. The cluster ODM will enter in cluster exclusive mode if one or some of the cluster nodes has/have CFS (Cluster File System) license instead of Oracle RAC.
When ODM is in "enabled exclusive" status, it means that ODM will only allow each file to be identified/opened
on one node at a time. The SFCFS environment is supposed to support single-node Oracle in failover mode, and the restriction imposed by ODM (in exclusive mode) is a feature of VERITAS Storage Foundation to prevent data corruption.
To check the license installed, run vxlicrep | grep "Product Name" | egrep "RAC|Cluster File System".
example:
# vxlicrep | grep "Product Name" | egrep "RAC|Cluster File System"
Product Name = VERITAS Storage Foundation for Oracle RAC
Product Name = VERITAS Storage Foundation for Cluster File System
Once each node has the correct RAC license installed, either reboot the cluster or restart ODM. To stop ODM, some ODM dependent modules need to be stopped prior stopping ODM. Once ODM is restarted, the other stopped modules need to be started in a reverse order as they were stopped.