CRS Application not able to start/join in VCS environment -

Scenario -

* 6 nodes SFRAC cluster - node1, 2, 3, 4, 5 and 6.

* 2 nodes ( node1 and node2) rebuilt (because of different NIC)

* Now CRS  behaves very differently as below

Scenario Failure -

CRS will not start on 4 original nodes (node3,4,5 and 6), if we first start CRS in either node1 or node2  (both of them are newly built nodes)

The Followings are the CRS messages below -

-----------

ERROR CODE/ MESSAGE:
2009-10-30 21:41:18.969: [ COMMCRS][42]clsc_connect: (1009533d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_mica-3_mica))

2009-10-30 21:41:18.969: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9

2009-10-30 21:41:18.969: [ CRSRTI][1] CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2009-10-30 21:41:20.539: [ COMMCRS][44]clsc_connect: (1009533d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_mica-3_mica))

2009-10-30 21:41:20.539: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9

2009-10-30 21:41:20.539: [ CRSRTI][1] CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2009-10-30 21:41:22.109: [ COMMCRS][46]clsc_connect: (1009533d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_mica-3_mica))

2009-10-30 21:41:22.109: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9

2009-10-30 21:41:22.109: [ CRSRTI][1] CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2009-10-30 21:41:23.678: [ COMMCRS][48]clsc_connect: (1009533d0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_mica-3_mica))

2009-10-30 21:41:23.679: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9


------------


Scenario Success -

CRS will start on all the nodes if we first start CRS on any of the original nodes - node3,4,5 and 6.

Then we add on node1 and node2, both of these nodes will start CRS successfully.



Issue -

issue was related to libskgxn2.so library link pointing to CRS_HOME directory instead of ORCL cluster in new node1 and node2.




SOLUTION:

Setup link as this - >

u01/app/oracle/product/10.2.0/crs_home/lib/libskgxn2.so -> /opt/ORCLcluster/lib/libskgxn2.so



 

 

CRS Apps defined under VCS not able to start in some nodes