VCS EMC MirrorViewSnap agent has been enhanced to remove the related snapshot OS device handles (LUNs) correctly on Linux
Article ID: 100004589
Updated On:
Resolution
The Veritas Cluster Server(VCS) EMC MirrorViewSnap agent has been enhanced to cleanup the EMC CLARiiON SnapView devices on layers (VxVM/DMP and Linux layers).
Note: The EMC MirrorViewSnap agent now requires the installation of the 3rd Party utility "lsscsi" to be installed.
Enabling the agent to report the Linux device details.
/opt/VRTSvcs/bin/MirrorViewSnap/MirrorViewSnap.pm
1.] The OS is presenting the following CLARiiON devices, prior to the removal of the related EMC MirrorView Snapshot lun.
Sample output
# lsscsi | grep DGC
[2:0:2:0] disk DGC RAID 5 0326 /dev/sdp
[2:0:2:1] disk DGC RAID 5 0326 /dev/sdr
[2:0:3:0] disk DGC RAID 5 0326 /dev/sdq
[2:0:3:1] disk DGC RAID 5 0326 /dev/sds
2.] The DMP enclosure LUN count for the EMC CLARiiON array is currently "2".
Sample output
# vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200065000220 CONNECTED CLR-A/PF 2
eva4k6k0 EVA4K6K 50001FE1500F0360 CONNECTED ALUA 7
3.] To validate the improvements made, offline the VCS ServiceGroup for the EMC MirrorViewSnap resource, in this instance the name is "MVSnap".
# hagrp -offline MVSnap -any
4.] To understand the VCS offline process, tail the VCS engine_A.log as follows:
# tail -f /var/VRTSvcs/log/engine_A.log
5.] During the offline process of the EMC MirrorView Snapview related ServiceGroup, critical pre-checks are performed.
Sample output
# hagrp -offline MVSnap -any
VCS NOTICE V-16-1-50733 Attempting to offline group on system vcslx303
2011/01/29 22:30:35 VCS INFO V-16-1-50135 User root fired command: hagrp -offline -any MVSnap localclus from localhost
2011/01/29 22:30:35 VCS NOTICE V-16-1-10167 Initiating manual offline of group MVSnap on system vcslx303
2011/01/29 22:30:35 VCS NOTICE V-16-1-10300 Initiating Offline of Resource dg_fd (Owner: Unspecified, Group: MVSnap) on System vcslx303
2011/01/29 22:30:38 VCS INFO V-16-1-10305 Resource dg_fd (Owner: Unspecified, Group: MVSnap) is offline on vcslx303 (VCS initiated)
2011/01/29 22:30:38 VCS NOTICE V-16-1-10300 Initiating Offline of Resource mvsnap_sync (Owner: Unspecified, Group: MVSnap) on System vcslx303
2011/01/29 22:30:45 VCS INFO V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Ping output: PING 10.209.64.26 (10.209.64.26) 56(84) bytes of data.
64 bytes from 10.209.64.26: icmp_seq=1 ttl=127 time=0.270 ms
--- 10.209.64.26 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms
2011/01/29 22:30:45 VCS INFO V-16-20054-190 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:
VCS EMC MirrorViewSnap Agent
offline-checks
2011/01/29 22:30:45 VCS INFO V-16-20054-191 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Environmental snapshot DMP offline-checks command:
/opt/VRTS/bin/vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200065000220 CONNECTED CLR-A/PF 2
eva4k6k0 EVA4K6K 50001FE1500F0360 CONNECTED ALUA 7
2011/01/29 22:30:45 VCS INFO V-16-20054-192 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:VM vxdisk -eq output prior to offline:
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTR
emc_clariion0_281 auto - - error sdq lun RAID_5
emc_clariion0_281_1 auto:cdsdisk - (dg2_fd) online clone_disk sds lun RAID_5
eva4k6k0_0 auto:cdsdisk - (OracleDG) online sdb -
eva4k6k0_1 auto:cdsdisk - (OracleDG) online sdj -
eva4k6k0_2 auto:cdsdisk - (WebSphereDG) online sdk -
eva4k6k0_3 auto:cdsdisk - (WebSphereDG) online sdl -
eva4k6k0_4 auto:cdsdisk - - online sdm -
eva4k6k0_5 auto:cdsdisk DISK00 EVACA0 online sdn -
eva4k6k0_6 auto - - error sdo -
sda auto:none - - online invalid sda -
6.] Once the offline checks have been conducted, the Veritas disk access name for the EMC CLARiiON SnapView lun is removed.
Sample output
2011/01/29 22:30:45 VCS INFO V-16-20054-133 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Removing VxVM disks created after snapshot.
2011/01/29 22:30:45 VCS INFO V-16-20054-151 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Issuing command [/opt/VRTS/bin/vxdmpadm getsubpaths dmpnodename=emc_clariion0_281_1 | /bin/awk '/EMC_CLARiiON/{print }'] to find subpaths.
2011/01/29 22:30:45 VCS INFO V-16-20054-152 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Output: [sdr
sds
]
2011/01/29 22:30:45 VCS INFO V-16-20054-153 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:New List: [
sdr
sds
]
2011/01/29 22:30:45 VCS INFO V-16-20054-131 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Issuing command to remove disks: /usr/sbin/vxdisk rm emc_clariion0_281_1
2011/01/29 22:30:45 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /usr/sbin/vxdisk rm emc_clariion0_281_1
2011/01/29 22:30:45 VCS NOTICE V-16-20054-102 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:command succeeded
7.] Once the native OS device handles have been identified for the (SnapView) Veritas disk access name, the EMC CLARiiON SnapView snapshot is deactivated and removed.
Sample output
2011/01/29 22:30:46 VCS NOTICE V-16-20054-109 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Deactivating snapshot : lun281_fd_snapshot.
2011/01/29 22:30:46 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /opt/Navisphere/bin/naviseccli -h 10.209.64.26 snapview -deactivatesnapshot -snapshotname lun281_fd_snapshot -o
2011/01/29 22:30:47 VCS NOTICE V-16-20054-102 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:command succeeded
2011/01/29 22:30:47 VCS NOTICE V-16-20054-113 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Removing snapshot : lun281_fd_snapshot from Storage group : vcslx303_304
2011/01/29 22:30:47 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /opt/Navisphere/bin/naviseccli -h 10.209.64.26 storagegroup -removesnapshot -gname vcslx303_304 -snapshotname lun281_fd_snapshot -o
2011/01/29 22:30:49 VCS NOTICE V-16-20054-102 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:command succeeded
2011/01/29 22:30:49 VCS NOTICE V-16-20054-115 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Removing Snapshot : lun281_fd_snapshot
2011/01/29 22:30:49 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /opt/Navisphere/bin/naviseccli -h 10.209.64.26 snapview -rmsnapshot -snapshotname lun281_fd_snapshot -o
2011/01/29 22:30:52 VCS NOTICE V-16-20054-102 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:command succeeded
2011/01/29 22:30:52 VCS NOTICE V-16-20054-111 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Stopping session : VCS_mvsnap_sync_fd_session
2011/01/29 22:30:52 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /opt/Navisphere/bin/naviseccli -h 10.209.64.26 snapview -stopsession VCS_mvsnap_sync_fd_session -o 2>&1
2011/01/29 22:30:56 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:
EMC CLARiiON storagegroup listing: /opt/Navisphere/bin/naviseccli -h 10.209.64.26 storagegroup -list -gname vcslx303_304 -host
Storage Group Name: vcslx303_304
Storage Group UID: 84:43:0F:12:03:14:E0:11:B8:90:00:60:16:0E:E6:04
HBA/SP Pairs:
HBA UID SP Name SPPort
------- ------- ------
20:00:00:E0:8B:1A:AD:B5:21:00:00:E0:8B:1A:AD:B5 SP A 0
Host name: vcslx303.vxindia.veritas.com
20:00:00:E0:8B:1A:AD:B5:21:00:00:E0:8B:1A:AD:B5 SP B 0
Host name: vcslx303.vxindia.veritas.com
HLU/ALU Pairs:
HLU Number ALU Number
---------- ----------
0 281
Shareable: YES
2011/01/29 22:30:56 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /opt/Navisphere/bin/naviseccli -h 10.209.64.27 snapview -stopsession VCS_mvsnap_sync_fd_session -o 2>&1
2011/01/29 22:30:59 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:
EMC CLARiiON storagegroup listing: /opt/Navisphere/bin/naviseccli -h 10.209.64.27 storagegroup -list -gname vcslx303_304 -host
Storage Group Name: vcslx303_304
Storage Group UID: 84:43:0F:12:03:14:E0:11:B8:90:00:60:16:0E:E6:04
HBA/SP Pairs:
HBA UID SP Name SPPort
------- ------- ------
20:00:00:E0:8B:1A:AD:B5:21:00:00:E0:8B:1A:AD:B5 SP A 0
Host name: vcslx303.vxindia.veritas.com
20:00:00:E0:8B:1A:AD:B5:21:00:00:E0:8B:1A:AD:B5 SP B 0
Host name: vcslx303.vxindia.veritas.com
HLU/ALU Pairs:
HLU Number ALU Number
---------- ----------
0 281
Shareable: YES
2011/01/29 22:30:59 VCS INFO V-16-1-50135 User root fired command: hares -modify mvsnap_sync Responsibility from localhost
8.] The OS device handles for the snapshot lun are then removed.
Sample output
2011/01/29 22:30:59 VCS INFO V-16-20054-134 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Removing FC LUN mapping from server.
2011/01/29 22:30:59 VCS INFO V-16-20054-150 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Deleting device [sdr] using cmd [echo 1 > /sys/block/sdr/device/delete]
2011/01/29 22:30:59 VCS INFO V-16-20054-150 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Deleting device [sds] using cmd [echo 1 > /sys/block/sds/device/delete]
2011/01/29 22:30:59 VCS INFO V-16-20054-160 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Rescaning VxVM devices
2011/01/29 22:30:59 VCS NOTICE V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:issuing command: /usr/sbin/vxdisk scandisks
2011/01/29 22:31:01 VCS NOTICE V-16-20054-102 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:command succeeded
2011/01/29 22:31:01 VCS INFO V-16-20054-162 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:
Linux device tree output :/usr/bin/lsscsi | /bin/grep DGC
[2:0:2:0] disk DGC RAID 5 0326 /dev/sdp
[2:0:3:0] disk DGC RAID 5 0326 /dev/sdq
9.] An environmental snapshot of DMP is captured at the end of the offline process.
Sample output
2011/01/29 22:31:01 VCS INFO V-16-20054-131 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Environmental snapshot DMP at the end of offline process:
2011/01/29 22:31:01 VCS INFO V-16-20054-195 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:DMP LUN Count: /opt/VRTS/bin/vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200065000220 CONNECTED CLR-A/PF 1
eva4k6k0 EVA4K6K 50001FE1500F0360 CONNECTED ALUA 7
2011/01/29 22:31:01 VCS INFO V-16-20054-196 (vcslx303) MirrorViewSnap:mvsnap_sync:offline:Refreshing /etc/vx/disk.info: /usr/sbin/vxddladm assign names
2011/01/29 22:31:08 VCS INFO V-16-20054-101 (vcslx303) MirrorViewSnap:mvsnap_sync:monitor:Ping output: PING 10.209.64.26 (10.209.64.26) 56(84) bytes of data.
64 bytes from 10.209.64.26: icmp_seq=1 ttl=127 time=0.506 ms
--- 10.209.64.26 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.506/0.506/0.506/0.000 ms
2011/01/29 22:31:09 VCS INFO V-16-1-10305 Resource mvsnap_sync (Owner: Unspecified, Group: MVSnap) is offline on vcslx303 (VCS initiated)
2011/01/29 22:31:09 VCS NOTICE V-16-1-10446 Group MVSnap is offline on system vcslx303
Process complete.
Applies To
The revised agent has been created for RedHat on Linux at this time.
Working Configuration
# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.5 (Tikanga)
# uname -a
Linux
Issue/Introduction
VCS engineering has released the "Mirrorview_Agent_4Q2010_HF3" (Hot-fix) to improve the robustness of the VCS MirrorViewSnap agent.
Please contact Veritas support to obtain the revised agent.
# rpm -qa | grep -i VRTSvcsm
VRTSvcsm-5.0.09.0-Linux_GENERIC
Additional Information
