Thin reclamation does not work with EMC VMAX SRDF R1/R2 devices
Article ID: 100025699
Updated On:
Resolution
At the time of writing this article, the Veritas Volume Manager (VxVM) stack and VMAX thin reclamation (thinrclm) enabled devices are not capable of reclaiming space.
Applies To
Reproduction steps
The following process was conducted on a Linux (SLES 11) server running 5.1 SP1.
# rpm -qa | grep -i VRTSvxvm
VRTSvxvm-5.1.100.000-SP1_SLES11
1.] New volume and filesystem created in diskgroup "SRDFthin-dg".
# vxprint -qhtg SRDFthin-dg
dg SRDFthin-dg default default 15000 1312296765.39.clabcctlx01
dm emc1_029a emc0_1714 auto 65587 4112688 -
dm emc1_0296 emc0_1710 auto 65536 4116224 -
dm emc1_0297 emc0_1711 auto 65587 4112688 -
dm emc1_0298 emc0_1712 auto 65536 4116224 -
dm emc1_0299 emc0_1713 auto 65536 4116224 -
# vxassist -g SRDFthin-dg maxsize
Maximum volume size: 20572160 (10045Mb)
# vxassist -g SRDFthin-dg make vol01 10045m
# vxprint -qhtg SRDFthin-dg
dg SRDFthin-dg default default 15000 1312296765.39.clabcctlx01
dm emc1_029a emc0_1714 auto 65587 4112688 -
dm emc1_0296 emc0_1710 auto 65536 4116224 -
dm emc1_0297 emc0_1711 auto 65587 4112688 -
dm emc1_0298 emc0_1712 auto 65536 4116224 -
dm emc1_0299 emc0_1713 auto 65536 4116224 -
v vol01 - ENABLED ACTIVE 20572160 SELECT - fsgen
pl vol01-01 vol01 ENABLED ACTIVE 20572160 CONCAT - RW
sd emc1_0296-01 vol01-01 emc1_0296 0 4116224 0 emc0_1710 ENA
sd emc1_0297-01 vol01-01 emc1_0297 0 4112688 4116224 emc0_1711 ENA
sd emc1_0298-01 vol01-01 emc1_0298 0 4116224 8228912 emc0_1712 ENA
sd emc1_0299-01 vol01-01 emc1_0299 0 4116224 12345136 emc0_1713 ENA
sd emc1_029a-01 vol01-01 emc1_029a 0 4110800 16461360 emc0_1714 ENA
# mkfs -t vxfs /dev/vx/rdsk/SRDFthin-dg/vol01
version 7 layout
20572160 sectors, 10286080 blocks of size 1024, log size 16384 blocks
largefiles supported
2.] Filesystem is mounted.
# mkdir /vol01
# mount -t vxfs /dev/vx/dsk/SRDFthin-dg/vol01 /vol01
3.] Shrinking both the filesystem and volume size, allowing subdisk "emc1_029a-01" to be freed, residing on Veritas disk access name "emc0_1714"
# /etc/vx/bin/vxresize -g SRDFthin-dg vol01 -4110800s
# vxprint -qhtg SRDFthin-dg
dg SRDFthin-dg default default 15000 1312296765.39.clabcctlx01
dm emc1_029a emc0_1714 auto 65587 4112688 -
dm emc1_0296 emc0_1710 auto 65536 4116224 -
dm emc1_0297 emc0_1711 auto 65587 4112688 -
dm emc1_0298 emc0_1712 auto 65536 4116224 -
dm emc1_0299 emc0_1713 auto 65536 4116224 -
v vol01 - ENABLED ACTIVE 16461360 SELECT - fsgen
pl vol01-01 vol01 ENABLED ACTIVE 16461360 CONCAT - RW
sd emc1_0296-01 vol01-01 emc1_0296 0 4116224 0 emc0_1710 ENA
sd emc1_0297-01 vol01-01 emc1_0297 0 4112688 4116224 emc0_1711 ENA
sd emc1_0298-01 vol01-01 emc1_0298 0 4116224 8228912 emc0_1712 ENA
sd emc1_0299-01 vol01-01 emc1_0299 0 4116224 12345136 emc0_1713 ENA
4.] The above operation freed up disk "emc0_1714" associated with disk media name "emc1_0299".
# vxdg -g SRDFthin-dg free
DISK DEVICE TAG OFFSET LENGTH FLAGS
emc1_029a emc0_1714 emc0_1714 0 4112688 -
5.] Thin reclamation process engaged
# vxdisk -g SRDFthin-dg reclaim emc0_1714
Disk emc0_1714 : Skipped. No VxFS file system found.
# vxdg -g SRDFthin-dg rmdisk emc1_029a
# vxdisk -g SRDFthin-dg reclaim emc0_1714
Disk emc0_1714 : Reclaimed full. Disk not in any disk group.
# vxdisk reclaim emc0_1714
VxVM vxdisk ERROR V-5-1-539 Device emc0_1714: get_contents failed:
Disk device is offline
Disk emc0_1714 : Skipped. Disk Not Ready.
# vxprint -g SRDFthin-dg -z
TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0
dg SRDFthin-dg SRDFthin-dg - - - - - -
dm emc1_0296 emc0_1710 - 4116224 - - - -
dm emc1_0297 emc0_1711 - 4112688 - - - -
dm emc1_0298 emc0_1712 - 4116224 - - - -
dm emc1_0299 emc0_1713 - 4116224 - - - -
v vol01 fsgen ENABLED 16461360 - ACTIVE - -
pl vol01-01 vol01 ENABLED 16461360 - ACTIVE - -
sd emc1_0296-01 vol01-01 ENABLED 4116224 0 - - -
sd emc1_0297-01 vol01-01 ENABLED 4112688 4116224 - - -
sd emc1_0298-01 vol01-01 ENABLED 4116224 8228912 - - -
sd emc1_0299-01 vol01-01 ENABLED 4116224 12345136 - - -
clabcctlx01:/opt/emc/SYMCLI/bin # vxdg -g SRDFthin-dg adddisk emc1_029a=emc0_1714
VxVM vxdg ERROR V-5-1-10128 Disk device is offline
# vxdisk scandisks
# vxdisk -e list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTR
emc0_1457 auto:LVM - - LVM sdp tprclm
emc0_1710 auto:cdsdisk emc1_0296 SRDFthin-dg online thinrclm sdq tprclm srdf-r1
emc0_1711 auto:sliced emc1_0297 SRDFthin-dg online thinrclm sdr tprclm srdf-r1
emc0_1712 auto:cdsdisk emc1_0298 SRDFthin-dg online thinrclm sds tprclm srdf-r1
emc0_1713 auto:cdsdisk emc1_0299 SRDFthin-dg online thinrclm sdt tprclm srdf-r1
emc0_1714 auto - - error sdu tprclm srdf-r1 <<<<<<<
Issue/Introduction
S Y M M E T R I X
Mcode Cache Num Phys Num Symm
SymmID Attachment Model Version Size (MB) Devices Devices
000192601604 Remote VMAX-1 5875 177664 0 13861 <<<<<< emc0 devices
The diskgroup "SRDFthin-dg" consists of a series of EMC SRDF R1 devices associated with a VMAX array running MicroCode "5875".
# vxdisk -e list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTR
emc0_1457 auto:LVM - - LVM sdp tprclm
emc0_1710 auto:cdsdisk emc1_0296 SRDFthin-dg online thinrclm sdq tprclm srdf-r1
emc0_1711 auto:sliced emc1_0297 SRDFthin-dg online thinrclm sdr tprclm srdf-r1
emc0_1712 auto:cdsdisk emc1_0298 SRDFthin-dg online thinrclm sds tprclm srdf-r1
emc0_1713 auto:cdsdisk emc1_0299 SRDFthin-dg online thinrclm sdt tprclm srdf-r1
emc0_1714 auto:sliced emc1_029a SRDFthin-dg online thinrclm sdu tprclm srdf-r1
sda auto:none - - online invalid sda -
