Configuration:


VxVM 5.0 MP3 RP4 running Solaris 10
An EMC BCV image is taken of an EMC SRDF R2 device on the same system.



Problem Description


The user will be unable to import the BCV diskgroup image unless a strict command sequence is performed.

When attempting to import a cloned BCV image of a SRDF-R2 diskgroup image using the vxdg options “ -o useclonedev=on and -o updateid”, diskgroup corruption can occur.
 

 

If the vxdg import options are executed separately the BCV diskgroup image of the R2 device can be imported without any issues.


Reproduction steps:


Note: The bcv-mapping.txt file contains the SRDF-R2 to BCV device mappings. The file is processed by the EMC symmir CLI interface.


Bashful # cat /bcv-mapping.txt
0072 00dc


The EMC SYMDEV reference in the first column is the source lun "0072", which relates to Veritas disk access (da) name "emc1_0072".
The EMC SYMDEV reference in the second column is the target lun "00DC" for the EMC BCV device, which relates to Veritas disk access (da) name "emc1_00dc".

1.] Re-establish the BCV lun state.
 

Note: A full establish is performed to ensure the entire disk contents are copied, in place of an incremental copy.


Bashful # symmir -sid 414 -v -f  /bcv-mapping.txt -full establish -nopr

'Full Establish' operation execution is in progress for the device list in device file '/bcv-mapping.txt'. Please wait...


SELECTING the list of Standard devices in the group:

  Device: 0072 [SELECTED]

SELECTING BCV devices associated with the group:

  Device: 00DC [SELECTED]

PAIRING of Standard and BCV devices:

  Devices: 0072(S) - 00DC(B) [PAIRED]

STARTING a BCV 'ESTABLISH' operation.

The BCV 'ESTABLISH' operation SUCCEEDED.

'Full Establish' operation successfully initiated for the device list in device file '/bcv-mapping.txt'.



2.] Confirm the BCV lun is "syncing" (SyncInProg) with the source LUN.


Bashful # symmir -sid 414 -v -f  /bcv-mapping.txt query

SELECTING the list of Standard devices in the group:

  Device: 0072 [SELECTED]

SELECTING BCV devices associated with the group:

  Device: 00DC [SELECTED]

PAIRING of Standard and BCV devices:

  Devices: 0072(S) - 00DC(B) [PAIRED]


Device File Name      : /bcv-mapping.txt
Device's Symmetrix ID : 000290301414



     Standard Device                    BCV Device                  State
-------------------------- ------------------------------------- ------------
                    Inv.                                  Inv.
Logical        Sym  Tracks Logical              Sym       Tracks STD <=> BCV
-------------------------- ------------------------------------- ------------

N/A            0072      0 N/A                  00DC         379 SyncInProg

Total              -------                               -------
  Track(s)               0                                   379
  MB(s)                0.0                                  23.7



Legend:


(*): The paired BCV device is associated with this group.



3.] Confirm that the BCV lun has been "synchronized".


Bashful # symmir -sid 414 -v -f  /bcv-mapping.txt query

SELECTING the list of Standard devices in the group:

  Device: 0072 [SELECTED]

SELECTING BCV devices associated with the group:

  Device: 00DC [SELECTED]

PAIRING of Standard and BCV devices:

  Devices: 0072(S) - 00DC(B) [PAIRED]


Device File Name      : /bcv-mapping.txt
Device's Symmetrix ID : 000290301414



     Standard Device                    BCV Device                  State
-------------------------- ------------------------------------- ------------
                    Inv.                                  Inv.
Logical        Sym  Tracks Logical              Sym       Tracks STD <=> BCV
-------------------------- ------------------------------------- ------------

N/A            0072      0 N/A                  00DC           0 Synchronized

Total              -------                               -------
  Track(s)               0                                     0
  MB(s)                0.0                                   0.0



Legend:


(*): The paired BCV device is associated with this group.



4.] Split the BCV lun using "symmir split".


Bashful # symmir -sid 414 -v -f  /bcv-mapping.txt split

Execute 'Split' operation for the 1 specified device(s) in device file '/bcv-mapping.txt' (y/[n]) ? y

'Split' operation execution is in progress for the device list in device file '/bcv-mapping.txt'. Please wait...


SELECTING the list of Standard devices in the group:

  Device: 0072 [SELECTED]

SELECTING BCV devices associated with the group:

  Device: 00DC [SELECTED]

PAIRING of Standard and BCV devices:

  Devices: 0072(S) - 00DC(B) [PAIRED]

STARTING a BCV 'SPLIT' operation.
The BCV 'SPLIT' operation SUCCEEDED.

'Split' operation successfully executed for the device list in device file '/bcv-mapping.txt'.



5.] Confirm the BCV lun has been "Split".


Bashful # symmir -sid 414 -v -f  /bcv-mapping.txt query

SELECTING the list of Standard devices in the group:

  Device: 0072 [SELECTED]

SELECTING BCV devices associated with the group:

  Device: 00DC [SELECTED]

PAIRING of Standard and BCV devices:

  Devices: 0072(S) - 00DC(B) [PAIRED]


Device File Name      : /bcv-mapping.txt
Device's Symmetrix ID : 000290301414



     Standard Device                    BCV Device                  State
-------------------------- ------------------------------------- ------------
                    Inv.                                  Inv.
Logical        Sym  Tracks Logical              Sym       Tracks STD <=> BCV
-------------------------- ------------------------------------- ------------

N/A            0072      0 N/A                  00DC           0 Split

Total              -------                               -------
  Track(s)               0                                     0
  MB(s)                0.0                                   0.0



Legend:


(*): The paired BCV device is associated with this group.

 

6.] Update the VxVM details.


Bashful # vxdisk scandisks


Bashful # vxdisk -e list emc1_00dc emc1_0072
DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_00dc    auto:cdsdisk   -            -           online udid_mismatch c1t5006048C536979A0d80s2 bcv     <<< < BCV (target) lun

DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_0072    auto:cdsdisk   -            -           online udid_mismatch c1t5006048C536979A0d65s2 srdf-r2    <<<< Source LUN



7.] Update the VxVM disk details for BCV lun "emc1_00dc" .


Bashful # vxdisk updateudid emc1_00dc
VxVM vxdisk ERROR V-5-1-12201 Device updateudid failed: Disk is in use by another host


To clear the hostid details, type:

Bashful # vxdisk clearimport emc1_00dc


Diskgroup fails to import


Bashful # vxdg -Cfn bcv_DopeyDg -o useclonedev=on -o updateid import DopeyDg
VxVM vxdg ERROR V-5-1-10978 Disk group DopeyDg: import failed:
DG import duplcate clone detected



Bashful # vxdisk updateudid emc1_00dc


Bashful # vxdisk -e list emc1_00dc emc1_0072
DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_00dc    auto:cdsdisk   -            -           online clone_disk    c1t5006048C536979A0d80s2 bcv

DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_0072    auto:cdsdisk   -            -           online udid_mismatch c1t5006048C536979A0d65s2 srdf-r2


8.] Second diskgroup import attempt still fails even after "vxdisk updateudid ".


Bashful # vxdg -Cfn bcv_DopeyDg -o useclonedev=on -o updateid import DopeyDg
VxVM vxdg ERROR V-5-1-10978 Disk group DopeyDg: import failed:


or

vxconfigd death may also occur


Bashful # pstack core
core 'core' of 56:      vxconfigd -x syslog -m boot
 0006262c chosen_rlist_delete (0, 308001c0, 10000000, b6, 272000, 2f0000) + 6c
 000ac288 req_dg_import (bba740, b6, bb1e30, bb1f30, bb1e10, 0) + 670
 0010b844 request_loop (abc18, bba740, 2e1cf4, 0, 2cfd8c, 151f0) + ae4
 000dedc4 main     (5, ffbffd8c, ffffffff, 277000, ffbffe44, 0) + cf8
 00036820 _start   (0, 0, 0, 0, 0, 0) + 108


Bashful # file core
core:           ELF 32-bit MSB core file SPARC Version 1, from 'vxconfigd'

Bashful # vxconfigd
VxVM vxconfigd WARNING V-5-1-10977 da_join failed, for device emc1_0075: Disk write failure
VxVM vxconfigd WARNING V-5-1-10977 da_join failed, for device emc1_0073: Disk write failure
VxVM vxconfigd WARNING V-5-1-10977 da_join failed, for device emc1_0074: Disk write failure
VxVM vxconfigd WARNING V-5-1-10977 da_join failed, for device emc1_0072: Disk write failure
VxVM vxconfigd ERROR V-5-1-579 Disk group DopeyDg: Errors in some configuration copies:
        Disk emc1_00dc, copy 1: Disks for disk group are inconsistent






Workaround


1.] Refresh the BCV image (established) and make available for import (split) once synchronized.


# symmir -sid 414 -f /bcv-mapping.txt establish -nopr
# symmir -sid 414 -f /bcv-mapping.txt query
# symmir -sid 414 -f /bcv-mapping.txt split -nopr


2.] Update the VxVM details for BCV lun "emc1_00dc".


Bashful # vxdisk clearimport emc1_00dc

Bashful # vxdisk updateudid  emc1_00dc


Bashful # vxdg -Cfn bcv_DopeyDg -o useclonedev=on import DopeyDg
VxVM vxdg ERROR V-5-1-10978 Disk group DopeyDg: import failed:
Device path not valid


Bashful # vxdg -Cfn bcv_DopeyDg -o useclonedev=on -o updateid import DopeyDg
VxVM vxdg WARNING V-5-1-560 Disk r1-008D: Not found, last known location: emc0_008d
VxVM vxdg WARNING V-5-1-560 Disk r1-008E: Not found, last known location: emc0_008e
VxVM vxdg WARNING V-5-1-560 Disk r1-008f: Not found, last known location: emc0_008f


Bashful # vxdisk -e list emc1_00dc emc1_0072
DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_00dc    auto:cdsdisk   r1-008C      bcv_DopeyDg online clone_disk    c1t5006048C536979A0d80s2 bcv   <<<< BCV lun imported.

DEVICE       TYPE           DISK        GROUP        STATUS               OS_NATIVE_NAME   ATTR
emc1_0072    auto           -            -           error udid_mismatch  c1t5006048C536979A0d65s2 srdf-r2    <<<< SRDF "R2" lun still write-disabled.


Issue resolved in 5.0 MP3 RP4 HF3 (Solaris) and 5.1SP1, etrack 2069806.