Description

If the correct LUN reconfiguration device removal steps are not followed, the user may be required to follow the steps as documented within this document.

In this instance, three EMC PowerPath controlled devices have been removed from a Solaris server via the EMC navicli interface, however, VxVM was not informed of this storage activity.
 

Figure 1.0

# /opt/Navisphere/bin/navicli -h 10.12.208.81  storagegroup -list -gname rdgv240sol13+14-bootdisks

Storage Group Name:    rdgv240sol13+14-bootdisks
Storage Group UID:     60:CC:49:25:65:41:DF:11:B2:65:00:60:16:01:6D:D5
HBA/SP Pairs:

  HBA UID                                          SP Name     SPPort
  -------                                          -------     ------
  10:00:00:01:73:01:BB:EB:20:00:00:01:73:01:BB:EB   SP A         1
  10:00:00:01:73:01:BB:EB:20:00:00:01:73:01:BB:EB   SP B         1
  10:00:00:01:73:01:BB:EB:20:00:00:01:73:01:BB:EB   SP A         0
  10:00:00:01:73:01:BB:EB:20:00:00:01:73:01:BB:EB   SP B         0

HLU/ALU Pairs:

  HLU Number     ALU Number
  ----------     ----------
    5               78
    6               79
    7               3
Shareable:             YES

The server has been rebooted, however, EMC PowerPath still references the removed entries for emcpower5a,emcpower6a and emcpower7a.

# powermt display class=clariion dev=all
Pseudo name=emcpower5a
CLARiiON ID=CK200053300424
Logical device ID=60060160E83416001C81C15E575FDF11
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=Unknown, current=Unknown Array failover mode: 4
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3073 UNKNOWN                   unknown   SP B0     active  dead       0      0
3073 UNKNOWN                   unknown   SP A0     active  dead       0      0
3073 UNKNOWN                   unknown   SP A1     active  dead       0      0
3073 UNKNOWN                   unknown   SP B1     active  dead       0      0
3074 UNKNOWN                   unknown   SP B0     active  dead       0      0
3074 UNKNOWN                   unknown   SP B1     active  dead       0      0
3074 UNKNOWN                   unknown   SP A0     active  dead       0      0
3074 UNKNOWN                   unknown   SP A1     active  dead       0      0

Pseudo name=emcpower6a
CLARiiON ID=CK200053300424
Logical device ID=60060160E83416004A3CB095BD3BDE11
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=Unknown, current=Unknown Array failover mode: 4
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3073 UNKNOWN                   unknown   SP B0     active  dead       0      0
3073 UNKNOWN                   unknown   SP B1     active  dead       0      0
3073 UNKNOWN                   unknown   SP A0     active  dead       0      0
3073 UNKNOWN                   unknown   SP A1     active  dead       0      0
3074 UNKNOWN                   unknown   SP B0     active  dead       0      0
3074 UNKNOWN                   unknown   SP B1     active  dead       0      0
3074 UNKNOWN                   unknown   SP A0     active  dead       0      0
3074 UNKNOWN                   unknown   SP A1     active  dead       0      0

Pseudo name=emcpower7a
CLARiiON ID=CK200053300424
Logical device ID=60060160E8341600F2BC89206340DE11
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=Unknown, current=Unknown Array failover mode: 4
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3073 UNKNOWN                   unknown   SP B1     active  dead       0      0
3073 UNKNOWN                   unknown   SP B0     active  dead       0      0
3073 UNKNOWN                   unknown   SP A1     active  dead       0      0
3073 UNKNOWN                   unknown   SP A0     active  dead       0      0
3074 UNKNOWN                   unknown   SP B0     active  dead       0      0
3074 UNKNOWN                   unknown   SP B1     active  dead       0      0
3074 UNKNOWN                   unknown   SP A0     active  dead       0      0
3074 UNKNOWN                   unknown   SP A1     active  dead       0      0

Note: EMC PowerPath is reporting the paths as "dead".

Volume Manager does not reference the "dead" EMC PowerPath devices.

# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
disk_0       auto:sliced     -            -            online
disk_1       auto:sliced     -            -            online
disk_2       auto:sliced     c2t0d0       rootdgrp4    online
emcpower0s2  auto:sliced     -            -            online
emcpower1s2  auto:cdsdisk    -            -            online
emcpower2s2  auto:sliced     -            -            online
emcpower3s2  auto:cdsdisk    -            -            online
emcpower4s2  auto:cdsdisk    -            -            online
emcpower8s2  auto:cdsdisk    -            -            online
emcpower9s2  auto:cdsdisk    emc0_0083    testdg       online
emcpower10s2 auto:cdsdisk    -            -            online
emcpower11s2 auto            -            -            error
emcpower12s2 auto:cdsdisk    -            -            online
emcpower13s2 auto            -            -            nolabel
emcpower14s2 auto:cdsdisk    -            -            online
emcpower15s2 auto:cdsdisk    -            -            online
emcpower16s2 auto:cdsdisk    -            -            online thin
emcpower17s2 auto:cdsdisk    -            -            online thin
emcpower18s2 auto:cdsdisk    emc0_0332    testdg       online thin

stop eventsource
 

Due to interoperability issues surrounding EMC PowerPath and vxesd. Ensure the "vxesd" (eventsource daemon) is stopped before preceeding.
 

# vxddladm stop eventsource

EMC PowerPath commands

The following EMC PowerPath commands can be performed in an attempt to clean-up the "dead" device entries:

# yes | powermt restore dev=all
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.

# /etc/powermt check dev=all class=clariion force
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.
Warning: CLARiiON device path unknown is currently dead.

Enable EMC PowerPath to refresh itself by removing the above "dead" devices.

# /etc/powercf -q

Could not validate the entry:
---------------------------------------
emcpower5: user ID = 11100000028
---------------------------------------

removing emcpower5

Could not validate the entry:
---------------------------------------
emcpower6: user ID = 11100000030
---------------------------------------

removing emcpower6

Could not validate the entry:
---------------------------------------
emcpower7: user ID = 11100000038
---------------------------------------

removing emcpower7

Update and save the recent EMC PowerPath changes

# /etc/powermt config
# /etc/powermt save

Refresh Solaris and Volume Manager

# devfsadm -Cvc disks

# vxdisk scandisks

Storage Foundation 5.0 MP3 introduces the "vxddladm assign names" command to dynamically update the /etc/vx/disk.info file.

# vxddladm assign names
# cat /etc/vx/disk.info
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030333333 emcpower17 0x4380078 0x4 emcpower17 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030333334 emcpower16 0x4380050 0x4 emcpower16 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290301414%5F140C6330 emcpower0 0x4380028 0x4 emcpower0 PP_EMC 000290301414
SEAGATE%5FST373207LSUN72G%5FDISKS%5F303534353330324636410000 c2t0d0 0x4380000 0x2 disk_2 Disk DISKS
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030333244 emcpower8 0x4380090 0x4 emcpower8 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030304539 emcpower13 0x4380068 0x4 emcpower13 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030333332 emcpower18 0x4380040 0x4 emcpower18 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290301414%5F14047330 emcpower1 0x4380018 0x4 emcpower1 PP_EMC 000290301414
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030303833 emcpower9 0x4380080 0x4 emcpower9 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030304542 emcpower11 0x4380058 0x4 emcpower11 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290301414%5F14045330 emcpower3 0x4380030 0x4 emcpower3 PP_EMC 000290301414
SEAGATE%5FST373307LSUN72G%5FDISKS%5F3035303342395A434C4C0000 c2t1d0 0x4380008 0x2 disk_0 Disk DISKS
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030304537 emcpower15 0x4380070 0x4 emcpower15 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030304538 emcpower14 0x4380048 0x4 emcpower14 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290301414%5F14046330 emcpower2 0x4380020 0x4 emcpower2 PP_EMC 000290301414
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030304541 emcpower12 0x4380088 0x4 emcpower12 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290300822%5F60060480000290300822533030303831 emcpower10 0x4380060 0x4 emcpower10 PP_EMC 000290300822
EMC%5FSYMMETRIX%5F000290301414%5F14044330 emcpower4 0x4380038 0x4 emcpower4 PP_EMC 000290301414
SEAGATE%5FST373307LSUN72G%5FDISKS%5F3035303342395A4636590000 c2t2d0 0x4380010 0x2 disk_1 Disk DISKS
 

Process complete.