How to disable or enable AIX native Multi-Path I/O (MPIO) for LUNs with Array Product PID with the vxmpio utility
Article ID: 100028373
Updated On:
Description
Description
Background:
Previous procedures to disable AIX MPIO multipathing to allow VxVM-DMP multipathing control required multiple steps including the download and installation of ODM array definitions from the array vendor. .
Veritas now provides the vxmpio utility which will disable or enable MPIO for array specific LUNs.
What follows is a vxmpio-disable and vxmpio-enable procedure walkthrough of the vxmpio utility.
Procedure to disable AIX native MPIO multipathing to establish VxVM-DMP multipathing
1.0 We need to identify the SAN array LUNs provisioned to the host.
* With vxdisk list we can display the DEVICE of interest.
* Notice VxVM Enclosure Based Naming (EBN) is enabled. We can identify the EMC storage LUNs.
# vxdisk -eo alldgs list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTRemc0_0 auto:none - - online invalid hdisk1 -emc0_1 auto:none - - online invalid hdisk2 -emc0_2 auto:none - - online invalid hdisk3 -emc0_3 auto:none - - online invalid hdisk4 -emc0_4 auto:none - - online invalid hdisk5 -emc0_5 auto:none - - online invalid hdisk6 -emc0_6 auto:none - - online invalid hdisk7 -emc0_7 auto:none - - online invalid hdisk8 -emc0_8 auto:none - - online invalid hdisk9 -emc0_9 auto:none - - online invalid hdisk10 -ibm_ds8x000_0 auto:LVM - - LVM hdisk0 -* We can distinguish the emc0 and the ibm_ds8x0000_0 LUNs
* Our objective is place the EMC LUNs under VxVM-DMP multipathing control.
* But what is the AIX native MPIO multipathing status with the EMC LUNs?
2.0 We can check which devices are MPIO managed.
* We know from vxdisk-list we can reference the device OS_NATIVE_NAME
* It appears all LUNs in this lsdev-disk are under MPIO multipathing
# lsdev -c disk
hdisk0 Available 30-T1-01 MPIO Other FC SCSI Disk Drivehdisk1 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk2 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk3 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk4 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk5 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk6 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk7 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk8 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk9 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk10 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk11 Available 35-T1-01 MPIO Other FC SCSI Disk Drive* But we need to identify-confirm the EMC LUNs and we need to determine the PID for the vxmpio command
Note: If your lsdev -c disk output displays the following similar array specific error
# /etc/vx/bin/vxmpio disable pid=SYMMETRIX
VxVM vxmpio ERROR V-5-2-5826 MPIO already disabled, model_name 'SYMMETRIX' already exists in ODM* this indicates the EMC Symmetrix was previously defined in the AIX ODM database for MPIO multipathing.
In order to use the vxmpio utility you will need revert the previous ODM procedures for disk management.
Consult AIX procedures on the initial setup of MPIO and ODM. vxmpio utility assumes the new installation default AIX setup of MPIO.
2.1 How many paths does VxVM-DMP see?
# vxdisk list emc0_0
Device: emc0_0devicetag: emc0_0type: autoinfo: format=noneflags: online ready private autoconfig invalidpubpaths: block=/dev/vx/dmp/emc0_0 char=/dev/vx/rdmp/emc0_0guid: -udid: EMC%5FSYMMETRIX%5F000192600969%5F6900C84000site: -Multipathing information:numpaths: 1hdisk1 state=enabled <<<<<<<< VxVM see a single psuedo MPIO device path# vxdisk list emc0_1
Device: emc0_1devicetag: emc0_1type: autoinfo: format=noneflags: online ready private autoconfig invalidpubpaths: block=/dev/vx/dmp/emc0_1 char=/dev/vx/rdmp/emc0_1guid: -udid: EMC%5FSYMMETRIX%5F000192600969%5F6900C85000site: -Multipathing information:numpaths: 1hdisk2 state=enabled <<<<<<<< VxVM see a single psuedo MPIO device path# vxdmpadm getsubpaths
NAME STATE[A] PATH-TYPE[M] DMPNODENAME ENCLR-NAME CTLR ATTRS================================================================================hdisk1 ENABLED(A) - emc0_0 emc0 fscsi1 -hdisk2 ENABLED(A) - emc0_1 emc0 fscsi1 -hdisk3 ENABLED(A) - emc0_2 emc0 fscsi1 -hdisk4 ENABLED(A) - emc0_3 emc0 fscsi1 -hdisk5 ENABLED(A) - emc0_4 emc0 fscsi1 -hdisk6 ENABLED(A) - emc0_5 emc0 fscsi1 -hdisk7 ENABLED(A) - emc0_6 emc0 fscsi1 -hdisk8 ENABLED(A) - emc0_7 emc0 fscsi1 -hdisk9 ENABLED(A) - emc0_8 emc0 fscsi1 -hdisk10 ENABLED(A) - emc0_9 emc0 fscsi1 -hdisk0 ENABLED(A) - ibm_ds8x000_0 ibm_ds8x000 fscsi0 -# vxdisk path
SUBPATH DANAME DMNAME GROUP STATEhdisk1 emc0_0 - - ENABLEDhdisk2 emc0_1 - - ENABLEDhdisk3 emc0_2 - - ENABLEDhdisk4 emc0_3 - - ENABLEDhdisk5 emc0_4 - - ENABLEDhdisk6 emc0_5 - - ENABLEDhdisk7 emc0_6 - - ENABLEDhdisk8 emc0_7 - - ENABLEDhdisk9 emc0_8 - - ENABLEDhdisk10 emc0_9 - - ENABLEDhdisk0 ibm_ds8x000_0 - - ENABLED* Clearly AIX native MPIO multipathing is active; VxVM DMP is just a passenger.
* This is a Veritas unsupported configuration for VxVM-DMP and AIX
3.0 Now confirm-identify the EMC LUNs and determine the EMC PID
# lscfg -vl hdisk0
hdisk0 U9117.MMB.1017B7P-V6-C430-T1-W50050763090386B5-L0 MPIO Other FC SCSI Disk Drive Manufacturer................IBM <<<<<<<<<<<< array source Machine Type and Model......2107900 <<<<<<<<<<<< PID Part Number................. ROS Level and ID............2E323436 Serial Number...............75TK2710 EC Level.................... FRU Number.................. Device Specific.(Z0)........000005329F101002 Device Specific.(Z1)........82D Device Specific.(Z2)........075 Device Specific.(Z3)........05510 Device Specific.(Z4)........ Device Specific.(Z5)........ Device Specific.(Z6)........# lscfg -vl hdisk1
hdisk1 U9117.MMB.1017B7P-V6-C431-T1-W50000972080F2561-L0 MPIO Other FC SCSI Disk Drive Manufacturer................EMC <<<<<<<<<<<<< array source Machine Type and Model......SYMMETRIX <<<<<<<<<<<<< PID Part Number................. ROS Level and ID............35383734 Serial Number...............69C84000 EC Level....................`.i FRU Number..................D0 Device Specific.(Z0)........000004329008100A Device Specific.(Z1)........@ Device Specific.(Z2)........ Device Specific.(Z3)........ Device Specific.(Z4)........T. Device Specific.(Z5)..........# lscfg -vl hdisk11
hdisk11 U9117.MMB.1017B7P-V6-C435-T1-W50000972080F2524-L0 MPIO Other FC SCSI Disk Drive Manufacturer................EMC <<<<<<<<<<<<< array source Machine Type and Model......SYMMETRIX <<<<<<<<<<<<< PID Part Number................. ROS Level and ID............35383734 Serial Number...............69246000 EC Level........................i FRU Number..................D0 Device Specific.(Z0)........000004329008100A Device Specific.(Z1)........@ Device Specific.(Z2)........ Device Specific.(Z3)........ Device Specific.(Z4)........U. Device Specific.(Z5)..........* We need to disable MPIO multipathing EMC LUNs using the PID "SYMMETRIX" string
4.0 Before we disable MPIO we need to temporarily remove VxVM "view" or "claim" of the LUNs.
* The vxmpio command will complain the EMC LUNs are in use
# for d in `vxdisk list | grep emc0_ | awk '{print $1}'`; do vxdisk rm $d; done
* recheck vxdisk-list
# vxdisk -eo alldgs list
DEVICE TYPE DISK GROUP STATUS OS_NATIVE_NAME ATTRibm_ds8x000_0 auto:LVM - - LVM hdisk0 -* VxVM is now released from the EMC LUNs
5.0 We can now disable AIX native MPIO multipathing for the EMC LUNs
* We will use the vxmpio utility
Important: vxmpio use with SAN root/boot disks
Do not use vxmpio to unmanage MPIO controlled SAN root/boot disks. The vxmpio utility was not designed to handle SAN boot disks, the utility will be enhanced to report a user friendly error message going forward, until we can support it. Here we are disabling MPIO on EMC disks.
Do not use vxmpio to unmanage MPIO controlled SAN root/boot disks. The vxmpio utility was not designed to handle SAN boot disks, the utility will be enhanced to report a user friendly error message going forward, until we can support it. Here we are disabling MPIO on EMC disks.
# /etc/vx/bin/vxmpio disable pid=SYMMETRIX
Running bosboot ..bosboot: Boot image is 46917 512 byte blocks.VxVM vxmpio INFO V-5-2-5828 Please reboot the machine to disable MPIO support for SYMMETRIX* vxmpio-disable completed but a reboot is required
# reboot
6.0 Now check the lsdev-disk device output
* Notice what is different with this output (compare with 2.0 above)
# lsdev -c disk
hdisk0 Available 30-T1-01 MPIO Other FC SCSI Disk Drive <<<< IBM LVM LUNhdisk1 Available 31-T1-01 Other FC SCSI Disk Drive <<<< EMC multi-device paths per LUNhdisk2 Available 31-T1-01 Other FC SCSI Disk Drivehdisk3 Available 31-T1-01 Other FC SCSI Disk Drivehdisk4 Available 31-T1-01 Other FC SCSI Disk Drivehdisk5 Available 31-T1-01 Other FC SCSI Disk Drivehdisk6 Available 31-T1-01 Other FC SCSI Disk Drivehdisk7 Available 31-T1-01 Other FC SCSI Disk Drivehdisk8 Available 31-T1-01 Other FC SCSI Disk Drivehdisk9 Available 31-T1-01 Other FC SCSI Disk Drivehdisk10 Available 31-T1-01 Other FC SCSI Disk Drivehdisk11 Available 35-T1-01 Other FC SCSI Disk Drivehdisk12 Available 35-T1-01 Other FC SCSI Disk Drivehdisk13 Available 35-T1-01 Other FC SCSI Disk Drivehdisk14 Available 35-T1-01 Other FC SCSI Disk Drivehdisk15 Available 35-T1-01 Other FC SCSI Disk Drivehdisk16 Available 35-T1-01 Other FC SCSI Disk Drivehdisk17 Available 35-T1-01 Other FC SCSI Disk Drivehdisk18 Available 35-T1-01 Other FC SCSI Disk Drivehdisk19 Available 35-T1-01 Other FC SCSI Disk Drivehdisk20 Available 35-T1-01 Other FC SCSI Disk Drivehdisk21 Available 35-T1-01 Other FC SCSI Disk Drive* Notice "MPIO Other" is now just "Other" with MPIO vxmpio-disabled EMC LUNs
* Also notice there are now twice as many "hdisk" devices (11 count prior to vxmpio-disable)
# lsdev -c disk |egrep -v MPIO |egrep -c "Other"
20* This means the hdisk# are device paths for each EMC LUN
* Notice too VxVM vxdisk-path sees two paths per EMC "DANAME"
# vxdisk path
SUBPATH DANAME DMNAME GROUP STATEhdisk18 emc0_0c8a - - ENABLEDhdisk7 emc0_0c8a - - ENABLEDhdisk19 emc0_0c8b - - ENABLEDhdisk8 emc0_0c8b - - ENABLEDhdisk20 emc0_0c8c - - ENABLEDhdisk9 emc0_0c8c - - ENABLEDhdisk21 emc0_0c8d - - ENABLEDhdisk10 emc0_0c8d - - ENABLEDhdisk12 emc0_0c84 - - ENABLEDhdisk1 emc0_0c84 - - ENABLEDhdisk13 emc0_0c85 - - ENABLEDhdisk2 emc0_0c85 - - ENABLEDhdisk14 emc0_0c86 - - ENABLEDhdisk3 emc0_0c86 - - ENABLEDhdisk15 emc0_0c87 - - ENABLEDhdisk4 emc0_0c87 - - ENABLEDhdisk16 emc0_0c88 - - ENABLEDhdisk5 emc0_0c88 - - ENABLEDhdisk17 emc0_0c89 - - ENABLEDhdisk6 emc0_0c89 - - ENABLEDhdisk0 ibm_ds8x000_0 - - ENABLED7.0 With MPIO multipathing out-of-the-way or disabled for the EMC LUNs, VxVM DMP multipathing --rescanned after reboot-- is now in control.
* vxdmpadm display multiple paths per "DMPNODENAME"
# vxdmpadm getsubpaths
NAME STATE[A] PATH-TYPE[M] DMPNODENAME ENCLR-NAME CTLR ATTRS================================================================================hdisk1 ENABLED(A) - emc0_0c84 emc0 fscsi1 -hdisk12 ENABLED(A) - emc0_0c84 emc0 fscsi2 -hdisk13 ENABLED(A) - emc0_0c85 emc0 fscsi2 -hdisk2 ENABLED(A) - emc0_0c85 emc0 fscsi1 -hdisk14 ENABLED(A) - emc0_0c86 emc0 fscsi2 -hdisk3 ENABLED(A) - emc0_0c86 emc0 fscsi1 -hdisk15 ENABLED(A) - emc0_0c87 emc0 fscsi2 -hdisk4 ENABLED(A) - emc0_0c87 emc0 fscsi1 -hdisk16 ENABLED(A) - emc0_0c88 emc0 fscsi2 -hdisk5 ENABLED(A) - emc0_0c88 emc0 fscsi1 -hdisk17 ENABLED(A) - emc0_0c89 emc0 fscsi2 -hdisk6 ENABLED(A) - emc0_0c89 emc0 fscsi1 -hdisk18 ENABLED(A) - emc0_0c8a emc0 fscsi2 -hdisk7 ENABLED(A) - emc0_0c8a emc0 fscsi1 -hdisk19 ENABLED(A) - emc0_0c8b emc0 fscsi2 -hdisk8 ENABLED(A) - emc0_0c8b emc0 fscsi1 -hdisk20 ENABLED(A) - emc0_0c8c emc0 fscsi2 -hdisk9 ENABLED(A) - emc0_0c8c emc0 fscsi1 -hdisk10 ENABLED(A) - emc0_0c8d emc0 fscsi1 -hdisk21 ENABLED(A) - emc0_0c8d emc0 fscsi2 -hdisk0 ENABLED(A) - ibm_ds8x000_0 ibm_ds8x000 fscsi0 -* vxdisk-list dmpnodename
# vxdisk list emc0_0c84
Device: emc0_0c84devicetag: emc0_0c84type: autoinfo: format=noneflags: online ready private autoconfig invalidpubpaths: block=/dev/vx/dmp/emc0_0c84 char=/dev/vx/rdmp/emc0_0c84guid: -udid: EMC%5FSYMMETRIX%5F000192600969%5F6900C84000site: -Multipathing information:numpaths: 2hdisk12 state=enabled <<<<<<<<<<<<<<<<<<<hdisk1 state=enabled <<<<<<<<<<<<<<<<<<<Procedure RE-ENABLE AIX Native MPIO multipathing with the vxmpio utility
65.0 Procedure to enable MPIO support (MPIO will do the multipathing):
Execute following command:
/etc/vx/bin/vxmpio enable pid=< product_id >
# /etc/vx/bin/vxmpio enable pid=SYMMETRIX
Method error (/usr/lib/methods/ucfgdevice): 0514-062 Cannot perform the requested function because the specified device is busy.VxVM vxmpio ERROR V-5-2-5825 Failed to remove devices hdisk1265.1 Above command failed because devices tied to VxVM at this time appear “busy”
* The vxmpio operation fails. We need to remove devices from VxVM and re-run vxmpio-enable command again.
* Be sure do vxdisk rm on each device to release all open counts.
# for d in `vxdisk list | grep emc0_ | awk '{print $1}'`; do vxdisk rm $d; done
# vxdisk list
DEVICE TYPE DISK GROUP STATUSibm_ds8x000_0 auto:LVM - - LVM66.0 Use vxmpio command to return MPIO multipathing to the EMC LUNs
# /etc/vx/bin/vxmpio enable pid=SYMMETRIX
hdisk1 deletedhdisk2 deletedhdisk3 deletedhdisk4 deletedhdisk5 deletedhdisk6 deletedhdisk7 deletedhdisk8 deletedhdisk9 deletedhdisk10 deletedhdisk11 deletedhdisk12 deletedhdisk13 deletedhdisk14 deletedhdisk15 deletedhdisk16 deletedhdisk17 deletedhdisk18 deletedhdisk19 deletedhdisk20 deletedhdisk21 deletedRunning bosboot ..bosboot: Boot image is 46914 512 byte blocks.VxVM vxmpio INFO V-5-2-5829 Please reboot the machine to enable MPIO support for SYMMETRIX* Reboot the system to see if MPIO is enabled for devices or not.
67.0 After reboot we see MPIO is back
# lsdev -c disk
hdisk0 Available 30-T1-01 MPIO Other FC SCSI Disk Drivehdisk1 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk2 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk3 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk4 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk5 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk6 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk7 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk8 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk9 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk10 Available 31-T1-01 MPIO Other FC SCSI Disk Drivehdisk11 Available 35-T1-01 MPIO Other FC SCSI Disk Drive* MPIO multipathing now presents psuedo devices to VxVM-DMP
67.1 We see VxVM-DMP sees the single pseudo device path per LUN from MPIO
# vxdmpadm getsubpaths
NAME STATE[A] PATH-TYPE[M] DMPNODENAME ENCLR-NAME CTLR ATTRS================================================================================hdisk1 ENABLED(A) - emc0_0 emc0 fscsi1 -hdisk2 ENABLED(A) - emc0_1 emc0 fscsi1 -hdisk3 ENABLED(A) - emc0_2 emc0 fscsi1 -hdisk4 ENABLED(A) - emc0_3 emc0 fscsi1 -hdisk5 ENABLED(A) - emc0_4 emc0 fscsi1 -hdisk6 ENABLED(A) - emc0_5 emc0 fscsi1 -hdisk7 ENABLED(A) - emc0_6 emc0 fscsi1 -hdisk8 ENABLED(A) - emc0_7 emc0 fscsi1 -hdisk9 ENABLED(A) - emc0_8 emc0 fscsi1 -hdisk10 ENABLED(A) - emc0_9 emc0 fscsi1 -hdisk0 ENABLED(A) - ibm_ds8x000_0 ibm_ds8x000 fscsi0 -(AIX)(c1062-p7701-mp4) /{4.EN_US}* The count is now 10 EMC devices (pseudo devices)
# vxdmpadm getsubpaths |egrep -c emc0_10
68.0 Furthermore we see MPIO multipathing is back in control with the EMC LUNs with lspath command
If you check following command then you see MPIO is managing two paths:
# lspath -l hdisk1
Enabled hdisk1 fscsi1Enabled hdisk1 fscsi2# lspath -l hdisk10
Enabled hdisk10 fscsi1Enabled hdisk10 fscsi2* VxVM-DMP is now just a passenger with MPIO multipathing in the driver seat presenting the pseudo device per LUN
# vxdmpadm getsubpaths
NAME STATE[A] PATH-TYPE[M] DMPNODENAME ENCLR-NAME CTLR ATTRS================================================================================hdisk1 ENABLED(A) - emc0_0 emc0 fscsi1 -hdisk2 ENABLED(A) - emc0_1 emc0 fscsi1 -hdisk3 ENABLED(A) - emc0_2 emc0 fscsi1 -hdisk4 ENABLED(A) - emc0_3 emc0 fscsi1 -hdisk5 ENABLED(A) - emc0_4 emc0 fscsi1 -hdisk6 ENABLED(A) - emc0_5 emc0 fscsi1 -hdisk7 ENABLED(A) - emc0_6 emc0 fscsi1 -hdisk8 ENABLED(A) - emc0_7 emc0 fscsi1 -hdisk9 ENABLED(A) - emc0_8 emc0 fscsi1 -hdisk10 ENABLED(A) - emc0_9 emc0 fscsi1 -hdisk0 ENABLED(A) - ibm_ds8x000_0 ibm_ds8x000 fscsi0 -Applies To
AIX environments with SAN array attached LUNs where native AIX MPIO multipathing is enabled.
Issue/Introduction
How to disable or enable AIX native Multi-Path I/O (MPIO) for LUNs with Array Product PID with the vxmpio utility
Was this article helpful?
Yes
No
Powered by
