How to add EMC DMX luns to a Linux server using DMP
Article ID: 100037882
Updated On:
Description
Description
LUN Addition
LUN Addition
This document attempts to explain the essential steps required to present(mask) EMC storage devices controlled by DMP to a Linux server.
In this instance, EMC storage is going to be used to illustrate the requirements outlined by Veritas.
The recommended Veritas Volume Manager version’s are:
5.0 MP4
5.1 SP1 RP1 P1 HF3 ( 5.1 SP1 RP2 )
6.0
LUN Provisioning Pre-Checks
Check the /etc/vx/disk.info file contents.
# grep "0xfff" /etc/vx/disk.info
Example of a LUN that has not been removed correctly, hence the “0xffffffff” entry EMC%5FSYMMETRIX%5F000290300822%5F2200264000 sdaf 0xffffffffffffffff 0x2
emc0_0264 EMC 000290300822
Refresh VxVM & DMP.
Refresh DDL layer and dev_t list.
1.] vxdisk scandisks
2.] vxddladm assign names
3.] grep "0xffff" /etc/vx/disk.info
EMC DMX STORAGE OVERVIEW
HBA and WWN content
symmask discover hba refresh the HBA details for the local server
symmask list hba display the WWN and HBA details for the local server
vxdmpadm getctlr all display WWN and HBA details using DMP
vxlist ctlr display WWN and HBA details using DMP
LUN masking commands
Sample syntax shown below for each command:
symmaskdb -sid
# symmaskdb -sid 822 list devs -wwn 210000e08b1c1df0
symmask –sid
# symmask –sid 822 list assign –dev 0264
symmask –sid
# symmask -sid 822 -wwn 210000e08b1c1df0 remove devs 0264 -dir 16c -p 0
# symmask -sid 822 -wwn 210000e08b1c1df0 remove devs 0264 -dir 1c -p 1
symmask refresh and symcfg discover# symmask –sid 822 refresh –noprompt
# symcfg –sid 822 discover
SAMPLE SYMMASK HBA OUTPUT
The SYMCLI command “symmask discover hba” refreshes the HBA content:
# symmask discover hba
Symmetrix ID : 000290300822
Device Masking Status : Success
Identifier Type User-generated Name
---------------- ----- ---------------------------------
210000e08b1c1df0 Fibre pluto/210000e08b1c1df0
Symmetrix ID : 000290301414
Device Masking Status : Success
Identifier Type User-generated Name
---------------- ----- ---------------------------------
210000e08b1c1df0 Fibre pluto/210000e08b1c1df0
EMC enclosure emc0, relates to Symmetrix ID (SID) “00290300822”, which is masked to WWN “210000e08b1c1df0”.
LIST WWN CONTENT
The SYMCLI command “symmask list hba” displays the WWN related content:
# symmask list hba
Identifier Type Adapter Physical Device Path Dir:P
---------------- ----- ---------------- ------------------------ -----
210000e08b1c1df0 Fibre 210000e08b1c1df0 /dev/sdj 16C:0
/dev/sdad 16C:1
/dev/sdax 16C:0
/dev/sday 16C:1
# /opt/VRTSsfmh/bin/vxlist ctlr
TY NAME TYPE STATE WWN PNAME
hba c0 FC online - c0
hba c1 FC online 210000E08B1C1DF0 c1
Note: EMC enclosure emc0, relates to Symmetrix ID (SID) “00290300822”, which is masked to WWN “210000E08B1C1DF0”.
LIST LINUX HBA WWN CONTENT
How to determine the HBA WWN related content for a Linux based server using systool :
# systool -c fc_host -v | egrep '(Device|name)'
Class Device = "host1"
Class Device path = "/sys/class/fc_host/host1"
fabric_name = "0x100500021e7c11"
node_name = "0x200000e08b1c1df0"
port_name = "0x210000e08b1c1df0"
symbolic_name = "QLA2340 FW:v3.03.26 DVR:v8.02.00.06.05.03-k"
system_hostname = ""
Device = "host1"
Device path = "/sys/devices/pci0000:00/0000:00:0a.0/0000:02:05.0/host1"
Note: EMC enclosure emc0, relates to Symmetrix ID (SID) “00290300822”, which is masked to WWN “210000e08b1c1df0”.
VIEW SYMDEV ASSIGNMENT PER SID
The SYMCLI command “symmaskdb –sid
# symmaskdb -sid 822 list assignment -dev 0264
Symmetrix ID : 000290300822
Device Identifier Type Dir:P
------ ---------------- ----- ----------------
0264 210000e08b1c1df0 FIBRE FA-16C:0,FA-16C:1
In this instance, the EMC storage (SYMDEV) to be assigned is 0264.
EMC enclosure emc0, relates to Symmetrix ID (SID) “00290300822”, which is masked to WWN “210000e08b1c1df0”.
LIST LUN ASSIGNMENT PER WWN
The SYMCLI command “symmaskdb –sid
# symmaskdb -sid 822 list devs -wwn 210000e08b1c1df0
Symmetrix ID : 000290300822
Originator Port wwn : 210000e08b1c1df0
User-generated Name : pluto/210000e08b1c1df0
Sym Dev LUN
Name Dir:P Physical Device Name VBUS TID SYMM HOST Attr Cap(MB)
------ ----- ----------------------- ---- --- ---- ---- ---- -------
0263 16C:0 /dev/sdk 0 0 10b b 10312
16C:1 /dev/sdk 0 0 f8 f8 10312
In this instance, the EMC storage (SYMDEV) 0264 will be presented to a Linux server.
# vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
emc0 EMC 000290300822 CONNECTED A/A 18
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200053300424 CONNECTED CLR-A/PF 1
# vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
emc0 EMC 000290300822 CONNECTED A/A 18
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200053300424 CONNECTED CLR-A/PF 1
# symmask -sid 822 -wwn 210000e08b1c1df0 add devs 0264 -dir 16c -p 0
# symmask -sid 822 -wwn 210000e08b1c1df0 add devs 0264 -dir 16c -p 1
The following devices are already assigned in at least one entry:
0264
Would you like to continue (y/[n])?y
# symmask -sid 822 refresh -noprompt
Symmetrix FA directors updated with contents of SymMask Database 000290300822
# symcfg -sid 822 discover
Attempting discovery of Symmetrix 000290300822
This operation may take up to a few minutes. Please be patient...
The newly provisioned is visible using both SYMCLI commands:
# symmaskdb - sid 822 list assignment -dev 0264
Symmetrix ID : 000290300822
Device Identifier Type Dir:P
------ ---------------- ----- ----------------
0264 210000e08b1c1df0 FIBRE FA-16C:0,FA-16C:1
# symmaskdb - sid 822 list devs – wwn 210000e08b1c1df0
Symmetrix ID : 000290300822
Originator Port wwn : 210000e08b1c1df0
User-generated Name : rdgv20z01/210000e08b1c1df0
Sym Dev LUN
Name Dir:P Physical Device Name VBUS TID SYMM HOST Attr Cap(MB )
------ ----- ----------------------- ---- --- ---- ---- ---- -------
0263 16C:0 /dev/ sdk 0 0 10b b 10312
16C:1 /dev/ sdk 0 0 f8 f8 10312
0264 16C:0 Not Visible 0 0 10c N/A 10312
16C:1 Not Visible 0 0 f9 N/A 10312
# echo "- - -" > /sys/class/scsi_host/host1/scan
# vxdisk scandisks
# grep 0264 /etc/vx/disk.info
EMC%5FSYMMETRIX%5F000290300822%5F2200264000 sdaf 0xc960 0x2 emc0_0264 EMC 000290300822
# vxddladm assign names
# grep 0xfff /etc/vx/disk.info
# vxdmpadm getsubpaths dmpnodename=emc0_0264
NAME STATE[A] PATH-TYPE[M] CTLR-NAME ENCLR-TYPE ENCLR-NAME ATTRS
================================================================================
sdaf ENABLED(A) - c1 EMC emc0 -
sdl ENABLED(A) - c1 EMC emc0 -
# lsscsi | egrep -w '(sdaf|sdl)'
[1:0:4:268] disk EMC SYMMETRIX 5773 /dev/sdl
[1:0:5:249] disk EMC SYMMETRIX 5773 /dev/sdaf
VALIDATE VISIBILITY OF PATHS
# vxdmpadm getsubpaths dmpnodename =emc0_0264
NAME STATE[A] PATH-TYPE[M] CTLR-NAME ENCLR-TYPE ENCLR-NAME ATTRS
================================================================================
sdaf ENABLED(A) - c1 EMC emc0 -
sdl ENABLED(A) - c1 EMC emc0 -
# lsscsi | egrep -w '( sdaf|sdl )'
[1:0:4:268] disk EMC SYMMETRIX 5773 /dev/ sdl
[1:0:5:249] disk EMC SYMMETRIX 5773 / dev/ sdaf
VALIDATE VISIBILITY OF PATHS
VERIFY ENCLOSURE LUN_COUNT
The emc0 enclosure LUN_COUNT was 18 prior to masking the LUN to the server:
# vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
emc0 EMC 000290300822 CONNECTED A/A 18
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200053300424 CONNECTED CLR-A/PF 1
The revised LUN_COUNT is now 19 following the addition process:
# vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS ARRAY_TYPE LUN_COUNT
=======================================================================================
emc0 EMC 000290300822 CONNECTED A/A 19
disk Disk DISKS CONNECTED Disk 1
emc_clariion0 EMC_CLARiiON CK200053300424 CONNECTED CLR-A/PF 1
Process complete.
Issue/Introduction
