"VxVM vxio V-5-3-1112 voldio: I/O hung; disallowing all I/Os to the disk" appears if some of the paths to a device fail

book

Article ID: 100012878

calendar_today

Updated On:

Description

Error Message

Vxconfigd stack during the problem

cv_wait()
delay_common()
delay()
vol_disk_change_iopolicy()
volsioctl_real()
fop_ioctl()
ioctl()
syscall_trap32()
 

Below, error messages can be seen:

vxdmp: [ID 447055 kern.notice] NOTICE: VxVM vxdmp V-5-0-0 failover initiated for 289/0x10
vxdmp: [ID 447055 kern.notice] NOTICE: VxVM vxdmp V-5-0-0 curpri set to primary for 289/0x10
vxio: [ID 284607 kern.warning] WARNING: VxVM vxio V-5-3-1146 voldsio_timeout: Timeout value 240 seconds, actual io time 240 seconds, I/O Timedout, bad disk?
vxio: [ID 316113 kern.warning] WARNING: VxVM vxio V-5-3-1111 voldio: I/O Timedout on disk c1t5d0s2, 1 I/Os hung on the disk!
vxio: [ID 393703 kern.warning] WARNING: VxVM vxio V-5-3-1112 voldio: I/O hung; disallowing all I/Os to the disk.
vxio: [ID 553511 kern.warning] WARNING: VxVM vxio V-5-3-1160 vol_disk_change_iopolicy: TIMEOUT timeout = f1
 

 

Cause

On Active/Passive arrays, IO’s get scheduled on primary paths and secondary paths are on standby. When primary path has IO failure, failover happens and secondary path is used for IO’s. During this process, NODE_QUIESCED flag is marked on primary paths. If this path is selected for IO after this flag is set then IO's are put in defer queue. These deferred IO's will get processed after QUIESCED flag is removed. But due to a defect in the code, this flag is not cleared and IO hangs resulting in the above issue.

 

 

Resolution

The fix for this issue is included in the latest GA patch 5.1SP1RP4, available through SORT.
 

 

 

 

 

 

 

Issue/Introduction

When some paths to a device on A/P array fail, VxVM commands such as vxdisk scandisks are hung or I/Os on VxVM volumes are hung. VxVM commands are waiting for vxconfigd daemon to respond whereas vxconfigd is hung with a stack waiting for I/Os to complete from DMP. This could occur during events like disk array firmware upgrade, zone remove/add operations.

Additional Information

ETrack: 2792242
Powered by Wolken Software