Frequently getting monitor time out error on a particular group

book

Article ID: 100027658

calendar_today

Updated On:

Description

Error Message

Sep 6 04:13:21 HOSTNAME vcsmm: [ID 832650 kern.notice] VCSMM: mm_deblog_sz = 65536
Sep 6 04:13:21 HOSTNAME vcsmm: [ID 706457 kern.notice] VCSMM: mm_msglog_sz = 128
Sep 6 04:13:21 HOSTNAME vcsmm: [ID 838746 kern.notice] VCSMM: mm_slave_max = 32768
Sep 6 04:13:21 HOSTNAME nw99rut: [ID 702911 user.alert] flush_syslog_060912
Sep 6 04:15:28 HOSTNAME AgentFramework[14606]: [ID 702911 daemon.notice] VCS ERROR V-16-1-13027 Thread(7) Resource(GENASYSBATCHdg) - monitor procedure did not complete within the expected time.
Sep 6 04:15:28 HOSTNAME Had[14586]: [ID 702911 daemon.notice] VCS ERROR V-16-1-13027 (HOSTNAME) Resource(GENASYSBATCHdg) - monitor procedure did not complete within the expected time.
Sep 6 04:15:31 HOSTNAME inetd[3646]: [ID 317013 daemon.notice] auto_remote[27340] from x.xxx.xxx.xx 45154
Sep 6 04:21:31 HOSTNAME unix: [ID 836849 kern.notice]
Sep 6 04:21:31 HOSTNME ^Mpanic[cpu12]/thread=30081c96200
 

Cause

This appears to be an issue with either emcp or at the hba/array/san layer. 

- vxconfigd is queued up waiting on I/O and not responding to callers fast enough.

The diskgroup monitor paniced the box because vxconfigd was busy vxconfigd was busy/hung waiting for i/o and/or emcp PowerSleep

 

 

Resolution

 

Veritas recommended the following:
Upgrade SF 5.1SP1RP2 which addresses
a) DiskGroup agent defect e2078943 (Replace "vxdisk list "
with "vxdisk -s list ")
b) vxesd will be automatically disabled when PP is installed
OR
# vxdmpadm settune dmp_probe_idle_lun=off
# vxdmpadm settune dmp_monitor_fabric=off
# vxdmpadm settune dmp_restore_interval=60
# vxdmpadm stop restore (after every reboot)
# hatype –modify DiskGroup     FaultOnMonitorTimeouts 0
(OR you can change the default FaultOnMonitorTimeouts value from 4 to 8 or 10. 0 means do not fault)
 

Applies To

Solaris 10 running 5.0MP3 with EMC Powerpath

Issue/Introduction

EMCP powerpath routine PowerSleep causing hang in vxdmp.
Powered by Wolken Software