2011/03/10 18:45:19 VCS WARNING V-16-1-53025 Agent Application has faulted; ipm connection was lost; restarting the agent
2011/03/10 18:45:23 VCS WARNING V-16-1-53025 Agent CFSfsckd has faulted; ipm connection was lost; restarting the agent
2011/03/10 18:45:23 VCS WARNING V-16-1-53025 Agent CVMCluster has faulted; ipm connection was lost; restarting the agent
Oracle was doing an export and writing to /tmp during the window which created contention.
These errors will occur when the system is heavily loaded. There is an interprocess communication between the VCS agents and the had daemon. If this communication is disrupted (due to system load), the agent will fault, and had will restart the agent. Since there are multiple agents reporting this, this indicates a system load issue.