Veritas Storage Foundation Cluster File System and High Availability (SFCFSHA) 6.1.1 installation and configuration support on RHEL 6.5 with SYBASE ASE CE 15.7

book

Article ID: 100014112

calendar_today

Updated On:

Description

STEP1: Install and configure Veritas Storage Foundation™ Cluster File System and High Availability 6.1.1 (SFCFSHA 6.1.1)

 
1.   Review Installation Overview and Planning.
      Refer Veritas Storage Foundation™ Cluster File System and High Availability 6.1 Installation Guide - Linux, section 1: Installation Overview and Planning.
 
      Note: Non-SCSI3 based fencing and Coordination Point Server based fencing is not supported with SF Sybase ASE CE.
 
2.   Verify and complete the preinstallation steps to install SFCFSHA.
      Refer Veritas Storage Foundation™ Cluster File System and High Availability 6.1 Installation Guide -Linux, section 2: Preparing to install SFCFSHA.
 
3.   Install and configure SFCFSHA.
      Refer Veritas Storage Foundation™ and High Availability solutions 6.1.1 Installation Guide -Linux, chapter 2: Installing the products for the first time.
 
      Note: While configuring SFCFSHA cluster for data integrity, configure disk based fencing.
 

STEP 2: Configure fencing in Sybase mode

 
1.   Stop VCS on all cluster nodes. Run the following command on one of the cluster nodes.
 
      # hastop –all
 
2.   Stop Fencing on all cluster nodes. Run the following command on all the cluster nodes.
 
      # /etc/init.d/vxfen stop
 
3.   Edit /etc/vxfenmode file on all nodes.
 
      Set vxfen_mode=sybase
 
4.   Start Fencing on all cluster nodes. Run the following command on all the cluster nodes.
 
      # /etc/init.d/vxfen start
 
5.   Start VCS on all cluster nodes. Run the following command on all the cluster nodes.
 
      # hastart
 

STEP 3: Install Sybase ASE CE

 

For installing Sybase ASE CE in a SFCFSHA environment, follow the steps mentioned below:
 
a.     Create the Sybase user and groups. For more information, see Sybase ASE CE documentation.
 
b.     Create local or shared disk group, volume, and mount point for Sybase binary installation.
 
        To create the disk group, volume and mount point for Sybase binaries (Local mount point)
 
1.  Initialize the disk.
     For example:
     # vxdisksetup -i Disk_1 format=cdsdisk
 
2.  Create a diskgroup.
     For example on system sys1:
    # vxdg init sybhome_sys1 Disk_1 Disk_2
 
3.  Create a mirrored volume in the group:  
 # vxassist -g sybhome_sys1 make sybhomevol\
      12G layout=mirrored nmirrors=2
 
4.  Create a VxFS file system on which to install the Sybase binaries:
  # mkfs -t vxfs /dev/vx/rdsk/sybhome_sys1/sybhomevol
 
 
     For a binary installation on a local file system, run the command on each node.
 
5.  Create the sybase home ($SYBASE) directory on the node:
  # mkdir /sybase_home
 
6.  Mount the directory:
  # mount -t vxfs /dev/vx/dsk/sybhome_sys1/sybhomevol /sybase_home
 
7.  Repeat the above steps on all other cluster nodes (for example on system sys2).
 
8.  On each system, change permission of the directory to sybase.
     # chown -R sybase:sybase /sybase_home
 
 
 
To create the disk group, volume and mount point for Sybase binaries (For shared mount point)
 
1.  Initialize the disk.
 
     For example:
     # vxdisksetup -i Disk_1 format=cdsdisk
 
2.  Create a CVM diskgroup.
 
     For example:
     # vxdg -s init sybhome Disk_1 Disk_2
 
3.  Create a mirrored volume in the group:
     # vxassist -g sybhome make sybhomevol 12G layout=mirrored nmirrors=2
 
4.  Create a VxFS file system on which to install the Sybase binaries:
  # mkfs -t vxfs -o largefiles /dev/vx/rdsk/sybhome/sybhomevol
 
    For a binary installation on a shared file system, you may run the command on any one node.
 
5.  Create a Sybase ASE CE home directory ($SYBASE) on all nodes:
    # mkdir /sybase_home
 
 
6.  Mount the directory on all the nodes in the cluster:
   # mount –t vxfs -o cluster /dev/vx/dsk/sybhome/sybhomevol /sybase_home
 
7.  On each system, change permission of the directory to sybase.
     # chown -R sybase:sybase /sybase_home
 
c.  Install Sybase ASE CE.
 
For information on installing Sybase ASE CE software, see the Sybase ASE CE product documentation.
 
Requirements for the Sybase ASE CE configuration:
 
■ Use the VxFS or CFS mount points you created in the previous section for installing the binaries
 
d.  Create a disk group, volume, and mount point for the Sybase quorum device.
 
To create the disk group, volume and mount point for a quorum device:
 
1.  Initialize the disk.
 
     For example:
    # vxdisksetup -i Disk_3 format=cdsdisk
      # vxdisksetup -i Disk_4 format=cdsdisk
 
2 . As root user, from the CVM master, create a shared VxVM disk group for the quorum device.
   # vxdg -s init quorumdg Disk_3 Disk_4
 
3.  As root user, from the CVM master, create a mirrored volume, quorumvol:
    # vxassist -g quorumdg make quorumvol 1G layout=mirrored nmirrors=2
 
4.  As root user, from the CVM master, create a file system with the volume, quorumvol.
   # mkfs -t vxfs /dev/vx/rdsk/quorumdg/quorumvol
 
5.  On each system, create a directory, /quorum:
 
     # mkdir /quorum
 
6.  On each system, mount /quorum.
     # mount -t vxfs -o cluster /dev/vx/dsk/quorumdg/quorumvol /quorum
 
7.  As root user, from any system, change permissions on /quorum.
 
     # chown -R sybase:sybase /quorum
 
e.  Create a disk group, volume, and mount point for the Sybase data files.
 
     To create the disk group, volume and mount point for the datafiles:
 
1.  Initialize the disk.
 
     For example:
    # vxdisksetup -i Disk_5 format=cdsdisk
      # vxdisksetup -i Disk_6 format=cdsdisk
 
2.  As root user, create a shared VxVM disk group for the datafiles.
 
    # vxdg -s init sybdatadg Disk_5 Disk_6
 
3.  As root user, create a mirrored volume, sybdatavol:
   # vxassist -g sybdatadg make sybdatavol 10G layout=mirrored nmirrors=2
 
4.  As root user, create a file system with the volume, sybvol.
   # mkfs -t vxfs /dev/vx/rdsk/sybdatadg/sybdatavol
 
5.  On each system, create a directory, /sybdata:
 
     # mkdir /sybdata
 
6.  On each system, mount /sybdata
   # mount -t vxfs -o cluster /dev/vx/dsk/sybdatadg/sybdatavol /sybdata
 
7.  As root user, from any system, change permissions on /sybdata
 
     # chown -R sybase:sybase /sybdata
 
f.    Create the Sybase ASE CE cluster
 
For information on creating a Sybase ASE CE cluster, see the Sybase ASE CE product documentation. Follow the normal process.
 
Requirements for the Sybase ASE CE configuration:
 
■ When you choose the private interconnect, set them on LLT links
■ SF Sybase CE supports only one instance per node
■ You can create a VCS cluster in local mode. Ignore the message "If you want to create a VCS cluster, specify "Shared" mode.", if it appears.
■ Put the quorum device on the mount point created for the quorum device.
   See “To create the disk group, volume and mount point for a quorum device”
■ Put the datafiles on the mount point created in for the datafiles.
   See “To create the disk group, volume and mount point for the datafiles”
 
g.  Configure Sybase ASE CE instances under VCS control. For more information, refer to STEP 4 “Configure Sybase ASE CE under VCS control” below.
 

STEP 4: Configure Sybase ASE CE under VCS control

 
a.  Configure VCS service group manually for Sybase binaries.
 
     To configure the VCS service group manually for Sybase binaries, follow the steps mentioned below:
 
1.  Make the VCS configuration writable.
     # haconf -makerw
 
2. Create VCS Service Group for Sybase binaries.
   
    # hagrp -add binmnt
  # hagrp -modify binmnt  SystemList  sys1  0  sys2  1
  # hagrp -modify binmnt  AutoStartList  sys1  sys2
  # hagrp -modify binmnt  Parallel  1
  # hagrp -modify binmnt  OnlineRetryLimit  3
  # hagrp -modify binmnt  OnlineRetryInterval  120
 
3.     Create VCS resource for CFS mount for Sybase biaries
 
    # hares -add sybbinmnt CFSMount binmnt
    # hares -modify sybbinmnt Critical 0
    # hares -modify sybbinmnt MountPoint /sybase_home
    # hares -modify sybbinmnt BlockDevice /dev/vx/dsk/sybhome/sybhomevol
    # hares -modify sybbinmnt Enabled 1
 
4.     Create VCS resource for CVM Diskgroup and Volumes used for Sybase binaries
 
   # hares -add sybbinvoldg CVMVolDg binmnt
   # hares -modify sybbinvoldg Critical 0
   # hares -modify sybbinvoldg CVMDiskGroup sybhome
   # hares -modify sybbinvoldg CVMVolume sybhomevol
   # hares -modify sybbinvoldg CVMActivation sw
   # hares -modify sybbinvoldg Enabled 1
 
5.  Create dependency between the resources in VCS service group for Sybase binaries.
 
  # hares -link sybbinmnt sybbinvoldg 
  # hagrp -link binmnt cvm
 
Note: The above  configuration considers sybase binaries on shared VxFS.
 
6.  Configure ResStateChange trigger.
 
     #cp /mnt/cdrom/rhel6_x86_64/scripts/resstatechange /opt/VRTSvcs/bin/triggers/resstatechange
 
b.  Configure VCS service group manually for Sybase database.
 
     To configure the VCS service group manually for Sybase database, follow the steps mentioned below:
 
1.  Create VCS Service Group for Sybase database.
 
  # hagrp -add sybasece
  # hagrp -modify sybasece SystemList sys1 0 sys2 1
  # hagrp -modify sybasece AutoStartList sys1 sys2
  # hagrp -modify sybasece Parallel 1
  # hagrp -modify sybasece AutoFailOver 0
  # hagrp -modify sybasece TriggerResStateChange 1
  # hagrp -modify sybasece OnlineRetryInterval 120
  # hagrp -modify sybasece OnlineRetryLimit 3
 
2.  Create VCS resource for CFS mount for Sybase quorum.
 
  # hares -add quorummnt CFSMount sybasece
  # hares -modify quorummnt Critical 0
  # hares -modify quorummnt MountPoint /quorum
  # hares -modify quorummnt BlockDevice  /dev/vx/dsk/quorumdg/quorumvol
  # hares -modify quorummnt Enabled 1
 
3.  Create VCS resource for CVM diskgroup and volume for Sybase quorum.
 
  # hares -add quorumdg CVMVolDg sybasece
  # hares -modify quorumdg Critical 0
  # hares -modify quorumdg CVMDiskGroup quorumdg
  # hares -modify quorumdg CVMVolume quorumvol
  # hares -modify quorumdg CVMActivation sw
  # hares -modify quorumdg Enabled 1
 
 
4.  Create VCS resource for CVM diskgroup and volume for Sybase data.
 
  # hares -add sybdatadg CVMVolDg sybasece
  # hares -modify sybdatadg Critical 0
  # hares -modify sybdatadg CVMDiskGroup sybdatadg
  # hares -modify sybdatadg CVMVolume sybdatavol
  # hares -modify sybdatadg CVMActivation sw
  # hares -modify sybdatadg Enabled 1
 
5.  Create VCS resource for CFS mount for Sybase data.
 
  # hares -add sybdatamnt CFSMount sybasece
  # hares -modify sybdatamnt Critical 0
  # hares -modify sybdatamnt MountPoint /sybdata
  # hares -modify sybdatamnt BlockDevice /dev/vx/dsk/sybdatadg/sybdatavol
  # hares -modify sybdatamnt Enabled 1
 
6.  Create VCS resource for monitoring vxfend process.
 
  # hares -add vxfend Process sybasece
  # hares -modify vxfend Critical 1
  # hares -modify vxfend PathName /sbin/vxfend
  # hares -modify vxfend Arguments -m sybase -k /tmp/vcmp_socket
  # hares -modify vxfend Enabled 1
 
7.  Create VCS resource for monitoring Sybase instance.
 
  # hares -add ase Sybase sybasece
  # hares -modify ase Critical 1
  # hares -local ase Server
  # hares -modify ase Server syb1 -sys sys1
  # hares -modify ase Server syb2 -sys sys2
  # hares -modify ase Owner sybase
  # hares -modify ase Home /sybase_home
  # hares -modify ase Version 15
  # hares -modify ase SA sa
  # hares -modify ase SApswd vcs123
  # hares -modify ase Run_ServerFile /sybase_home/ASE-15_0/install\/RUN_syb2 sys2
  # hares -modify ase Run_ServerFile /sybase_home/ASE-15_0/install\/RUN_syb1 sys1
  # hares -modify ase Quorum_dev /quorum/qfile2
  # hares -modify ase Enabled 1
 
 
8.  Create dependency between the resources in VCS service group for Sybase binaries.
 
  # hares -link quorummnt quorumdg
  # hares -link sybdatamnt sybdatadg  
  # hares -link ase vxfend  
  # hares -link ase quorummnt  
  # hares -link ase sybdatamnt  
  # hagrp -link sybasece binmnt 
 
9.  Dump the configuration and make it read-only.
 
  # haconf -dump -makero
 

Sample main.cf for a basic Sybase ASE CE cluster configuration under VCS control with shared mount point on CFS for Sybase binary installation

 
include "types.cf"
include "CFSTypes.cf"
include "CVMTypes.cf"
include "SybaseTypes.cf"
 
cluster sybase (
     UserNames = { admin = INOgNInKOjOOmWOiNL }
     Administrators = { admin }
     UseFence = SCSI3
     HacliUserLevel = COMMANDROOT
     )
 
system sys1 (
     )
 
system sys2 (
     )
 
group binmnt (
     SystemList = { sys1 = 0, sys2 = 1 }
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     OnlineRetryLimit = 3
     OnlineRetryInterval = 120
     )
 
     CFSMount sybbinmnt (
         Critical = 0
         MountPoint = "/sybase_home"
         BlockDevice = "/dev/vx/dsk/sybhome/sybhomevol"
         )
 
     CVMVolDg sybbinvoldg (
         Critical = 0
         CVMDiskGroup = sybhome
         CVMVolume = { sybhomevol }
         CVMActivation = sw
         )
 
     requires group cvm online local firm
     sybbinmnt requires sybbinvoldg
 
 
     // resource dependency tree
     //
     //   group binmnt
     //   {
     //   CFSMount sybbinmnt
     //       {
     //       CVMVolDg sybbinvoldg
     //       }
     //   }
 
 
group cvm (
     SystemList = { sys1 = 0, sys2 = 1 }
     AutoFailOver = 0
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     )
 
     CFSfsckd vxfsckd (
         )
 
     CVMCluster cvm_clus (
         CVMClustName = sybase
         CVMNodeId = { sys1 = 0, sys2 = 1 }
         CVMTransport = gab
         CVMTimeout = 200
         )
 
     CVMVxconfigd cvm_vxconfigd (
         Critical = 0
         CVMVxconfigdArgs = { syslog }
         )
 
     cvm_clus requires cvm_vxconfigd
     vxfsckd requires cvm_clus
 
 
     // resource dependency tree
     //
     //   group cvm
     //   {
     //   CFSfsckd vxfsckd
     //       {
     //       CVMCluster cvm_clus
     //           {
     //           CVMVxconfigd cvm_vxconfigd
     //           }
     //       }
     //   }
 
 
group sybasece (
     SystemList = { sys1 = 0, sys2 = 1 }
     AutoFailOver = 0
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     TriggerResStateChange = 1
     OnlineRetryLimit = 3
     OnlineRetryInterval = 120
     )
 
     CFSMount quorummnt (
         Critical = 0
         MountPoint = "/quorum"
         BlockDevice = "/dev/vx/dsk/quorumdg/quorumvol"
         )
 
     CFSMount sybdatamnt (
         Critical = 0
         MountPoint = "/sybdata"
         BlockDevice = "/dev/vx/dsk/sybdatadg/sybdatavol"
         )
 
     CVMVolDg quorumdg (
         Critical = 0
         CVMDiskGroup = quorumdg
         CVMVolume = { quorumvol }
         CVMActivation = sw
         )
 
     CVMVolDg sybdatadg (
         Critical = 0
         CVMDiskGroup = sybdatadg
         CVMVolume = { sybdatavol }
         CVMActivation = sw
         )
 
     Process vxfend (
         PathName = "/sbin/vxfend"
         Arguments = "-m sybase -k /tmp/vcmp_socket"
         )
 
     Sybase ase (
         Server @sys1 = syb1
         Server @sys2 = syb2
         Owner = sybase
         Home = "/sybase_home"
         Version = 15
         SA = sa
         SApswd = vcs123
         Run_ServerFile @sys1 = "/sybase_home/ASE-15_0/install/RUN_syb1"
         Run_ServerFile @sys2 = "/sybase_home/ASE-15_0/install/RUN_syb2"
         Quorum_dev = "/quorum/qfile2"
         )
 
     requires group binmnt online local firm
     ase requires quorummnt
     ase requires sybdatamnt
     ase requires vxfend
     quorummnt requires quorumdg
     sybdatamnt requires sybdatadg
 
 
     // resource dependency tree
     //
     //   group sybasece
     //   {
     //   Sybase ase
     //       {
     //       CFSMount quorummnt
     //           {
     //           CVMVolDg quorumdg
     //           }
     //       CFSMount sybdatamnt
     //           {
     //           CVMVolDg sybdatadg
     //           }
     //       Process vxfend
     //       }
     //   }

 

Sample main.cf for a basic Sybase ASE CE cluster configuration under VCS control with local mount point on CFS for Sybase binary installation

include "types.cf"
include "CFSTypes.cf"
include "CVMTypes.cf"
include "SybaseTypes.cf"
 
cluster sybase (
     UserNames = { admin = dijBidIfjEjjHrjDig }
     Administrators = { admin }
     UseFence = SCSI3
     HacliUserLevel = COMMANDROOT
     )
 
system sys1 (
     )
 
system sys2 (
     )
 
group binlocalmnt (
     SystemList = { sys1 = 0, sys2 = 1 }
     AutoFailOver = 0
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     OnlineRetryLimit = 3
     OnlineRetryInterval = 120
     )
 
     DiskGroup sybhomedg (
         Critical = 0
         DiskGroup @sys1 = sybhome_sys1
         DiskGroup @sys2 = sybhome_sys2
         )
 
     Mount sybhomemnt (
         Critical = 0
         MountPoint = "/sybase_home"
         BlockDevice @sys1 = "/dev/vx/dsk/sybhome_sys1/sybhomevol"
         BlockDevice @sys2 = "/dev/vx/dsk/sybhome_sys2/sybhomevol"
         FSType = vxfs
         FsckOpt = "-y"
         )
 
     Volume sybhomevol (
         Critical = 0
         DiskGroup @sys1 = sybhome_sys1
         DiskGroup @sys2 = sybhome_sys2
         Volume @sys1 = sybhomevol
         Volume @sys2 = sybhomevol
         )
 
     requires group cvm online local firm
     sybhomemnt requires sybhomevol
     sybhomevol requires sybhomedg
 
 
     // resource dependency tree
     //
     //   group binlocalmnt
     //   {
     //   Mount sybhomemnt
     //       {
     //       Volume sybhomevol
     //           {
     //           DiskGroup sybhomedg
     //           }
     //       }
     //   }
 
 
group cvm (
     SystemList = { sys1 = 0, sys2 = 1 }
     AutoFailOver = 0
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     )
 
     CFSfsckd vxfsckd (
         )
 
     CVMCluster cvm_clus (
         CVMClustName = sybase
         CVMNodeId = { sys1 = 0, sys2 = 1 }
         CVMTransport = gab
         CVMTimeout = 200
         )
 
     CVMVxconfigd cvm_vxconfigd (
         Critical = 0
         CVMVxconfigdArgs = { syslog }
         )
 
     cvm_clus requires cvm_vxconfigd
     vxfsckd requires cvm_clus
 
 
     // resource dependency tree
     //
     //   group cvm
     //   {
     //   CFSfsckd vxfsckd
     //       {
     //       CVMCluster cvm_clus
     //           {
     //           CVMVxconfigd cvm_vxconfigd
     //           }
     //       }
     //   }
 
 
group sybasece (
     SystemList = { sys1 = 0, sys2 = 1 }
     AutoFailOver = 0
     Parallel = 1
     AutoStartList = { sys1, sys2 }
     TriggerResStateChange = 1
     OnlineRetryLimit = 3
     OnlineRetryInterval = 120
     )
 
     CFSMount quorummnt (
         Critical = 0
         MountPoint = "/quorum"
         BlockDevice = "/dev/vx/dsk/quorumdg/quorumvol"
         )
 
     CFSMount sybdatamnt (
         Critical = 0
         MountPoint = "/sybdata"
         BlockDevice = "/dev/vx/dsk/sybdatadg/sybdatavol"
         )
 
     CVMVolDg quorumdg (
         Critical = 0
         CVMDiskGroup = quorumdg
         CVMVolume = { quorumvol }
         CVMActivation = sw
         )
 
     CVMVolDg sybdatadg (
         Critical = 0
         CVMDiskGroup = sybdatadg
         CVMVolume = { sybdatavol }
         CVMActivation = sw
         )
 
     Process vxfend (
         PathName = "/sbin/vxfend"
         Arguments = "-m sybase -k /tmp/vcmp_socket"
         )
 
     Sybase ase (
         Server @sys1 = syb1
         Server @sys2 = syb2
         Owner = sybase
         Home = "/sybase_home"
         Version = 15
         SA = sa
         SApswd = vcs123
         Run_ServerFile @sys1 = "/sybase_home/ASE-15_0/install/RUN_syb1"
         Run_ServerFile @sys2 = "/sybase_home/ASE-15_0/install/RUN_syb2"
         Quorum_dev = "/quorum/qfile2"
         )
 
     requires group binlocalmnt online local firm
     ase requires quorummnt
     ase requires sybdatamnt
     ase requires vxfend
     quorummnt requires quorumdg
     sybdatamnt requires sybdatadg
 
 
     // resource dependency tree
     //
     //   group sybasece
     //   {
     //   Sybase ase
     //       {
     //       CFSMount quorummnt
     //           {
     //           CVMVolDg quorumdg
     //           }
     //       CFSMount sybdatamnt
     //           {
     //           CVMVolDg sybdatadg
     //           }
     //       Process vxfend
     //       }
     //   }
 

 

 

 

Resolution

The following article helps you to install and configure Sybase ASE CE 15.7 on RHEL 6.5 operating systems with SFCFSHA 6.1.1

 

Issue/Introduction

Veritas  Storage Foundation™  Cluster File System and High Availability (SFCFSHA) 6.1.1 installation and configuration support on RHEL 6.5 with SYBASE ASE CE 15.7