Upgrading Sun Cluster Software From Solaris 8 to Solaris 9 Software

This page provides procedures to upgrade a Sun Cluster 3.0 configuration to Sun Cluster 3.1 04/04 software. This page also includes how to upgrade a Sun Cluster 3.1 04/04 configuration that runs on Solaris 8 software to Solaris 9 software. This page includes the following information.

• How to Prepare the Cluster for Upgrade
• How to Upgrade the Solaris Operating Environment
• How to Upgrade to Sun Cluster 3.1 04/04 Software
• How to Upgrade Sun Cluster-Module Software for Sun Management Center
• How to Finish Upgrading to Sun Cluster 3.1 04/04 Software
• How to Handle Storage Reconfiguration During an Upgrade
• How to Resolve Mistaken Storage Changes During an Upgrade

Top

Upgrading to Sun Cluster 3.1 04/04 Software

Perform the following tasks to upgrade from Sun Cluster 3.0 software to Sun Cluster 3.1 04/04 software, including upgrade from Solaris 8 to Solaris 9 software, or to upgrade a Sun Cluster 3.1 04/04 configuration that runs on Solaris 8 software to Solaris 9 software.

Task Map: Upgrading to Sun Cluster 3.1 04/04 Software

Top

Upgrade Requirements and Restrictions

Observe the following requirements and restrictions when you upgrade to Sun Cluster 3.1 04/04 software:

• The cluster must run on or be upgraded to at least Solaris 8 2/02 software, including the most current required patches.
• The cluster hardware must be a supported configuration for Sun Cluster 3.1 04/04 software. Contact your Sun representative for information about current supported Sun Cluster configurations.
• You must upgrade all software to a version that is supported by Sun Cluster 3.1 04/04 software. For example, you must upgrade a data service that is supported on Sun Cluster 3.0 software but is not supported on Sun Cluster 3.1 04/04 software to the version of that data service that is supported on Sun Cluster 3.1 04/04 software. If the related application is not supported on Sun Cluster 3.1 04/04 software, you must also upgrade that application to a supported release.
• The scinstall upgrade utility only upgrades those data services that are provided with Sun Cluster 3.1 04/04 software. You must manually upgrade any custom or third-party data services.
• Have available the test IP addresses to use with your public network adapters when NAFO groups are converted to Internet Protocol (IP) Network Multipathing groups. The scinstall upgrade utility prompts you for a test IP address for each public network adapter in the cluster. A test IP address must be on the same subnet as the primary IP address for the adapter.
  
  See the IP Network Multipathing Administration Guide (Solaris 8) or System Administration Guide: IP Services (Solaris 9) for information about test IP addresses for IP Network Multipathing groups.
• Sun Cluster 3.1 04/04 software supports direct upgrade only from Sun Cluster 3.x software.
• Sun Cluster 3.1 04/04 software does not support any downgrade of Sun Cluster software.

How to Prepare the Cluster for Upgrade

Before you upgrade the software, perform the following steps to take the cluster out of production:

1. Ensure that the configuration meets requirements for upgrade.
   
   See Upgrade Requirements and Restrictions.
2. Have available the CD-ROMs, documentation, and patches for all software products you are upgrading.
   • Solaris 8 or Solaris 9 operating environment
   • Sun Cluster 3.1 04/04 framework
   • Sun Cluster 3.1 04/04 data services (agents)
   • Applications that are managed by Sun Cluster 3.1 04/04 data-service agents
   • Veritas Volume Manager
   • Patch 113801–01 or later, which is required to upgrade from Solaris 8 software to Solaris 9 software
     See Patches and Required Firmware Levels in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.
3. (Optional) Install Sun Cluster 3.1 04/04 documentation.
   
   Install the documentation packages on your preferred location, such as an administrative console or a documentation server. See the index.html file at the top level of the Sun Cluster 3.0 5/02 CD-ROM to access installation instructions.
4. Have available your list of test IP addresses, one for each public network adapter in the cluster.
   
   A test IP address is required for each public network adapter in the cluster, regardless of whether the adapter is the active adapter or the backup adapter in a NAFO group. The test IP addresses will be used to reconfigure the adapters to use IP Network Multipathing.

   Note Each test IP address must be on the same subnet as the existing IP address that is used by the public network adapter.

   To list the public network adapters on a node, run the following command:

   % pnmstat

   See the IP Network Multipathing Administration Guide (Solaris 8) or System Administration Guide: IP Services (Solaris 9) for more information about test IP addresses for IP Network Multipathing.

5. Notify users that cluster services will be unavailable during upgrade.
6. Ensure that the cluster is functioning normally.
   • To view the current status of the cluster, run the following command from any node:

     % scstat

     See the scstat(1M) man page for more information.

   • Search the /var/adm/messages log on the same node for unresolved error messages or warning messages.
   • Check volume manager status.
7. Become superuser on a node of the cluster.
8. Switch each resource group offline.

   # scswitch -F -g resource-group

   -F	Switches a resource group offline

   -g resource-group

   Specifies the name of the resource group to take offline

9. Disable all resources in the cluster.
   
   The disabling of resources before upgrade prevents the cluster from bringing the resources online automatically if a node is mistakenly rebooted into cluster mode.

   Note If you are upgrading from a Sun Cluster 3.1 release, you can use the scsetup(1M) utility instead of the command line. From the Main Menu, choose Resource Groups, then choose Enable/Disable Resources.

   1. From any node, list all enabled resources in the cluster.

      # scrgadm -pv | grep "Res enabled"

   2. Identify those resources that depend on other resources.
      
      You must disable dependent resources first before you disable the resources that they depend on.
   3. Disable each enabled resource in the cluster.

      scswitch -n -j resource

      -n

      Disables

      -j resource

      Specifies the resource

      See the scswitch(1M) man page for more information.

10. Move each resource group to the unmanaged state.

    # scswitch -u -g resource-group

    -u	Moves the specified resource group to the unmanaged state

    -g resource-group

    Specifies the name of the resource group to move into the unmanaged state

11. Verify that all resources on all nodes are disabled and that all resource groups are in the unmanaged state.

    # scstat -g

12. Stop all databases that are running on each node of the cluster.
13. Ensure that all shared data is backed up.
14. From one node, shut down the cluster.

    # scshutdown
    ok

    See the scshutdown(1M) man page for more information.

15. Boot each node into noncluster mode.

    ok boot -x

16. Ensure that each system disk is backed up.
17. Determine whether to upgrade the Solaris operating environment.
    • If Sun Cluster 3.1 04/04 software does not support the release of the Solaris environment that you currently run on your cluster, you must upgrade the Solaris software to a supported release. Go to How to Upgrade the Solaris Operating Environment.
    • If your cluster configuration already runs on a release of the Solaris environment that supports Sun Cluster 3.1 04/04 software, go to How to Upgrade to Sun Cluster 3.1 04/04 Software.
      See Supported Products in Sun Cluster 3.1 Release Notes for more information.

How to Upgrade the Solaris Operating Environment

Perform this procedure on each node in the cluster to upgrade the Solaris operating environment.

Note The cluster must already run on, or be upgraded to, at least the minimum required level of the Solaris 8 or Solaris 9 environment to support Sun Cluster 3.1 04/04 software. See Supported Products in Sun Cluster 3.1 Release Notes for more information.

1. Ensure that all steps in How to Prepare the Cluster for Upgrade are completed.
2. Become superuser on the cluster node to upgrade.
3. Determine whether the following Apache links already exist, and if so, whether the file names contain an uppercase K or S:

   /etc/rc0.d/K16apache 
   /etc/rc1.d/K16apache 
   /etc/rc2.d/K16apache 
   /etc/rc3.d/S50apache 
   /etc/rcS.d/K16apache

   • If these links already exist and do contain an uppercase K or S in the file name, no further action is necessary for these links.
   • If these links do not exist, or if these links exist but instead contain a lowercase k or s in the file name, you move aside these links in Step 8.
4. Comment out all entries for globally mounted file systems in the /etc/vfstab file.
   1. Make a record of all entries that are already commented out for later reference.
   2. Temporarily comment out all entries for globally mounted file systems in the /etc/vfstab file.
      
      Entries for globally mounted file systems contain the global mount option. Comment out these entries to prevent the Solaris upgrade from attempting to mount the global devices.
5. Determine which procedure to follow to upgrade the Solaris operating environment.

   Volume Manager	Procedure to Use	Instructions
   Solstice DiskSuite™/Solaris Volume Manager	Any Solaris upgrade method except the Live Upgrade method	Solaris 8 or Solaris 9 installation documentation
   Veritas Volume Manager	Upgrading VxVM and Solaris software	Veritas Volume Manager installation documentation

6. Upgrade the Solaris software, following the procedure you selected in Step 5.

   Note Ignore the instruction to reboot at the end of the Solaris software upgrade process. You must first perform Step 7 and Step 8, then reboot into noncluster mode in Step 9 to complete Solaris software upgrade. If you are instructed to reboot a node at other times in the upgrade process, always add the -x option to the command. This option ensures that the node reboots into noncluster mode. For example, either of the following two commands boot a node into single-user noncluster mode: # reboot –– -xs ok boot -xs

7. In the /a/etc/vfstab file, uncomment those entries for globally mounted file systems that you commented out in Step 4.
8. If the Apache links in Step 3 did not already exist or if they contained a lowercase k or s in the file names before you upgraded the Solaris software, move aside the restored Apache links.
   
   Use the following commands to rename the files with a lowercase k or s:

   # mv /a/etc/rc0.d/K16apache /a/etc/rc0.d/k16apache 
   # mv /a/etc/rc1.d/K16apache /a/etc/rc1.d/k16apache
   # mv /a/etc/rc2.d/K16apache /a/etc/rc2.d/k16apache
   # mv /a/etc/rc3.d/S50apache /a/etc/rc3.d/s50apache
   # mv /a/etc/rcS.d/K16apache /a/etc/rcS.d/k16apache

9. Reboot the node into noncluster mode.
   
   Include the double dashes (--) in the following command:

   # reboot –– -x

10. Install any required Solaris software patches and hardware-related patches, and download any needed firmware that is contained in the hardware patches.
    
    For Solstice DiskSuite software (Solaris 8), also install any Solstice DiskSuite software patches.

    Note Do not reboot after you add patches. You reboot the node after you upgrade the Sun Cluster software.

    See Patches and Required Firmware Levels in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

11. Upgrade to Sun Cluster 3.1 04/04 software.
    
    Go to How to Upgrade to Sun Cluster 3.1 04/04 Software.

    Note To complete upgrade from Solaris 8 to Solaris 9 software, you must also upgrade to the Solaris 9 version of Sun Cluster 3.1 04/04 software, even if the cluster already runs on Sun Cluster 3.1 04/04 software.

How to Upgrade to Sun Cluster 3.1 04/04 Software

This procedure describes how to upgrade the cluster to Sun Cluster 3.1 04/04 software. You must also perform this procedure to complete cluster upgrade from Solaris 8 to Solaris 9 software.

Tip You can perform this procedure on more than one node at the same time.

1. Ensure that all steps in How to Prepare the Cluster for Upgrade are completed.
   
   If you upgraded from Solaris 8 to Solaris 9 software, also ensure that all steps in How to Upgrade the Solaris Operating Environment are completed.
2. Become superuser on a node of the cluster.
3. Ensure that you have installed all required Solaris software patches and hardware-related patches.
   
   For Solstice DiskSuite software (Solaris 8), also ensure that you have installed all required Solstice DiskSuite software patches.
4. Insert the Sun Cluster 3.0 5/02 CD-ROM into the CD-ROM drive on the node.
   
   If the Volume Management daemon vold(1M) is running and configured to manage CD-ROM devices, it automatically mounts the CD-ROM on the /cdrom/suncluster_3_0 directory.
5. Upgrade the node to Sun Cluster 3.1 04/04 software.
   1. Change to the /cdrom/suncluster_3_0/SunCluster_3.1/Sol_ver/Tools directory, where ver is 8 (for Solaris 8) or 9 (for Solaris 9) .

      # cd /cdrom/suncluster_3_0/SunCluster_3.1/Sol_ver/Tools

   2. Upgrade the cluster framework software.
      • To upgrade from Sun Cluster 3.0 software, run the following command:

        # ./scinstall -u update -S interact

        -S	Specifies the test IP addresses to use to convert NAFO groups to IP Network Multipathing groups

        interact

        Specifies that scinstall prompts the user for each test IP address needed

      • To upgrade from Sun Cluster 3.1 software, run the following command:

        # ./scinstall -u update

        Tip If upgrade processing is interrupted, use the scstat(1M) command to ensure that the node is in noncluster mode (Offline), then restart the scinstall command. # scstat -n –– Cluster Nodes ––                    Node name      Status                    ––––––––-      ––––––   Cluster node:    nodename        Offline   Cluster node:    nodename        Offline

        See the scinstall(1M) man page for more information. See the IP Network Multipathing Administration Guide (Solaris 8) or System Administration Guide: IP Services (Solaris 9) for information about test addresses for IP Network Multipathing.

        Note Sun Cluster 3.1 04/04 software requires at least version 3.5.1 of Sun Explorer software. Upgrade to Sun Cluster software includes installing Sun Explorer data collector software, to be used in conjunction with the sccheck utility. If another version of Sun Explorer software was already installed before Sun Cluster upgrade, it is replaced by the version that is provided with Sun Cluster software. Options such as user identity and data delivery are preserved, but crontab entries must be manually recreated.

        During Sun Cluster upgrade, scinstall might make one or more of the following configuration changes:

      • Convert NAFO groups to IP Network Multipathing groups but keep the original NAFO-group name.
      • Rename the ntp.conf file to ntp.conf.cluster, if ntp.conf.cluster does not already exist on the node.
      • Set the local-mac-address? variable to true, if the variable is not already set to that value.
   3. Change to the CD-ROM root directory and eject the CD-ROM.
   4. Install any Sun Cluster 3.1 04/04 patches.

      Note If you upgraded from Solaris 8 software to Solaris 9 software, install Patch 113801–01 or later before you proceed to the next step.

      See Patches and Required Firmware Levels in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.

      Note Do not reboot the node at this time.

6. Upgrade software applications that are installed on the cluster and apply application patches as needed.
   
   Ensure that application levels are compatible with the current version of Sun Cluster and Solaris software. See your application documentation for installation instructions. In addition, follow these guidelines to upgrade applications in a Sun Cluster 3.1 04/04 configuration:
   • If the applications are stored on shared disks, you must master the relevant disk groups and manually mount the relevant file systems before you upgrade the application.
   • If you are instructed to reboot a node during the upgrade process, always add the -x option to the command. This option ensures that the node reboots into noncluster mode. For example, either of the following two commands boot a node into single-user noncluster mode:

     # reboot –– -xs
     ok boot -xs

7. Upgrade Sun Cluster data services to the Sun Cluster 3.1 04/04 software versions.

   Note Only those data services that are provided on the Sun Cluster 3.0 5/02 Agents CD-ROM are automatically upgraded by scinstall(1M). You must manually upgrade any custom or third-party data services.

   1. Insert the Sun Cluster 3.0 5/02 Agents CD-ROM into the CD-ROM drive on the node to upgrade.
   2. Upgrade the data-service software.

      # scinstall -u update -s all -d /cdrom/cdrom0

      -u update

      Specifies upgrade

      -s all

      Updates all Sun Cluster data services that are installed on the node

      Tip If upgrade processing is interrupted, use the scstat(1M) command to ensure that the node is in noncluster mode (Offline), then restart the scinstall command. # scstat -n –– Cluster Nodes ––                    Node name      Status                    ––––––––-      ––––––   Cluster node:    nodename        Offline   Cluster node:    nodename        Offline

   3. Change to the CD-ROM root directory and eject the CD-ROM.
   4. As needed, manually upgrade any custom data services that are not supplied on the Sun Cluster 3.0 5/02 Agents CD-ROM.
   5. Install any Sun Cluster 3.1 04/04 data-service patches.
      
      See Patches and Required Firmware Levels in Sun Cluster 3.1 Release Notes for the location of patches and installation instructions.
8. After all nodes are upgraded, reboot each node into the cluster.

   # reboot                                                        

9. Verify that all upgraded software is at the same version on all upgraded nodes.
   1. On each upgraded node, view the installed levels of Sun Cluster software.

      # scinstall -pv

   2. From one node, verify that all upgraded cluster nodes are running in cluster mode (Online).

      # scstat -n

      See the scstat(1M) man page for more information about displaying cluster status.

10. Did you upgrade from Solaris 8 to Solaris 9 software?
    • If no, skip to Step 14.
    • If yes, proceed to Step 11.
11. On each node, run the following command to verify the consistency of the storage configuration:

    # scdidadm -c

    -c	Perform a consistency check

    Caution Do not proceed to Step 12 until your configuration passes this consistency check. Failure to do so might result in errors in device identification and cause data corruption.

    The following table lists the possible output from the scdidadm -c command and the action you must take, if any.

    Example Message	Action to Take
    device id for ’phys-schost-1:/dev/rdsk/c1t3d0’ does not match physical device’s id, device may have been replaced	Go to Recovering From Storage Configuration Changes During Upgrade and perform the appropriate repair procedure.
    device id for ’phys-schost-1:/dev/rdsk/c0t0d0’ needs to be updated, run scdidadm –R to update	None. You update this device ID in Step 12.
    No output message	None.

    See the scdidadm(1M) man page for more information.

12. On each node, migrate the Sun Cluster storage database to Solaris 9 device IDs.

    # scdidadm -R all

    -R	Perform repair procedures

    all	Specify all devices

13. On each node, run the following command to verify that storage database migration to Solaris 9 device IDs is successful:

    # scdidadm -c

    • If the scdidadm command displays a message, return to Step 11 to make further corrections to the storage configuration or the storage database.
    • If the scdidadm command displays no messages, the device-ID migration is successful. If device-ID migration is verified on all cluster nodes, proceed to Step 14.
14. Did you upgrade VxVM?
    • If no, proceed to Step 15.
    • If yes, upgrade all disk groups.
      
      To upgrade a disk group to the highest version supported by the VxVM release you installed, run the following command from the primary node of the disk group:

      # vxdg upgrade dgname

      See your VxVM administration documentation for more information about upgrading disk groups.

15. Do you intend to use Sun Management Center to monitor the cluster?
    • If yes, go to How to Upgrade Sun Cluster-Module Software for Sun Management Center.
    • If no, go to How to Finish Upgrading to Sun Cluster 3.1 04/04 Software.

Example: Upgrade From Sun Cluster 3.0 to Sun Cluster 3.1 04/04 Software

The following example shows the process of upgrading a two-node cluster, including data services, from Sun Cluster 3.0 to Sun Cluster 3.1 04/04 software on the Solaris 8 operating environment. The cluster node names are phys-schost-1 and phys-schost-2.

How to Upgrade Sun Cluster-Module Software for Sun Management Center

Perform the following steps to upgrade to the Sun Cluster 3.1 04/04 module software packages for Sun Management Center on the Sun Management Center server machine and help-server machine.

1. Ensure that all Sun Management Center core packages are installed on the appropriate machines, as described in your Sun Management Center installation documentation.
   
   This step includes installing Sun Management Center agent packages on each cluster node.
2. Become superuser on the Sun Management Center server machine.
3. Insert the Sun Cluster 3.0 5/02 CD-ROM into the CD-ROM drive.
4. Change to the /cdrom/suncluster_3_0/SunCluster_3.1/Sol_ver/Packages directory, where ver is 8 (for Solaris 8) or 9 (for Solaris 9) .

   # cd /cdrom/suncluster_3_0/SunCluster_3.1/Sol_ver/Packages

5. Install the Sun Cluster–module server package SUNWscssv.

   # pkgadd -d . SUNWscssv

6. Change to the CD-ROM root directory and eject the CD-ROM.
7. Become superuser on the Sun Management Center help-server machine.
8. Repeat Step 3 through Step 6 to install the Sun Cluster –module help-server package SUNWscshl.
9. Finish the upgrade.
   
   Go to How to Finish Upgrading to Sun Cluster 3.1 04/04 Software.

How to Finish Upgrading to Sun Cluster 3.1 04/04 Software

Perform this procedure to reregister and reversion all resource types that received a new version from the upgrade, then to re-enable resources and bring resource groups back online.

Note To upgrade future versions of resource types, see Upgrading a Resource Type in Sun Cluster 3.1 Data Service 4/03 Planning and Administration Guide.

1. Ensure that all steps in How to Upgrade to Sun Cluster 3.1 04/04 Software are completed.
2. From any node, start the scsetup(1M) utility.

   # scsetup

3. To work with resource groups, type 2 (Resource groups).
4. To register resource types, type 4 (Resource type registration).
   
   Type yes when prompted to continue.
5. Type 1 (Register all resource types which are not yet registered).
   
   The scsetup utility displays all resource types that are not registered.
   
   Type yes to continue to register these resource types.
6. Type 8 (Change properties of a resource).
   
   Type yes to continue.
7. Type 3 (Manage resource versioning).
   
   Type yes to continue.
8. Type 1 (Show versioning status).
   
   The scsetup utility displays which resources you can upgrade to new versions of the same resource type. The utility also displays the state that the resource should be in before the upgrade can begin.
   
   Type yes to continue.
9. Type 4 (Re-version all eligible resources).
   
   Type yes to continue when prompted.
10. Return to the Resource Group Menu.
11. Type 6 (Enable/Disable a resource).
    
    Type yes to continue when prompted.
12. Select a resource to enable and follow the prompts.
13. Repeat Step 12 for each disabled resource.
14. When all resources are re-enabled, type q to return to the Resource Group Menu.
15. Type 5 (Online/Offline or Switchover a resource group).
    
    Type yes to continue when prompted.
16. Follow the prompts to bring each resource group online.
17. Exit the scsetup utility.
    
    Type q to back out of each submenu, or press Ctrl-C.
    
    The cluster upgrade is complete. You can now return the cluster to production.

Top

Recovering From Storage Configuration Changes During Upgrade

This section provides the following repair procedures to follow if changes were inadvertently made to the storage configuration during upgrade:* How to Handle Storage Reconfiguration During an Upgrade

• How to Resolve Mistaken Storage Changes During an Upgrade

How to Handle Storage Reconfiguration During an Upgrade

Any changes to the storage topology, including running Sun Cluster commands, should be completed before you upgrade the cluster to Solaris 9 software. If, however, changes were made to the storage topology during the upgrade, perform the following procedure. This procedure ensures that the new storage configuration is correct and that existing storage that was not reconfigured is not mistakenly altered.

1. Ensure that the storage topology is correct.
   
   Check whether the devices that were flagged as possibly being replaced map to devices that actually were replaced. If the devices were not replaced, check for and correct possible accidental configuration changes, such as incorrect cabling.
2. Become superuser on a node that is attached to the unverified device.
3. Manually update the unverified device.

   # scdidadm -R device

   -R device-

   Performs repair procedures on the specified device

   See the scdidadm(1M) man page for more information.

4. Update the DID driver.

   # scdidadm -ui
   # scdidadm -r

   -u	Loads the device ID configuration table into the kernel

   -i	Initializes the DID driver

   -r	Reconfigures the database

5. Repeat Step 2 through Step 4 on all other nodes that are attached to the unverified device.
6. Return to the remaining upgrade tasks.
   
   Go to Step 11 in How to Upgrade to Sun Cluster 3.1 04/04 Software.

How to Resolve Mistaken Storage Changes During an Upgrade

If accidental changes are made to the storage cabling during the upgrade, perform the following procedure to change the storage configuration back to the correct state.

Note This procedure assumes that no physical storage was actually changed. If physical or logical storage devices were changed or replaced, instead follow procedures in How to Handle Storage Reconfiguration During an Upgrade.

1. Change the storage topology back to its original configuration.
   
   Check the configuration of the devices that were flagged as possibly being replaced, including the cabling.
2. As superuser, update the DID driver on each node of the cluster.

   # scdidadm -ui
   # scdidadm -r

   -u	Loads the device–ID configuration table into the kernel

   -i	Initializes the DID driver

   -r	Reconfigures the database

   See the scdidadm(1M) man page for more information.

3. Did the scdidadm command return any error messages in Step 2?
   • If no, proceed to Step 4.
   • If yes, return to Step 1 to make further modifications to correct the storage configuration, then repeat Step 2.
4. Return to the remaining upgrade tasks.
   
   Go to Step 11 in How to Upgrade to Sun Cluster 3.1 04/04 Software.