Top 5 CRS Cluster Patching Issues

Top 5 CRS Cluster Patching Issues (Doc ID 1372859.1)

APPLIES TO:

Oracle Database - Enterprise Edition - Version 10.2.0.5.0 and later
Information in this document applies to any platform.

PURPOSE

The purpose of this note is to provide a summary of the top 5 issues seen when patching the CRS Cluster.

SCOPE

This note applies to the 10g, 11gR1 CRS patching issues and to the new 11gR2 Grid Infrastructure patching issues.

DETAILS

Issue #1: Opatch auto fails with "The opatch Component check failed"

Symptoms:

1. The opatch Component check failed. This patch is not applicable for /u01/.../...
2. The opatch Applicable check failed for /u01/... The patch is not applicable for /u01/..

Possible Causes:

1. Permission issues / The patch was unzipped in non-empty directory.
2. Different OS user for Grid home and RDBMS home

Solutions:

1. Check Document 1169036.1
2. If 'opatch auto' still fails an alternative is to follow the manual procedure as documented in the README document of the PSU patches.
3.  Check Document 1580746.1

Issue #2: OPATCH CheckSystemSpace Failed with Error Code 73 while Applying GI PSU

Symptoms:

1. UtilSession failed: Prerequisite check "CheckSystemSpace" failed.
2. OPatch failed with error code 73.

Possible Causes:

1. OPATCH needs about 4X (patch size) amount of disk space in $GRID_HOME to apply PSU patch, the issue happened as there's insufficient space.
2. As PSU on AIX is a lot larger than on other platforms bug 9780505, the absolute number is significantly higher, i.e. space requirement is 22GB for 11.2.0.3 PSU

Solutions:

1. Ensure enough free space is available in $GRID_HOME directory
2. For AIX temporarily ask sysadmin to extend your file system space if needed.
3. Use 'opatch util cleanup' to free space in $GRID_HOME/.patch_storage directory (before and/or after applying patch). SeeDocument 550522.1.
4.Reference: opatch CheckSystemSpace Fails With Error Code 73 While Applying GI PSU Document 1088455.1

Issue #3: Error: 'CRS is not installed on any of the nodes'

Symptoms:

1. ERROR: CRS is not installed on any of the nodes.

Possible Causes:

1. The central inventory entries for the CRS home is missing a flag that identifies it as a CRS-type home.

Solutions:

1. Update Inventory to set "CRS=true" flag. Follow Document 1053393.1
2. Verify inventory shows valid data and lists the local and remote cluster nodes.

Issue #4: Opatch Error "UtilSession failed: Patch nnn requires component(s) that are not installed"

Symptoms:

1. UtilSession failed: Patch nnn requires component(s) that are not installed in OracleHome. These not-installed components are oracle.crs: ...

Possible Causes:

1. Wrong patch path specified for database home
2. Relative patch path is specified

Solutions:

1. Specify the full path and the patch under .../custom/server/ .. directory.
Example: /OPatch/opatch napply -oh -local /depot/patches/11.2/GIPSU2/12311357/custom/server/12311357
For more details see Document 763680.1

Issue #5: Opatch: version check failed

Symptoms:

1. ZOP-49: Not able to execute the prereq. OPatch cannot inform if the patch satisfies minimum version requirement.

Possible Causes:

1. OPatch version does not meet the requirements for the patch (specified in the README), you must upgrade OPatch.
2. The grid or database user can not read unzipped patch directory/files, check directory permissions

Solutions:

1. Install latest opatch version. See Document 274526.1.
2. Correct directory permission of unzipped patch.

For further debugging upload the $ORACLE_HOME/cfgtoollogs log files. See Document 403212.1

REFERENCES

NOTE:1053393.1 - How to Update Inventory to Set/Unset "CRS=true" Flag for Oracle Clusterware Home
NOTE:1169036.1 - Applying GI PSU using "opatch auto" fails with "The opatch Component check failed"
NOTE:1339140.1 - FAQ: OPatch/Patch Questions/Issues for Oracle Clusterware (Grid Infrastructure or CRS) and RAC Environments

NOTE:403212.1 - Location Of Logs For OPatch And OUI
NOTE:550522.1 - How To Avoid Disk Full Issues Because OPatch Backups Take Big Amount Of Disk Space.
NOTE:763680.1 - Opatch Error "UtilSession failed: Patch nnn requires component(s) that are not installed" When Applying CRS or Grid Infrastructure Merge, Bundle or PSU Patches
NOTE:564192.1 - FAQs on Central Inventory and Oracle Home Inventory (Local Inventory) in Oracle RDBMS
NOTE:1088455.1 - opatch CheckSystemSpace Fails With Error Code 73 While Applying GI PSU
NOTE:557934.1 - Oracle Clusterware: Patch installation
NOTE:274526.1 - How To Download And Install The Latest OPatch(6880880) Version
NOTE:1553964.1 - "This Patch Is Not Applicable" Encountered While Using 'opatch auto' Where 'OPatch' Directory is Not Owned by :