Exadata bug related to HAIP

Recently i have been engaged Peoplesoft financials and HR Exadata gig.  I ran into issue related to HAIP that is used on EXADATA system.  Oracle have confirmed that it is bug and solution is to set cluster_interconnects for each node.

following error encountered when starting cluster database:

PRCR-1013 : Failed to start resource ora.orcl.db
PRCR-1064 : Failed to start resource ora.orcl.db on node nd01db1
CRS-5017: The resource action “ora.orcl.db start” encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 0
Session ID: 0 Serial number: 0
 

Trace file:

Group reconfiguration cleanup

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

*** 2012-02-07 15:05:09.686

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

*** 2012-02-07 15:05:10.714

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

*** 2012-02-07 15:05:11.743

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

*** 2012-02-07 15:05:12.565

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).

*** 2012-02-07 15:05:16.275

kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE])

I looked up on support and they are saying it is a bug:

https://support.oracle.com/CSP/ui/flash.html#tab=KBHome(page=KBHome&id=()),(page=KBNavigator&id=(bmDocTitle=Exadata%20Rac%20Node%20Instance%20Crash%20with%20kjzdattdlm:%20Can%20not%20attach%20to%20DLM&from=BOOKMARK&bmDocType=PROBLEM&bmDocDsrc=KB&bmDocID=1386843.1&viewingMode=1143))

solution is to shutdown and recreate spfile with hard coded value for bindib0

SQL> create pfile='inittempORCL.ora' from spfile ;
SQL> !echo "ORCL1.cluster_interconnects='192.168.5.1' " >>inittempORCL.ora
SQL> !echo "ORCL2.cluster_interconnects='192.168.5.2' " >>inittempORCL.ora

SQL> create spfile='+DATA/ORCL/spfileORCL.ora' from pfile='inittempORCL.ora';

# srvctl start database -d ORCL

Repeat each steps all cluster databases.

hopefully, steps above should fix the issue with bindib0.
Advertisements

Author: Abdul H Khan

Trying to be cloudy!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s