Symptoms:
Trying to register the database manually, it fails
Cause:
The binary osdbagrp in the RDBMS ORACLE_HOME/bin is corrupted for some reason.
Error:
[oracle@ebsdb01 bin]$ srvctl add database -d ebstest -o /u01/app/oracle/product/12.1.0.2/dbhome_1 -p +DATA/EBSTEST/PARAMETERFILE/spfileebstest.ora -r primary -a DATA,RECO_EBST
PRCR-1006 : Failed to add resource ora.ebstest.db for ebstest
PRCT-1011 : Failed to run "osdbagrp". Detailed error:
Solution:
Copy the file osdbagrp from GRID HOME to RDBMS HOME
Take backup of the existing osdbagrp file.
[oracle@ebsdb01 ~]$ cd /u01/app/oracle/product/12.1.0.2/dbhome_1/bin
[oracle@ebsdb01 bin]$ ls -lrt osdbagrp
-rwxr-xr-x 1 oracle oinstall 32287 Jan 23 13:33 osdbagrp
[oracle@ebsdb01 bin]$ mv osdbagrp osdbagrp.mod
[oracle@ebsdb01 bin]$ pwd
/u01/app/oracle/product/12.1.0.2/dbhome_1/bin
[oracle@ebsdb01 bin]$ ls -lrt osdbagrp
ls: cannot access osdbagrp: No such file or directory
Copy the file from GRID HOME to RDBMS HOME
[oracle@ebsdb01 bin]$ cp -rp /u01/app/12.1.0.2/grid/bin/osdbagrp .
[oracle@ebsdb01 bin]$ ls -lrt osdbagrp
-rwxr-xr-x 1 oracle oinstall 32318 Aug 4 18:28 osdbagrp
Try to add the database through srvctl
[oracle@ebsdb01 bin]$ srvctl add database -d ebstest -o /u01/app/oracle/product/12.1.0.2/dbhome_1 -p +DATA/EBSTEST/PARAMETERFILE/spfileebstest.ora -r primary -a DATA,RECO_EBST
[oracle@ebsdb01 bin]$
Alternate Solutions:
1. Regenerate the osdbgrp binary, as RDBMS software owner
Either relink the osdbagrp executable only (preferred):
$ cd $ORACLE_HOME/srvm/lib
$ make -f ins_srvm.mk iosdbagrp
or alternatively relink all executables, however this will require to shutdown all instances running from this ORACLE_HOME:
$ cd $ORACLE_HOME/bin
$ relink all
Retry srvctl add database command.
2. Copy the osdbagrp binary from other nodes of the cluster if it is working fine on the other nodes
or
If there is no user role separation in place for GI HOME and RDBMS ORACLE_HOME and the GI is in the same release as RDBMS, just copy the osdbagrp from GRID_HOME/bin
Retry srvctl add database command.