Two days before while starting our UAT database using SRVCTL, I received following error:
[oracle@srv-uat-db-gen1 ~] Ora:BIIBDPRD $ srvctl start database -d BIIBDPRD PRCR-1079 : Failed to start resource ora.biibdprd.db ORA-12547: TNS:lost contact CRS-5017: The resource action "ora.biibdprd.db start" encountered the following error: ORA-12547: TNS:lost contact . For details refer to "(:CLSN00107:)" in "/u01/app/184.108.40.206/grid/log/srv-uat-db-gen2/agent/crsd/oraagent_oracle/oraagent_oracle.log". CRS-2674: Start of 'ora.biibdprd.db' on 'srv-uat-db-gen2' failed ORA-12547: TNS:lost contact CRS-2632: There are no more servers to try to place resource 'ora.biibdprd.db' on that would satisfy its placement policy CRS-2674: Start of 'ora.biibdprd.db' on 'srv-uat-db-gen1' failed CRS-2680: Clean of 'ora.biibdprd.db' on 'srv-uat-db-gen1' failed CRS-5804: Communication error with agent process
I tried connecting instance on node 2 through sqlplus, I received the same error:
[oracle@srv-uat-db-gen2 ~] Ora:BIIBDPRD $ sqlplus "/ as sysdba" SQL*Plus: Release 220.127.116.11.0 Production on Thu Jun 18 17:09:23 2015 Copyright (c) 1982, 2011, Oracle. All rights reserved. ERROR: ORA-12547: TNS:lost contact
After searching on metalink for possible causes of ORA-12547: TNS:Lost Contact, I found following note which explains various scenarios for ORA-12547. Local SQL*Plus Connection and DBCA Fails With: ORA-12547: TNS:Lost Contact (Doc ID 422173.1)
One of those scenarios : Incorrect permissions on the ORACLE executable was matching in my case as on node 2 : oracle executable was owned by root instead of oracle.
After correcting permissions on oracle executable my issue resolved!!
root@srv-uat-db-gen2:/u01/app/oracle/BIIBDPRD/18.104.22.168/bin# chown oracle:oinstall oracle root@srv-uat-db-gen2:/u01/app/oracle/BIIBDPRD/22.214.171.124/bin# ls -lrt oracle -rwsr-s--x 1 oracle oinstall 250373280 Jun 18 17:23 oracle [oracle@srv-uat-db-gen2 bin] Ora:BIIBDPRD $ sss SQL*Plus: Release 126.96.36.199.0 Production on Thu Jun 18 17:25:23 2015 Copyright (c) 1982, 2011, Oracle. All rights reserved. Connected to an idle instance. SQL> Disconnected
This time I was able to start my database using SRVCTL without any issues 🙂
Hope so u will find this post very useful 🙂