IHAC who is on Exadata image version: 18.104.22.168.0.131014.1, faced below issue.
Any command on cellcli was failing with error: CELL-02630.
CELL-02630: There is a communication error between Management Server and Cell Server caused by a mismatch of security keys. Check that both servers have access to and use the same $OSSCONF/cellmskey.ora file.
If you read error description, it refers to communication error between CELLSRV & MS processes, due to mismatch in security keys.
I did check current status of CELL process & all were up & running.
[root@test01celadm01 ~]# service celld status rsStatus: running msStatus: running cellsrvStatus: running
MS always creates key file ==> cellmskey.ora on startup if it does not exist. But in our case it was not present. (Not sure if someone deleted it manually)
I asked customer to restart MS process & check if it helps. After restarting MS process, CELLCLI commands started working as expected 🙂
CellCLI> alter cell restart services ms Restarting MS services... The RESTART of MS services was successful. CellCLI> list celldisk CD_00_test01celadm01 normal CD_01_test01celadm01 normal CD_02_test01celadm01 normal CD_03_test01celadm01 normal CD_04_test01celadm01 normal CD_05_test01celadm01 normal CD_06_test01celadm01 normal CD_07_test01celadm01 normal CD_08_test01celadm01 normal CD_09_test01celadm01 normal CD_10_test01celadm01 normal CD_11_test01celadm01 normal FD_00_test01celadm01 normal FD_01_test01celadm01 normal FD_02_test01celadm01 normal FD_03_test01celadm01 normal FD_04_test01celadm01 normal FD_05_test01celadm01 normal FD_06_test01celadm01 normal FD_07_test01celadm01 normal FD_08_test01celadm01 normal FD_09_test01celadm01 normal FD_10_test01celadm01 normal FD_11_test01celadm01 normal FD_12_test01celadm01 normal FD_13_test01celadm01 normal FD_14_test01celadm01 normal FD_15_test01celadm01 normal
Hope so u will find this post very useful 🙂