1- The problem:
Today, we discovered some of the OEM agents are unreachable as a consequence all jobs scheduled were skipped / having problems.
This is an Oracle Enterprise Manager Cloud control version 12.1.0.4.0.
2- Troubleshooting the OEM problem:
First I login to one server where the agent is marked unreachable and check the agent status.
This shows the “Last successful upload” set to NULL.
so I sopped the agent , clear its state, started the agent and tried to upload.
so First thing I did, I edied the emd.properties file under $AGENT_HOME/sysman/config and increaedthe values of the two parameters; UploadMaxBytesXML to 6MB and UploadMaxNumberXML to 4000.
Then I sopped again the agent , clear its state, started the agent and tried to upload many times, until I got the following new output;
I tried to stop OMS from the OEM repository host;
As you can see the “WebTier Could Not Be Stopped” ; so I ended forcing the OMS to stop;
Then I killed all remained Java processes in one command;
then started OMS;
Then back to the agent, stopped it, clear its state, start the agent, and upload again;
keep uploading the agent few times and Then check the status of the agent;
Now the upload date was updated (not null). I check again the agent status by logging into OEM page;