OEM Agent upload Failing with EMD upload error:full upload has failed: Upload Recent Sending Statistics


Agent is up and running fine ..but Upload is Failing with   EMD upload error:full upload has failed: Upload Recent Sending Statistics 

 Note:  Tried installation multiple times but stuck with same error..No communication or Port issue with OMS .. No Known issue.

Here is my Agent status:


 ./emctl status agent 
Oracle Enterprise Manager Cloud Control 12c Release 4 
Copyright (c) 1996, 2014 Oracle Corporation. All rights reserved. 
--------------------------------------------------------------- 
Agent Version : 12.1.0.4.0 
OMS Version : 12.1.0.4.0 
Protocol Version : 12.1.0.1.0 
Agent Home : /usr/lib/oracle/agent_drm/agent_inst 
Agent Log Directory : /usr/lib/oracle/agent_drm/agent_inst/sysman/log 
Agent Binaries : /usr/lib/oracle/agent_drm/core/12.1.0.4.0 
Agent Process ID : 2199 
Parent Process ID : 2118 
Agent URL : https://test-oradl11:3873/emd/main/ 
Local Agent URL in NAT : https://test-oradl11:3873/emd/main/ 
Repository URL : https://test-oempl01.drm.s365.us:4903/empbs/upload 
Started at : 2016-04-23 08:45:42 
Started by user : oracle 
Operating System : Linux version 3.8.13-118.3.1.el6uek.x86_64 (amd64) 
Last Reload : 2016-04-24 01:38:55 
Last successful upload : (none) 
Last attempted upload : 2016-04-24 01:37:43 
Total Megabytes of XML files uploaded so far : 0 
Number of XML files pending upload : 398 
Size of XML files pending upload(MB) : 0.53 
Available disk space on upload filesystem : 66.23% 
Collection Status : Collections enabled 
Backoff Expiration : 2016-04-24 01:40:17 
Heartbeat Status : Ok 
Last attempted heartbeat to OMS : 2016-04-24 01:38:05 
Last successful heartbeat to OMS : 2016-04-24 01:38:05 
Next scheduled heartbeat to OMS : 2016-04-24 01:39:05 

 --------------------------------------------------------------- 
Agent is Running and Ready 

 ./emctl verifykey 

Oracle Enterprise Manager Cloud Control 12c Release 4 
Copyright (c) 1996, 2014 Oracle Corporation. All rights reserved. 

 ----------------------------------------------------- 
verifykey: Successfully Completed communication with agent 

EMD pingOMS completed successfully 
Upload Agent Error 

 ./emctl upload agent
Oracle Enterprise Manager Cloud Control 12c Release 4
Copyright (c) 1996, 2014 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
EMD upload error:full upload has failed: Upload Recent Sending Statistics
________________________________

 Avg send time=0.0 milliseconds
Backoff Event List
________________________________
Backoff event : channel=Severities expiration at 2016-04-28 04:35:45 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Metadata expiration at 2016-04-28 04:33:18 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:35:45 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Metadata expiration at 2016-04-28 04:33:24 GMT
Upload Failure List
_______________________________
Connection Event List
_____________________________
Upload timed out before completion.
Number of files to upload before the uploadNow call: 1995, total size (MB): 2.335885
Remaining number of files to upload: 1996, total size (MB): 2.3373327 (TIMEOUT)


Solution :

1. Stop the Agent: 
./emctl stop agent 

2. Secure the Agent: 
./emctl secure agent 

3. Start the Agent: 
./emctl start agent 

4. Force Upload Agent: 
./emctl upload 

Would recommend to arrange for a downtime and Apply Patch 19458672 to the OMS home 


I tried Agent Secure but the issue still persists .. 

Final option is to Apply  Patch 19458672 to the OMS home



Help References:

Diagnosis: A common solution for these symptoms: 


Read Note:1938980.1 EM 12c: Agent and Host Target shown under Metric Collection Error after Agent Deployment 


For less common solutions than those already presented: 


Read Note:1595464.1 EM 12c: EM 12c: Troubleshooting Issues Related to Missing / Status Pending / Metric Collection Error for Host or Agent Targets after Agent Installation 


Read Note:1396675.1 EM 12c: Known Issues and Troubleshooting 12c Management Agent Installation issues 


To provide the diagnostic information typically required with the Service Request: 


Read Note:1919178.1 SRDC - Collecting Log files for Agent Startup/upload/blocked/unreachable issues 


Comments

Post a Comment

Popular posts from this blog

ORA-28086: The data redaction policy expression has an error

Image
Error: ERROR at line 1: ORA-28086: The data redaction policy expression has an error. ORA-06512: at "SYS.DBMS_REDACT_INT", line 3 ORA-06512: at "SYS.DBMS_REDACT", line 42 ORA-06512: at line 1 When we try to run same as sys user it is working perfectly fine, but as a normal user it is failing with below errors. No Privileges issue because AVO user had DBA Privilege .. Versions  confirmed  as being affected 12.1.0.2 (Server Patch Set) 11.2.0.4 Fixed: The fix for 20693579 is first included in 12.2.0.1 (Base Release) Cause : Bug 20693579 - DBMS_REDACT.ADD_POLICY fails with ORA-28086 when CURSOR_SHARING is force (Doc ID 20693579.8) To Bottom Bug 20693579  DBMS_REDACT.ADD_POLICY fails with ORA-28086 when CURSOR_SHARING is force  This note gives a brief overview of bug 20693579.  The content was last updated on: 17-FEB-2017   Click  here  for details of each of the sections below. Aff...
Read more

ORA-65139: Mismatch between XML metadata file and data file

Error: CDB$ROOT@EBTUPRDC> CREATE PLUGGABLE DATABASE EBTUSPRDPDB1 using '/home/oracle/EBTUSPRDC.xml' nocopy tempfile reuse; CREATE PLUGGABLE DATABASE EBTUSPRDPDB1 using '/home/oracle/EBTUSPRDC.xml' nocopy tempfile reuse * ERROR at line 1: ORA-65139: Mismatch between XML metadata file and data file /u05/odb/ORADATA_1/EBTUSPRDC/datafile/system.1531.807800993 for value of fcpsb (2230502002 in the plug XML file, 2230505492 in the data file) Fix: Don't open Non-CDB database until we complete pdb creation other wise we will get above error. Shutdown immediate; startup mount; alter database open read only; create xml file. shutdown immediate; Connect to CDB and Create Pluggable database .
Read more

TFA-00002 : Oracle Trace File Analyzer (TFA) is not running

TFA Failed to start listening for commands on one of the Rac Node : As a root user /etc/init.d/init.tfa  start Starting TFA.. start: Job is already running: oracle-tfa Waiting up to 100 seconds for TFA to be started.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Successfully started TFA Process.. . . . . . TFA-00002 : Oracle Trace File Analyzer (TFA) is not running TFA Failed to start listening for commands Solution : run synctfanodes.sh  if you have root password . if no root password copy below files to TFA Failed node and try to restart TFA .. Please check whether these 4 files exist on all nodes are similar. TFA_HOME/server.jks TFA_HOME/client.jks TFA_HOME/internal/ssl.properties   TFA_HOME/internal/ portmapping.txt If not similar just copy these files to TFA Failing node and try TFA Restart ..It Worked for me .   [root@host01]# ./tfactl  -v "debug" start Starting TFA...
Read more