OEM Agent upload Failing with EMD upload error:full upload has failed: Upload Recent Sending Statistics


Agent is up and running fine ..but Upload is Failing with   EMD upload error:full upload has failed: Upload Recent Sending Statistics 

 Note:  Tried installation multiple times but stuck with same error..No communication or Port issue with OMS .. No Known issue.

Here is my Agent status:


 ./emctl status agent 
Oracle Enterprise Manager Cloud Control 12c Release 4 
Copyright (c) 1996, 2014 Oracle Corporation. All rights reserved. 
--------------------------------------------------------------- 
Agent Version : 12.1.0.4.0 
OMS Version : 12.1.0.4.0 
Protocol Version : 12.1.0.1.0 
Agent Home : /usr/lib/oracle/agent_drm/agent_inst 
Agent Log Directory : /usr/lib/oracle/agent_drm/agent_inst/sysman/log 
Agent Binaries : /usr/lib/oracle/agent_drm/core/12.1.0.4.0 
Agent Process ID : 2199 
Parent Process ID : 2118 
Agent URL : https://test-oradl11:3873/emd/main/ 
Local Agent URL in NAT : https://test-oradl11:3873/emd/main/ 
Repository URL : https://test-oempl01.drm.s365.us:4903/empbs/upload 
Started at : 2016-04-23 08:45:42 
Started by user : oracle 
Operating System : Linux version 3.8.13-118.3.1.el6uek.x86_64 (amd64) 
Last Reload : 2016-04-24 01:38:55 
Last successful upload : (none) 
Last attempted upload : 2016-04-24 01:37:43 
Total Megabytes of XML files uploaded so far : 0 
Number of XML files pending upload : 398 
Size of XML files pending upload(MB) : 0.53 
Available disk space on upload filesystem : 66.23% 
Collection Status : Collections enabled 
Backoff Expiration : 2016-04-24 01:40:17 
Heartbeat Status : Ok 
Last attempted heartbeat to OMS : 2016-04-24 01:38:05 
Last successful heartbeat to OMS : 2016-04-24 01:38:05 
Next scheduled heartbeat to OMS : 2016-04-24 01:39:05 

 --------------------------------------------------------------- 
Agent is Running and Ready 

 ./emctl verifykey 

Oracle Enterprise Manager Cloud Control 12c Release 4 
Copyright (c) 1996, 2014 Oracle Corporation. All rights reserved. 

 ----------------------------------------------------- 
verifykey: Successfully Completed communication with agent 

EMD pingOMS completed successfully 
Upload Agent Error 

 ./emctl upload agent
Oracle Enterprise Manager Cloud Control 12c Release 4
Copyright (c) 1996, 2014 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
EMD upload error:full upload has failed: Upload Recent Sending Statistics
________________________________

 Avg send time=0.0 milliseconds
Backoff Event List
________________________________
Backoff event : channel=Severities expiration at 2016-04-28 04:35:45 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Metadata expiration at 2016-04-28 04:33:18 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:35:45 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Severities expiration at 2016-04-28 04:36:06 GMT
Backoff event : channel=Metadata expiration at 2016-04-28 04:33:24 GMT
Upload Failure List
_______________________________
Connection Event List
_____________________________
Upload timed out before completion.
Number of files to upload before the uploadNow call: 1995, total size (MB): 2.335885
Remaining number of files to upload: 1996, total size (MB): 2.3373327 (TIMEOUT)


Solution :

1. Stop the Agent: 
./emctl stop agent 

2. Secure the Agent: 
./emctl secure agent 

3. Start the Agent: 
./emctl start agent 

4. Force Upload Agent: 
./emctl upload 

Would recommend to arrange for a downtime and Apply Patch 19458672 to the OMS home 


I tried Agent Secure but the issue still persists .. 

Final option is to Apply  Patch 19458672 to the OMS home



Help References:

Diagnosis: A common solution for these symptoms: 


Read Note:1938980.1 EM 12c: Agent and Host Target shown under Metric Collection Error after Agent Deployment 


For less common solutions than those already presented: 


Read Note:1595464.1 EM 12c: EM 12c: Troubleshooting Issues Related to Missing / Status Pending / Metric Collection Error for Host or Agent Targets after Agent Installation 


Read Note:1396675.1 EM 12c: Known Issues and Troubleshooting 12c Management Agent Installation issues 


To provide the diagnostic information typically required with the Service Request: 


Read Note:1919178.1 SRDC - Collecting Log files for Agent Startup/upload/blocked/unreachable issues 


Comments

Post a Comment

Popular posts from this blog

Useful OEM Queries to get Target details from OEM Repository

List Targets with TNS Listener ports configured : SELECT mgmt$target.host_name , mgmt$target.target_name , mgmt$target.target_type , mgmt$target_properties.property_name , mgmt$target_properties.property_value FROM mgmt$target , mgmt$target_properties WHERE ( mgmt$target.target_name = mgmt$target_properties.target_name ) AND ( mgmt$target.target_type = mgmt$target_properties.target_type ) and ( mgmt$target.target_type = 'oracle_listener' ) and ( mgmt$target_properties.property_name = 'Port' ); Devora02       LISTENER_ora02                       oracle_listener Port 1529 Devora01       LISTENER_ora01                       oracle_listener Port 1529 Devora04       LISTENER_ora04                       oracle_listener Port 1529 List Machine_Names, CPU Count & Database Verion for Licensing SELECT mgmt$target.host_name , mgmt$target_properties.property_name , mgmt$target_properties.property_value FROM mgmt$target , mgmt$target_properties WHERE ( mgmt$
Read more

WARNING: Subscription for node down event still pending' in Listener Log

Image
These messages are related to the Oracle TNS Listener's default subscription to the Oracle Notification Service (ONS). In a non-RAC environment it is recommended to disable this subscription.   This feature was introduced in Oracle 10g. SOLUTION Set the following parameter in the listener.ora: SUBSCRIBE_FOR_NODE_DOWN_EVENT_<listener_name>=OFF Where <listener_name> should be replaced with the actual listener name configured in the LISTENER.ORA file. SUBSCRIBE_FOR_NODE_DOWN_EVENT_<listener_name> parameter is to be placed by itself on an empty line. It will be necessary to restart or reload the listener following the addition of this parameter. This will prevent the messages from being written to the log file and may also prevent the TNS Listener from hanging periodically.  See (10g only) NOTE 340091.1 Intermittent TNS Listener Hang, New Child Listener Process Forked Please Note: Setting SUBSCRIBE_FOR_NODE_DOWN_<listener_n
Read more

ORA-65139: Mismatch between XML metadata file and data file

Error: CDB$ROOT@EBTUPRDC> CREATE PLUGGABLE DATABASE EBTUSPRDPDB1 using '/home/oracle/EBTUSPRDC.xml' nocopy tempfile reuse; CREATE PLUGGABLE DATABASE EBTUSPRDPDB1 using '/home/oracle/EBTUSPRDC.xml' nocopy tempfile reuse * ERROR at line 1: ORA-65139: Mismatch between XML metadata file and data file /u05/odb/ORADATA_1/EBTUSPRDC/datafile/system.1531.807800993 for value of fcpsb (2230502002 in the plug XML file, 2230505492 in the data file) Fix: Don't open Non-CDB database until we complete pdb creation other wise we will get above error. Shutdown immediate; startup mount; alter database open read only; create xml file. shutdown immediate; Connect to CDB and Create Pluggable database .
Read more