This article describes the Inventory Synchronization job in addition to a failure scenario and the cause behind it.

Note: Inventory Synchronization is an add-on job which is patched to every JOB for DVPN creation or deletion to get the device stats/configuration to make sure that configuration duplication does not happen (for example the GRE tunnel interface configured or deleted).

The job fails with the following error:

Task: resync-topo-device

Sep 15 2020 11:37:07 AM discover resources task in-progress
Sep 15 2020 11:37:07 AM Task started
Sep 15 2020 11:37:07 AM discover resources task in-progress
Sep 15 2020 11:38:36 AM discover resources task failed
Sep 15 2020 11:38:36 AM Task complete
Sep 15 2020 11:38:36 AM discover resources task failed

From the TSSM logs, it was discovered that a command execution on the CPE failed.

The error that was discovered:

Upon checking the command output (XML), the error came from the device side:

</output-bps>
<output-pps>
96072
</output-pps>
</traffic-statistics>
<logical-interface>
nc:rpc-error
nc:error-typeprotocol</nc:error-type>
nc:error-tagoperation-failed</nc:error-tag>
nc:error-severityerror</nc:error-severity>
<source-daemon>
ifinfo
</source-daemon>
nc:error-message
remote statistics get for interface reth4.0 failed: Resource temporarily unavailable (35)
</nc:error-message>
</nc:rpc-error>
</logical-interface>
</physical-interface>
</interface-information>
</nc:rpc-reply>
]]>]]>
"},

Since this RPC is relative to retrieve interface utilization, checking the same output from the platform side, the same error is seen for reth4:

junoscript interactive
rpc <get-interface-information></get-interface-information>

When checking the said interface statistics, an error was seen:

root@srx> show interfaces reth4
Physical interface: reth4, Enabled, Physical link is Up
Interface index: 132, SNMP ifIndex: 565
Description: AUX_0 Connected to JCP
Link-level type: Ethernet, MTU: 1518, Speed: 10Gbps, BPDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled,
Flow control: Disabled, Minimum links needed: 1, Minimum bandwidth needed: 1bps
Device flags   : Present Running
Interface flags: SNMP-Traps Internal: 0x4000
Current address: 00:10:db:ff:10:04, Hardware address: 00:10:db:ff:10:04
Last flapped   : 2020-09-24 15:40:04 UTC (4d 00:53 ago)
Input rate     : 944 bps (0 pps)
Output rate    : 0 bps (0 pps)
error: remote statistics get for interface reth4.0 failed: Resource temporarily unavailable (35)  

Hence, the error of the Job failure was due to a command execution failure on the CPE and not in the CSO.
The issue needs to be debugged from a platform prospective.