Knowledge Search


×
 

[PTX] 'Info cell drops' counter incrementing on the FPC of a disabled PFE

  [KB34308] Show Article Properties


Summary:

'Info cell drops' are observed on the FPC without any impact.

Symptoms:

Syslog reports that a PFE is disabled:

Mar 20 18:20:36  r1 : %PFE-3: fpc0 pechip_set_pfe_disabled:976: PECHIP[1]: PFE Marked Disabled !!!
Mar 20 18:20:36  r1 : %PFE-3: fpc0 pechip_set_pfe_disabled:983: PECHIP[1]: Deregisterd TOE PIO Vectors !!!
Mar 20 18:20:36  r1 : %PFE-3: fpc0 JPRDS_FDB:ERR:jprds_fdb_set_pfe_disabled(),7656: pfe 1 marked disabled 
Mar 20 18:20:36  r1 : %PFE-0: fpc0 Cmerror Op Set: PE Chip::FATAL ERROR!! from pe1[1]: HMCIF: Link2: Retry Error 
Mar 20 18:20:37  r1 : %PFE-3: fpc0 Cmerror Op Set: Host Loopback: HOST LOOPBACK WEDGE DETECTED IN PATH ID 2 
Mar 20 18:20:37  r1 : %PFE-3: fpc0 Cmerror Op Set: Host Loopback: HOST LOOPBACK WEDGE DETECTED IN PATH ID 3 
Mar 20 18:31:30  r1 : %PFE-3: fpc0 Cmerror Op Set: PE Chip: pe1[1]: IQM: pkt_timeout error 
Mar 20 18:32:54  r1 : %PFE-3: fpc0 Cmerror Op Set: PE Chip: pe1[1]: HOSTSYS HIF Write NACK for Aperture 0 
Mar 20 18:32:55  r1 : %PFE-3: fpc0 Cmerror Op Set: PE Chip: pe1[1]: HOSTSYS HIF Write NACK for Aperture 0 
Mar 20 18:34:06  r1 : %PFE-3: fpc0 Cmerror Op Clear: PE Chip: pe1[1]: IQM: clear pkt_timeout error  


'Info cell drops' counter is increasing:

r1> show pfe statistics traffic fpc 0 | match info | refresh 5      
---(refreshed at 2019-04-17 02:16:30 UTC)---
    Info cell drops            :              4720693
---(refreshed at 2019-04-17 02:16:35 UTC)---
    Info cell drops            :              4720707
---(refreshed at 2019-04-17 02:16:40 UTC)---
    Info cell drops            :              4720713

'show chassis fpc errors' also confirms that the PFE state is disabled:

r1> show chassis fpc errors
FPC  Level Occurred Cleared Threshold Action-Taken Action
2   Minor      0      0     10      0   LOG|
    Major      0      0      1      0 GET STATE|ALARM|
    Fatal      0      0      1      0 DISABLE PFE
    Pfe-State: pfe-0 -ENABLED | pfe-1 -DISABLED | pfe-2 -ENABLED | pfe-3 -ENABLED | pfe-4 -ENABLED | pfe-5 -ENABLED |
Cause:

PFE was disabled due to an HMC error in the FPC that caused the lookup to get stalled. This caused the 'Info cell drops' counter to increase. This counter can be ignored during this state.

Solution:

1. Collect the following data during the problem state:

request support information 
/var/log


2. Also collect the following output from the PFE of the FPC:

start shell pfe network fpc< >
show syslog messages
show pechip < > iqm debug global-counters
show pechip < > ipw debug-statistics
show pechip < > trapstats verbose


3. Restart the FPC to clear the PFE disabled state. This will eventually clear the 'Info cell drops' as well.
 

4. If restarting the FPC does not resolve the issue, repeat steps 1 and 2, and open a case with your technical support representative. 

Attach the collected outputs before and after restarting the FPC.



Related Links: