Knowledge Search


×
 

[QFX] FPC reboots due to NMI timeout

  [KB35068] Show Article Properties


Summary:

In QFX10008 or QFX10016, FPC can reboot for various unexpected reasons. This article explains what it means if an FPC is rebooted due to 'NMI timeout'.

Symptoms:

The following syslog message is seen:

Sep 11 22:03:28.835  qfx-node chassisd[5510]: fru_nmi_timer: Restart FPC 7 due to NMI timeout <-- root cause
Solution:

The purpose of NMI (non maskable interrupt) is for voltage failure errors monitoring the flexible PIC concentrator (FPC).  There is a knob to disable that in T/MX/EX, but not for QFX.  The feature is meant for dynamic power management feature. For details, refer to the technical documentation on Configuring Voltage Level Monitoring of FPCs.

In the message log, check if there is any reference about power shortage or daemon alarms stating the same terms. Ensure the device has sufficient power inputs to power up FPCs.

Example:

Sep 11 22:02:39.698  qfx-node craftd[5512]: Receive FX craftd set alarm message: color: 2 class: 100 object: 127 slot: 0 silent: 0 short_reason=Power Budget: Minor long_reason=Power Budget:Chassis experiencing power shortage id=33554559 reason=16777216
Sep 11 22:02:39.698  qfx-node craftd[5512]:  Minor alarm set, Power Budget:Chassis experiencing power shortage

For 100GE FPC ULC-30Q28, max power is 1150W. 100GE takes much more power vs 40GE FPCs. This is an important consideration when checking for power shortage.

Sep 11 22:02:38.858  qfx-node craftd[5512]: Receive FX craftd set alarm message: color: 2 class: 100 object: 75 slot: 0 silent: 0 short_reason=PEM 0 No Power long_reason=PEM 0 Not Powered id=402653259 reason=402653184
Sep 11 22:02:38.858  qfx-node craftd[5512]:  Minor alarm set, PEM 0 Not Powered
Sep 11 22:02:38.862  qfx-node craftd[5512]: Receive FX craftd set alarm message: color: 2 class: 100 object: 75 slot: 1 silent: 0 short_reason=PEM 1 No Power long_reason=PEM 1 Not Powered id=402653515 reason=402653184
Sep 11 22:02:38.864  qfx-node alarmd[5511]: Alarm set: PS SFXPC color=YELLOW, class=CHASSIS, reason=PEM 1 Not Powered
Sep 11 22:02:38.864  qfx-node craftd[5512]:  Minor alarm set, PEM 1 Not Powered
Sep 11 22:02:38.867  qfx-node craftd[5512]: Receive FX craftd set alarm message: color: 2 class: 100 object: 75 slot: 5 silent: 0 short_reason=PEM 5 Feed 2 no inp long_reason=PEM 5 Feed 2 has no input source id=553649483 reason=553648128
Sep 11 22:02:38.867  qfx-node craftd[5512]:  Minor alarm set, PEM 5 Feed 2 has no input source

Related Links: