Support Support Downloads Knowledge Base Apex Support Portal Community

Knowledge Base

Search our Knowledge Base sites to find answers to your questions.

Ask All Knowledge Base Sites All Knowledge Base Sites JunosE Defect (KA)Knowledge BaseSecurity AdvisoriesTechnical BulletinsTechnotes Sign in to display secure content and recently viewed articles

[QFX/PTX] Major 'FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin' alarm leading to Fabric Chip failure.

0

0

Article ID: KB35913 KB Last Updated: 11 Jun 2020Version: 1.0
Summary:

This article explains the meaning of 'FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin' error and the steps to overcome it.

Symptoms:

Error Logs:

user@host> show log chassisd | grep Alarm 
Feb  1 09:49:04 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperDisabled (entPhysicalIndex 70, entStateAdmin 3, entStateAlarm 0)
Feb  1 09:52:54  {alarm, management-ethernet, 0x3 0x8333880}
Feb  1 09:52:54  {chassis, alarm, 0x3 0x8313050}
Feb  1 09:52:54  {ecc-sbe, no-alarm, 0x3 0x8342ae0}
Feb  1 09:52:54  {aer-correctable, no-alarm, 0x3 0x8342950}
Feb  1 09:52:54  {chassis, slow-pfe-alarm, 0x3 0x834c010}
Feb  1 09:52:54  {alarm, redundancy, 0x3 0x8341440}
Feb  1 09:52:55  chassis_alarm_module_init
Feb  1 09:52:55  chassis_alarm_module_init
Feb  1 09:52:56  alarmd connection completed
Feb  1 09:52:56  send: clear all chassis class alarms
Feb  1 09:53:13  [Alarm SET] Object 150 reason 2 Device FRU VOLT SENSOR 70, reason Vsensor 70 Beyond M(FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin), color 1, slot 70 Alarm id 2521169922
Feb  1 09:53:13  send: red alarm set, device FRU VOLT SENSOR 70, reason FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin
Feb  1 10:00:42 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperEnabled (entPhysicalIndex 70, entStateAdmin 4, entStateAlarm 6)
Feb  1 10:01:00 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperEnabled (entPhysicalIndex 77, entStateAdmin 4, entStateAlarm 0)
Feb  1 10:10:01  {alarm, management-ethernet, 0x3 0x8333880}
Feb  1 10:10:01  {chassis, alarm, 0x3 0x8313050}
Feb  1 10:10:01  {ecc-sbe, no-alarm, 0x3 0x8342ae0}
Feb  1 10:10:01  {aer-correctable, no-alarm, 0x3 0x8342950}
Feb  1 10:10:01  {chassis, slow-pfe-alarm, 0x3 0x834c010}
Feb  1 10:10:01  {alarm, redundancy, 0x3 0x8341440}
Feb  1 10:10:01  chassis_alarm_module_init
Feb  1 10:10:01  chassis_alarm_module_init
Feb  1 10:10:01 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperEnabled (entPhysicalIndex 70, entStateAdmin 4, entStateAlarm 6)
Feb  1 10:10:01 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperEnabled (entPhysicalIndex 77, entStateAdmin 4, entStateAlarm 0)
Feb  1 10:10:02  alarmd connection completed
Feb  1 10:10:02  send: clear all chassis class alarms
Feb  1 10:10:05  [Alarm SET] Object 150 reason 2 Device FRU VOLT SENSOR 70, reason Vsensor 70 Beyond M(FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin), color 1, slot 70 Alarm id 2521169922
Feb  1 10:10:05  send: red alarm set, device FRU VOLT SENSOR 70, reason FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin
Feb  1 10:11:01  ch_tvp_ng_send_alarm_request: fru_type=2, slot=0, reason=14
Feb  1 10:11:01  send: red alarm set, device FPC 0, reason FPC 0 Fabric Chip Failure
Feb  1 10:11:01  ch_tvp_ng_send_alarm_request: fru_type=2, slot=0, reason=14
Feb  1 10:11:01  send: red alarm clear, device FPC 0, reason FPC 0 Fabric Chip Failure

The alarm below is seen:

user@host> show chassis alarms 
1 alarms currently active
Alarm time               Class  Description
2019-02-01 09:53:13 PST  Major  FPC0: Vsensor 70:VDD RAIL 12.0V Beyond Margin
2019-02-01 10:11:01 PST  Major  FPC0: Fabric Chip Failure

In cases where the alarm is not cleared on time, FPC may go offline due to exceeding voltage conditions. 

Cause:
  • Voltage exceeded beyond margin value
  • Overheating of FPC
  • Inadequate airflow system
Solution:

Verify if correct power supply source has been connected:

user@host> show chassis environment fpc | grep "VDD RAIL"
VDD RAIL 12.0V             12054 mV


Verify the environment status:

user@host> show chassis environment 
Class Item                           Status     Measurement
Power Power Supply 0                 OK         30 degrees C / 86 degrees F
      Power Supply 1                 OK         30 degrees C / 86 degrees F
      Power Supply 2                 OK         31 degrees C / 87 degrees F
      Power Supply 3                 OK         31 degrees C / 87 degrees F
Temp  FPC 0 MAIN Exhaust Sensor 1    OK         47 degrees C / 116 degrees F
      FPC 0 MAIN Exhaust Sensor 2    OK         46 degrees C / 114 degrees F
      FPC 0 MAIN Intake Sensor 1     OK         32 degrees C / 89 degrees F
      FPC 0 MAIN Intake Sensor 2     OK         29 degrees C / 84 degrees F
      FPC 0 MAIN Board Sensor        OK         35 degrees C / 95 degrees F
      FPC 0 MEZZ Exhaust Sensor 1    OK         59 degrees C / 138 degrees F
      FPC 0 MEZZ Exhaust Sensor 2    OK         55 degrees C / 131 degrees F
      FPC 0 MEZZ Intake Sensor 1     OK         34 degrees C / 93 degrees F
      FPC 0 MEZZ Intake Sensor 2     OK         30 degrees C / 86 degrees F
      FPC 0 MAIN PE0 Temp Sensor     OK         49 degrees C / 120 degrees F
      FPC 0 MAIN PE1 Temp Sensor     OK         56 degrees C / 132 degrees F
      FPC 0 MAIN PE2 Temp Sensor     OK         48 degrees C / 118 degrees F
      FPC 0 MAIN CPU Temp Sensor     OK         60 degrees C / 140 degrees F
      FPC 0 MAIN OCXO Temp Sensor    OK         38 degrees C / 100 degrees F
      FPC 0 MAIN PE3 Temp Sensor     OK         55 degrees C / 131 degrees F
      <snip>
      FPC 0 MEZZ-PFE9-HMC0-DIE       OK         63 degrees C / 145 degrees F
      FPC 0 MEZZ-PFE9-HMC0-TOP       OK         52 degrees C / 125 degrees F
      FPC 0 MAIN-PFE0-DIODE-0        OK         45 degrees C / 113 degrees F
      FPC 0 MAIN-PFE0-DIODE-1        OK         46 degrees C / 114 degrees F
      FPC 0 MAIN-PFE1-DIODE-0        OK         53 degrees C / 127 degrees F
      FPC 0 MAIN-PFE1-DIODE-1        OK         54 degrees C / 129 degrees F
      FPC 0 MAIN-PFE2-DIODE-0        OK         45 degrees C / 113 degrees F
      FPC 0 MAIN-PFE2-DIODE-1        OK         46 degrees C / 114 degrees F
      FPC 0 MAIN-PFE3-DIODE-0        OK         53 degrees C / 127 degrees F
      FPC 0 MAIN-PFE3-DIODE-1        OK         54 degrees C / 129 degrees F
      FPC 0 MAIN-PFE4-DIODE-0        OK         45 degrees C / 113 degrees F
      FPC 0 MAIN-PFE4-DIODE-1        OK         47 degrees C / 116 degrees F
      FPC 0 MAIN-PFE5-DIODE-0        OK         54 degrees C / 129 degrees F
      FPC 0 MAIN-PFE5-DIODE-1        OK         55 degrees C / 131 degrees F
      FPC 0 MEZZ-PFE6-DIODE-0        OK         47 degrees C / 116 degrees F
      FPC 0 MEZZ-PFE11-DIODE-0       OK         55 degrees C / 131 degrees F
      FPC 0 MEZZ-PFE11-DIODE-1       OK         57 degrees C / 134 degrees F
Fans  Fan Tray 0                     OK         Spinning at normal speed
      Fan Tray 1                     OK         Spinning at normal speed
      Fan Tray 2                     OK         Spinning at normal speed


Verify temperature-thresholds:

user@host> show chassis temperature-thresholds
                                        Fan speed      Yellow alarm      Red alarm      Fire Shutdown
                                       (degrees C)      (degrees C)     (degrees C)      (degrees C)
Item                                  Normal  High   Normal  Bad fan   Normal  Bad fan     Normal
FPC 0 MAIN Exhaust Sensor 1               49    68       80       75       85       80         95
FPC 0 MAIN Exhaust Sensor 2               49    68       80       75       85       80         95
FPC 0 MAIN Intake Sensor 1                30    54       62       57       66       61         75
FPC 0 MAIN Intake Sensor 2                30    54       62       57       66       61         75
FPC 0 MAIN Board Sensor                   25    52       63       58       80       75         85
FPC 0 MEZZ Exhaust Sensor 1               68    81       88       83       91       86         95
FPC 0 MEZZ Exhaust Sensor 2               68    81       88       83       91       86         95
FPC 0 MEZZ Intake Sensor 1                30    54       62       57       66       61         75
FPC 0 MEZZ Intake Sensor 2                30    54       62       57       66       61         75
FPC 0 MAIN PE0 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MAIN PE1 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MAIN PE2 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MAIN CPU Temp Sensor                72    87       96       96      100      100        108
FPC 0 MAIN OCXO Temp Sensor               50    70       81       81       90       90        100
FPC 0 MAIN PE3 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MAIN PE4 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MAIN PE5 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MEZZ PE6 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MEZZ PE7 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MEZZ PE8 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MEZZ PE9 Temp Sensor                67    86       97       97      105      105        120
FPC 0 MEZZ PE10 Temp Sensor               67    86       97       97      105      105        120
FPC 0 MEZZ PE11 Temp Sensor               67    86       97       97      105      105        120
FPC 0 MEZZ PF0 Temp Sensor                82    95      102      102      105      105        120
<snip>

Verify power on chassis:​

user@host> show chassis power detail
<snip PEM details>
System:
  Zone 0:
      Capacity:          6400 W (maximum 6400 W)
      Allocated power:   1224 W (5176 W remaining)
      Actual usage:      1224 W
  Total system capacity: 6400 W (maximum 6400 W)
  Total remaining power: 5176 W
Item                 Used(W)
  Fan Tray 0              0
  Fan Tray 1              0
  Fan Tray 2              0
  RE0/CB0                 0
  SIB 0                   0
  FPC 0                   0


To overcome the alarm, perform a restart of chassis control​. 

user@host> restart chassis-control 
Chassis control process started, pid 727

In case the alarm still exists, restart the FPC and check the voltage supplies. This will temporarily affect services running on the FPC, so be prepared for such an occurrence. This will re-initiate power into the FRU making sure that any transient issue is cleared. If the device is a standalone box where FPC is not a Field- Replaceable-Unit, restart the chassis (RE).
WARNING: This will cause downtime on the system and must be performed during a Maintenance Window under supervision by JTAC Engineer or a Juniper Expert.
Comment on this article > Affected Products Browse the Knowledge Base for more articles related to these product categories. Select a category to begin.

Getting Up and Running with Junos

Getting Up and Running with Junos Security Alerts and Vulnerabilities Product Alerts and Software Release Notices Problem Report (PR) Search Tool EOL Notices and Bulletins JTAC User Guide Customer Care User Guide Pathfinder SRX High Availability Configurator SRX VPN Configurator Training Courses and Videos End User Licence Agreement Global Search