[MX] Output pps/bps counters of AE child links not getting updated

  [KB34863] Show Article Properties


Summary:

Customers may notice that although the Input pps/bps counters of AE child links are updated correctly, the Output pps/bps counters of these links are not updated on MX Series routers.

The article gives more information about this behavior and clarifies whether any workaround is available to update the counters.

 

Symptoms:

On the ICMP echo sender router and reply sender router, the Input pps/bps counters of AE child links are updated correctly, but the Output pps/bps counters of these child links are not updated at all, although ICMP packets are flowing between the ICMP echo/reply sender routers.

On the transit router, both Input/Output pps/bps counters work.

When you check the child link statistics counters while ICMP packets are flowing between the ICMP echo sender router and the ICMP reply sender router, the following values are seen:

User@MX> clear interfaces statistics all

User@MX> ping 192.168.2.2 rapid count 9999999
PING 192.168.2.2 (192.168.2.2): 56 data bytes
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

           <--- 192.168.1.0/24 --->          <--- 192.168.2.0/24 --->

 ICMP echo sender                   Transit                          ICMP reply sender
+--------+                        +--------+                        +--------+
|        |ge-0/2/1        ge-0/3/1|        |ge-0/2/9        ge-0/3/9|        |
|        +------------------------+        +------------------------+        |
|  main  |ae0                  ae1| LSYS1  |ae2                  ae3| LSYS2  |
|        +------------------------+        +------------------------+        |
|        |ge-0/2/0        ge-0/3/0|        |ge-0/2/8        ge-0/3/8|        |
+--------+                        +--------+                        +--------+
           .1                   .2           .1                    .2

    RE                                                                    RE
    | ^                                                                   | ^
    | |                                                                   | |
    | |ge-0/2/1 in      ge-0/3/1 out          ge-0/2/9 in     ge-0/3/9 out| |
    | +<----------------------------ICMPreply <---------------------------+ |
    +------------------------------>ICMPecho ------------------------------>+
       ge-0/2/0 out     ge-0/3/0 in           ge-0/2/9 out    ge-0/3/9 in

 ICMP echo sender router  : Main router
Transit router           : LSYS1
ICMP reply sender router : LSYS2

User@MX> show interfaces ae0 extensive |no-more
Physical interface: ae0, Enabled, Physical link is Up
  Interface index: 202, SNMP ifIndex: 633, Generation: 205
  Link-level type: Ethernet, MTU: 1514, Speed: 2Gbps, BPDU Error: None, MAC-REWRITE Error: None,
  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled
  Pad to minimum frame size: Disabled
  Minimum links needed: 1, Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: 2c:21:72:b8:0f:c0, Hardware address: 2c:21:72:b8:0f:c0
  Last flapped   : 2019-06-17 14:06:25 JST (00:12:46 ago)
  Statistics last cleared: 2019-06-17 14:18:54 JST (00:00:17 ago)
  Traffic statistics:
   Input  bytes  :               525252               753640 bps
   Output bytes  :               695760               979264 bps
   Input  packets:                 6253                 1121 pps
   Output packets:                 6690                 1177 pps
   IPv6 transit statistics:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  Dropped traffic statistics due to STP State:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  MAC statistics:                      Receive         Transmit
    Broadcast packets                        0                0
    Multicast packets                        0                0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0,
    Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0
  Ingress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                                0                    0                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                             6465                 6465                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    1                   expedited-forwarding
    2                   assured-forwarding
    3                   network-control

  Logical interface ae0.0 (Index 325) (SNMP ifIndex 553) (Generation 215)
    Flags: Up SNMP-Traps 0x4004000 Encapsulation: ENET2
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :          6253       1121        525252       753640
        Output:          6694          0        656012            0 <<<<<<<<<<< Output pps and bps are '0'
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      ge-0/2/0.0
        Input :             0          0             0            0
        Output:          6692          0        655816            0 <<<<<<<<<<< Output pps and bps are '0'
      ge-0/2/1.0
        Input :          6253       1121        525252       753640
        Output:             0          0             0            0

    Aggregate member links: 2

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      ge-0/2/0.0                 0           0            0            0
      ge-0/2/1.0                 0           0            0            0
    Protocol inet, MTU: 1500
    Max nh cache: 75000, New hold nh limit: 75000, Curr nh cnt: 1, Curr new hold cnt: 0,
    NH drop cnt: 0
    Generation: 323, Route table: 0
      Flags: Sendbcast-pkt-to-re
      Addresses, Flags: Is-Preferred Is-Primary
        Destination: 192.168.1/24, Local: 192.168.1.1, Broadcast: 192.168.1.255, Generation: 193
    Protocol multiservice, MTU: Unlimited, Generation: 324, Route table: 0
      Flags: Is-Primary
      Policer: Input: __default_arp_policer__

User@MX> show interfaces ae1 extensive |no-more
Physical interface: ae1, Enabled, Physical link is Up
  Interface index: 203, SNMP ifIndex: 634, Generation: 206
  Link-level type: Ethernet, MTU: 1514, Speed: 2Gbps, BPDU Error: None, MAC-REWRITE Error: None,
  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled
  Pad to minimum frame size: Disabled
  Minimum links needed: 1, Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: 2c:21:72:b8:0f:c1, Hardware address: 2c:21:72:b8:0f:c1
  Last flapped   : 2019-06-17 14:06:25 JST (00:12:51 ago)
  Statistics last cleared: 2019-06-17 14:18:54 JST (00:00:22 ago)
  Traffic statistics:
   Input  bytes  :               922236               800344 bps
   Output bytes  :               922236               800680 bps
   Input  packets:                10979                 1190 pps
   Output packets:                10979                 1191 pps
   IPv6 transit statistics:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  Dropped traffic statistics due to STP State:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  MAC statistics:                      Receive         Transmit
    Broadcast packets                        0                0
    Multicast packets                        0                0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0,
    Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0
  Ingress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                                0                    0                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                            12481                12481                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    1                   expedited-forwarding
    2                   assured-forwarding
    3                   network-control

  Logical interface ae1.0 (Index 336) (SNMP ifIndex 560) (Generation 226)
    Flags: Up SNMP-Traps 0x4004000 Encapsulation: ENET2
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :         10979       1190        922236       800344
        Output:         10979       1191        922236       800680
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      ge-0/3/0.0
        Input :         10979       1190        922236       800344
        Output:             0          0             0            0
      ge-0/3/1.0
        Input :             0          0             0            0
        Output:         10979       1191        922236       800680

    Aggregate member links: 2

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      ge-0/3/0.0                 0           0            0            0
      ge-0/3/1.0                 0           0            0            0
    Protocol inet, MTU: 1500
    Max nh cache: 75000, New hold nh limit: 75000, Curr nh cnt: 1, Curr new hold cnt: 0,
    NH drop cnt: 0
    Generation: 355, Route table: 29
      Flags: Sendbcast-pkt-to-re, Is-Primary
      Addresses, Flags: Is-Default Is-Preferred Is-Primary
        Destination: 192.168.1/24, Local: 192.168.1.2, Broadcast: 192.168.1.255, Generation: 197
    Protocol multiservice, MTU: Unlimited, Generation: 335, Route table: 29
      Policer: Input: __default_arp_policer__


User@MX> show interfaces ae2 extensive |no-more
Physical interface: ae2, Enabled, Physical link is Up
  Interface index: 204, SNMP ifIndex: 635, Generation: 207
  Link-level type: Ethernet, MTU: 1514, Speed: 2Gbps, BPDU Error: None, MAC-REWRITE Error: None,
  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled
  Pad to minimum frame size: Disabled
  Minimum links needed: 1, Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: 2c:21:72:b8:0f:c2, Hardware address: 2c:21:72:b8:0f:c2
  Last flapped   : 2019-06-17 14:06:25 JST (00:12:55 ago)
  Statistics last cleared: 2019-06-17 14:18:54 JST (00:00:26 ago)
  Traffic statistics:
   Input  bytes  :              1311072               786232 bps
   Output bytes  :              1311072               786232 bps
   Input  packets:                15608                 1169 pps
   Output packets:                15608                 1169 pps
   IPv6 transit statistics:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  Dropped traffic statistics due to STP State:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  MAC statistics:                      Receive         Transmit
    Broadcast packets                        0                0
    Multicast packets                        0                0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0,
    Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0
  Ingress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                                0                    0                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                            17170                17170                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    1                   expedited-forwarding
    2                   assured-forwarding
    3                   network-control

  Logical interface ae2.0 (Index 337) (SNMP ifIndex 555) (Generation 227)
    Flags: Up SNMP-Traps 0x4004000 Encapsulation: ENET2
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :         15608       1169       1311072       786232
        Output:         15608       1169       1311072       786232
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      ge-0/2/8.0
        Input :             0          0             0            0
        Output:             0          0             0            0
      ge-0/2/9.0
        Input :         15608       1169       1311072       786232
        Output:         15608       1169       1311072       786232

    Aggregate member links: 2

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      ge-0/2/8.0                 0           0            0            0
      ge-0/2/9.0                 0           0            0            0
    Protocol inet, MTU: 1500
    Max nh cache: 75000, New hold nh limit: 75000, Curr nh cnt: 1, Curr new hold cnt: 0,
    NH drop cnt: 0
    Generation: 356, Route table: 29
      Flags: Sendbcast-pkt-to-re
      Addresses, Flags: Is-Preferred Is-Primary
        Destination: 192.168.2/24, Local: 192.168.2.1, Broadcast: 192.168.2.255, Generation: 199
    Protocol multiservice, MTU: Unlimited, Generation: 336, Route table: 29
      Policer: Input: __default_arp_policer__


User@MX> show interfaces ae3 extensive |no-more
Physical interface: ae3, Enabled, Physical link is Up
  Interface index: 205, SNMP ifIndex: 636, Generation: 208
  Link-level type: Ethernet, MTU: 1514, Speed: 2Gbps, BPDU Error: None, MAC-REWRITE Error: None,
  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled
  Pad to minimum frame size: Disabled
  Minimum links needed: 1, Minimum bandwidth needed: 1bps
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Current address: 2c:21:72:b8:0f:c3, Hardware address: 2c:21:72:b8:0f:c3
  Last flapped   : 2019-06-17 14:06:26 JST (00:12:58 ago)
  Statistics last cleared: 2019-06-17 14:18:54 JST (00:00:30 ago)
  Traffic statistics:
   Input  bytes  :              1710660               799000 bps
   Output bytes  :              2264704               997984 bps
   Input  packets:                20365                 1188 pps
   Output packets:                21776                 1199 pps
   IPv6 transit statistics:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  Dropped traffic statistics due to STP State:
   Input  bytes  :                    0
   Output bytes  :                    0
   Input  packets:                    0
   Output packets:                    0
  MAC statistics:                      Receive         Transmit
    Broadcast packets                        0                0
    Multicast packets                        0                0
  Input errors:
    Errors: 0, Drops: 0, Framing errors: 0, Runts: 0, Giants: 0, Policed discards: 0,
    Resource errors: 0
  Output errors:
    Carrier transitions: 0, Errors: 0, Drops: 0, MTU errors: 0, Resource errors: 0

  Ingress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                                0                    0                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Egress queues: 8 supported, 4 in use
  Queue counters:       Queued packets  Transmitted packets      Dropped packets
    0                            21564                21564                    0
    1                                0                    0                    0
    2                                0                    0                    0
    3                                0                    0                    0
  Queue number:         Mapped forwarding classes
    0                   best-effort
    1                   expedited-forwarding
    2                   assured-forwarding
    3                   network-control

  Logical interface ae3.0 (Index 338) (SNMP ifIndex 562) (Generation 228)
    Flags: Up SNMP-Traps 0x4004000 Encapsulation: ENET2
    Statistics        Packets        pps         Bytes          bps
    Bundle:
        Input :         20365       1188       1710660       799000
        Output:         21779          0       2134342            0 <<<<<<<<<<< Output pps and bps are '0'
    Adaptive Statistics:
        Adaptive Adjusts:          0
        Adaptive Scans  :          0
        Adaptive Updates:          0
    Link:
      ge-0/3/8.0
        Input :             0          0             0            0
        Output:             0          0             0            0
      ge-0/3/9.0
        Input :         20365       1188       1710660       799000
        Output:         21777          0       2134146            0 <<<<<<<<<<< Output pps and bps are '0'

    Aggregate member links: 2

    Marker Statistics:   Marker Rx     Resp Tx   Unknown Rx   Illegal Rx
      ge-0/3/8.0                 0           0            0            0
      ge-0/3/9.0                 0           0            0            0
    Protocol inet, MTU: 1500
    Max nh cache: 75000, New hold nh limit: 75000, Curr nh cnt: 1, Curr new hold cnt: 0,
    NH drop cnt: 0
    Generation: 340, Route table: 30
      Flags: Sendbcast-pkt-to-re, Is-Primary
      Addresses, Flags: Is-Default Is-Preferred Is-Primary
        Destination: 192.168.2/24, Local: 192.168.2.2, Broadcast: 192.168.2.255, Generation: 195
    Protocol multiservice, MTU: Unlimited, Generation: 337, Route table: 30
      Policer: Input: __default_arp_policer__

 

Solution:

The ICMP echo/reply packets for sender routers are L2 inject packets, and the stats rates for these are not updated anywhere in the kernel software. This is why the Output pps/bps counters are not updated in the AE child links.

This is a product limitation and there is no workaround or fix available.

 

Related Links: