PA-VM in AWS interface stats not showing under Panorama Managed Devices Health.
4246
Created On 10/05/23 16:29 PM - Last Modified 11/30/23 03:00 AM
Symptom
- The Panorama WebUI shows zero values for Bit Rate and Packets Per Second
- For the working case we see positive interface stats values
- The output of "show interface ethernet" shows 0 values in the "Physical port counters read from MAC: " section
> show interface ethernet1/2
Physical port counters read from MAC:
-----------------------------------------------------------------
rx-broadcast 0
rx-bytes 0
rx-multicast 0
rx-unicast 0
tx-broadcast 0
tx-bytes 0
tx-multicast 0
tx-unicast 0
- On a working firewall, one can see the physical port counter values
> show interface ethernet1/2
Physical port counters read from MAC:
----------------------------------------------------
rx-broadcast 0
rx-bytes 26032861494408
rx-multicast 0
rx-unicast 24488480433
tx-broadcast 0
tx-bytes 14630985784703
tx-multicast 0
tx-unicast 16939627582
- An SNMP using the IF-MIB shows "0" for the interface counters
# snmpwalk -c public -v 2c 10.10.10.34 1.3.6.1.2.1.31 | grep "\.2 "
IF-MIB::ifName.2 = STRING: ethernet1/2
IF-MIB::ifInMulticastPkts.2 = Counter32: 0
IF-MIB::ifInBroadcastPkts.2 = Counter32: 0
IF-MIB::ifOutMulticastPkts.2 = Counter32: 0
IF-MIB::ifOutBroadcastPkts.2 = Counter32: 0
IF-MIB::ifHCInOctets.2 = Counter64: 0
IF-MIB::ifHCInUcastPkts.2 = Counter64: 0
IF-MIB::ifHCInMulticastPkts.2 = Counter64: 0
IF-MIB::ifHCInBroadcastPkts.2 = Counter64: 0
IF-MIB::ifHCOutOctets.2 = Counter64: 0
IF-MIB::ifHCOutUcastPkts.2 = Counter64: 0
.....
- On a working fall we see non-zero interface counters
# snmpwalk -c public -v 2c 10.10.10.168 1.3.6.1.2.1.31 | grep "\.2 "
IF-MIB::ifName.2 = STRING: ethernet1/2
IF-MIB::ifInMulticastPkts.2 = Counter32: 37631
IF-MIB::ifInBroadcastPkts.2 = Counter32: 0
IF-MIB::ifOutMulticastPkts.2 = Counter32: 0
IF-MIB::ifOutBroadcastPkts.2 = Counter32: 0
IF-MIB::ifHCInOctets.2 = Counter64: 21435
IF-MIB::ifHCInUcastPkts.2 = Counter64: 0
IF-MIB::ifHCInMulticastPkts.2 = Counter64: 37631
IF-MIB::ifHCInBroadcastPkts.2 = Counter64: 0
IF-MIB::ifHCOutOctets.2 = Counter64: 23480
IF-MIB::ifHCOutUcastPkts.2 = Counter64: 314
.....
Environment
- PAN-OS 10.2.3, 11.0.2
- Panorama
- AWS firewalls using the "net_ena" NIC driver, for example, the m5 instance type
> debug show vm-series interfaces all
Interface_name Base-OS_port Base-OS_MAC PCI-ID Driver Eni
mgt eth0 06:b1:87:03:5f:65 0000:00:05.0 ena
Ethernet1/1 eth1 06:e2:04:5b:3b:eb 0000:00:06.0 net_ena eni-04fb4e3b
Ethernet1/2 eth2 06:da:90:55:42:5d 0000:00:07.0 net_ena eni-009da723
> show system state filter cfg.platform.instance-type*
cfg.platform.instance-type: m5.4xlarge
Cause
The vendor provided NIC drivers did not have the support to extract the required NIC statistics with enhanced networking enabled.
Resolution
- The issue is fixed in PAN-OS to 10.2.5, 10.2.6, 11.0.3 or 11.1.0.
- Upgrade to the fixed version will resolve the issue.
- Alternatively deploying instances that do not use the net_ena NIC driver will also resolve the issue.