High Disk Space Usage on /opt/pancfg partition and How To Clear

High Disk Space Usage on /opt/pancfg partition and How To Clear

63731
Created On 04/08/19 13:54 PM - Last Modified 03/25/22 19:03 PM


Symptom
  • Unable to log into Web UI
  • Unable to download PAN-OS release images (Device> Software Updates)
  • Unable to download Dynamic Wildfire, Content images (Device> Dynamic Updates)
WebGUI_Error
  • The /opt/pancfg partition is greater than 90 percent
> show system disk-space 

Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3             7.6G  2.8G  4.4G  40% /
/dev/sda5              23G   21G  1.4G  94% /opt/pancfg         <------ Over 90%
/dev/sda6              16G   13G  1.5G  91% /opt/panrepo
tmpfs                 7.9G  110M  7.8G   2% /dev/shm
cgroup_root           7.9G     0  7.9G   0% /cgroup
/dev/sda8              56G   17G   37G  32% /opt/panlogs
/dev/loop0             16G  173M   15G   2% /opt/logbuffer


Environment
  • PAN-OS
  • Palo Alto Firewall
  • Panorama


Cause
Some of the usual causes of /opt/pancfg filling up are:
  • Large number of saved configurations
  • Large number of downloaded PAN-OS software image files
  • In Panorama, large number of downloaded PAN-OS software image files for managed devices under Panorama> Device Deployment
  • Although there is still 1.4GB free space left in the /opt/pancfg partition, the downloads will still fail. The PAN-OS runs a strict check on the disk space on /opt/pancfg. If it is 90% or above, the downloads will fail regardless of the available free disk-space.

Important Note About Panorama:
Whenever a candidate configuration is saved on a firewall managed by Panorama, either via the web interface (Device > Setup > Operations > Save named configuration snapshot) or via the CLI (“save config to <filename>”), the same file is also saved on Panorama in the directory /opt/pancfg/mgmt/devices/<SN>/. In this case, <SN> is the serial number of the firewall.

Whenever a saved candidate configuration on the firewall is deleted (“delete config saved <filename>”), the configuration file is NOT automatically deleted from Panorama. By having numerous firewalls managed by the same Panorama, some of them with large configuration files will eventually lead to exhaustion of the available disk space on the /opt/pancfg/ partition.

 


Resolution

From the CLI

  1. Delete Software and Dynamic Update Images
delete software version <version-number>
delete config saved <file-name>
delete config repo <Named snapshot>
delete content cache old-content
delete wildfire update <value>
delete anti-virus update <value>
  1. Delete saved config files from specific devices (Panorama only)
Panorama> delete config repo device <device SN> file <Named snapshot>​​​​​​
Note: No bulk delete is possible through the Web Interface or CLI.
  1. You can lower the number of maximum images to keep. Default is set to 5.
> show max-num-images
Maximum images to keep is set to 5

To change the number stored to a minimum of 2.
> set max-num-images count 2


From the Web-GUI

  1. Delete any unused Software images (Device>Software)
  2. Delete any unused Content images (Device>Dynamic Updates)

If none of the above remediation steps resolve the issue, it is recommended to collect the following Troubleshooting Data below and open a Support Case.
  1. Collect Tech Support File  (GUI: Device > Support  Click Generate Tech Support File)
  2. Collect the output of the CLI show system disk-space 


Additional Information
For Virtual Panorama Devices in Legacy mode see KB below on increasing Disk space

HIGH DISK UTILIZATION ON /OPT/PANCFG PARTITION ON VIRTUAL PANORAMA


Here are some other useful articles related to failing dynamic updates:
Dynamic Updates Display Error after Clicking on Check Now Button
Dynamic Update Fails with Image File Authentication Error Message
Unable to Perform Dynamic Updates with updates.paloaltonetworks.com FQDN Address Object
Dynamic Updates for AntiVirus Fail
Dynamic Updates for Applications and Threats will not Install
Cannot Schedule Dynamic Updates from Panorama for Firewalls
Dynamic Updates Error failed to get a response from the device server


Attachments
Actions
  • Print
  • Copy Link

    https://knowledgebase.paloaltonetworks.com/KCSArticleDetail?id=kA10g000000PLSJCA4&refURL=http%3A%2F%2Fknowledgebase.paloaltonetworks.com%2FKCSArticleDetail

Attachments