ProxmoxBackupPoolDiskOutOfSpace #
Disk is almost full (< 10% left)
Alert Rule
alert: ProxmoxBackupPoolDiskOutOfSpace
annotations:
description: |-
Disk is almost full (< 10% left)
VALUE = {{ $value }}
runbook: https://srerun.github.io/prometheus-alerts/runbooks/pbs-exporter/proxmoxbackuppooldiskoutofspace/
summary: Proxmox datastore out of space (datastore {{ $labels.datastore }})
expr: pbs_used / pbs_size * 100 > 90
for: 2m
labels:
severity: warning
Here is a sample runbook for the Prometheus alert rule:
Meaning #
This alert is triggered when a Proxmox backup pool disk is almost out of space, with less than 10% of free space left. This can cause backups to fail, leading to potential data loss.
Impact #
The impact of this alert is not addressed, backups may fail, resulting in:
- Data loss due to failed backups
- Increased risk of data corruption
- Inability to restore data in case of a disaster
Diagnosis #
To diagnose the issue, follow these steps:
- Check the Proxmox backup pool disk usage using the
pbs_used
andpbs_size
metrics in Prometheus. - Verify that the disk is indeed running low on space.
- Check the backup pool configuration to ensure it is set up correctly.
Mitigation #
To mitigate the issue, follow these steps:
- Increase the size of the Proxmox backup pool disk.
- Remove unnecessary files or backups to free up space on the disk.
- Consider implementing a more efficient backup retention policy to minimize storage usage.
- Verify that backups are completing successfully and that data is being properly stored.
Additional Resources: