Proxmox Backups – zstd and zpaq tested with astonishing results, 100% saving over multiple backups!

Standard

This post is in progress, and currently only shows the raw data I have collected this weekend on my Proxmox Backups, testing between zstd and zpaq. I will be doing a full write up over the next few days, so check back for that 🙂

Proxmox Static Backups - Space Saving
Original Backups
   605M Oct 10 11:38 vzdump-qemu-101-2021_10_10-11_37_35.vma.zst
   884M Oct 10 11:38 vzdump-qemu-102-2021_10_10-11_38_05.vma.zst
  3650M Oct 10 11:40 vzdump-qemu-104-2021_10_10-11_38_39.vma.zst
   393M Oct 10 11:41 vzdump-qemu-105-2021_10_10-11_40_32.vma.zst
  2493M Oct 10 15:35 vzdump-qemu-200-2021_10_10-15_34_05.vma.zst
 12500M Oct 10 15:42 vzdump-qemu-201-2021_10_10-15_35_59.vma.zst
  7164M Oct 10 15:46 vzdump-qemu-202-2021_10_10-15_42_01.vma.zst
   730M Oct 10 11:42 vzdump-qemu-203-2021_10_10-11_41_07.vma.zst
  2282M Oct 10 11:43 vzdump-qemu-204-2021_10_10-11_42_12.vma.zst
   681M Oct 10 11:44 vzdump-qemu-300-2021_10_10-11_43_48.vma.zst
  2215M Oct 10 11:46 vzdump-qemu-400-2021_10_10-11_44_51.vma.zst
   469M Oct 10 11:46 vzdump-qemu-999-2021_10_10-11_46_19.vma.zst
34,066M Total (All Files)

Backups archived and compressed with ZPAQ v7.15 (flags: -m5) 
Highest Compression Settings
  379M Oct 14 00:43 vzdump-qemu-101.zpaq
  639M Oct 14 04:31 vzdump-qemu-102.zpaq
 2997M Oct 13 17:11 vzdump-qemu-104.zpaq
  259M Oct 16 00:03 vzdump-qemu-105.zpaq
 1700M Oct 14 19:14 vzdump-qemu-200.zpaq
 9337M Oct 13 05:02 vzdump-qemu-201.zpaq
 5387M Oct 12 03:17 vzdump-qemu-202.zpaq
  496M Oct 13 23:41 vzdump-qemu-203.zpaq
 1546M Oct 15 02:22 vzdump-qemu-204.zpaq
  384M Oct 15 14:43 vzdump-qemu-300.zpaq
 1471M Oct 13 15:23 vzdump-qemu-400.zpaq
24,595M Total (All Files)

Compression Saving (without accounting for future deduplication savings)
9,471M compared to zstd compression.

---
Adding a second backup to each file, to test deduplication

Rough size of two total backups using zstd compression:
68,132M

   413M Oct 16 12:15 vzdump-qemu-101.zpaq
   680M Oct 16 12:18 vzdump-qemu-102.zpaq
  3113M Oct 16 12:24 vzdump-qemu-104.zpaq
   283M Oct 16 12:27 vzdump-qemu-105.zpaq
  1775M Oct 16 12:32 vzdump-qemu-200.zpaq
 12587M Oct 16 14:37 vzdump-qemu-201.zpaq
  7741M Oct 16 16:08 vzdump-qemu-202.zpaq
   537M Oct 16 16:14 vzdump-qemu-203.zpaq
  1619M Oct 16 16:21 vzdump-qemu-204.zpaq
   451M Oct 16 16:36 vzdump-qemu-300.zpaq
  1782M Oct 16 16:56 vzdump-qemu-400.zpaq
   313M Oct 16 17:16 vzdump-qemu-999.zpaq
   
Total size of 2 full backups of each VM with zpaq and deduplication:
30,981M
Saving over two zstd backups: 37,151M

Leave a Reply

Your email address will not be published. Required fields are marked *

Solve to post *