So I have some space on my server rack, but not a lot of money lying around.
What I’m trying to achieve is a nas setup for my security camera system. It has 30 cameras, and 4 drives fill up in 3 months. 3X3TB drives.
Looking on eBay for a second hand rack mounted NaS is pretty expensive. Could I build one? From a jbod or something? I’ve got a nice big space in my rack doing nothing.
(I know I could buy bigger drives, but I kinda like the idea of experimenting with something g different) ✌️💛
Void Linux + mdadm in RAID5 + BTRFS with snapshots enabled. Trust me, you won’t regret it 😉. I have a working storage like this, but with 6 drives (scrap 2TB ones in RAID5) and BTRFS with zstd set at 10. Compression on MPEG2 content is… more than I ever hoped for to be honest, like 30, 40% compression. MPEG4, not as much, but you can shim about 5 to 10%.
Do not do this setup if your data is critical. btrfs raid 5 isn’t stable
MPEG2 is, by today’s standards, horribly inefficient, so that is to be expected. Transcoding, inthat case, will gain a lot more. But if your mp4 files still compress significantly with a standard lossless compression algorithm, something is wrong with your encoder settings. Even xz, which, even at the default Level 6 is often better than zstd at 19, will generally do less than 1%, typically 0.2%, even at level 9 (the highest).
To be honest, that percentage was after deduping everything, so it could be due to dups being deduped. The first one (the MPEG2 one) was before deduping, so that should be valid.
zstd can go up to 15 on BTRFS, not higher.