I want to understand which filesystem (FS) will be most suitable for the purpose of data archival. Following are the usage parameters and requirements the FS should be able to meet:
- Backup medium is portable magnetic hard disk drive (HDD). SDD is unlikely to be used ever.
- HDD capacity is currently 5TB. Future upto 24TB.
- The HDD is rarely connected (once ~3 months), all backup archives/files are written to the disk, then safely ejected. Data reads off HDD are even rare.
- Individual file size can sometimes reach up to 100Gb. Usual size is about 5Gb.
- A single FS partition is desirable. Having multiple partitions is avoided unless it assists in data preservation.
- FS must be fully supported on Linux. Open Source FS would be a plus.
- Support for windows and mac is not required, however, HDD might occasionally be connected to a Linux virtual machines running on windows or mac hosts.
- The FS will be on top of a LUKS container. Should behave well on LUKS.
- Should be least prone to data corruption at rest / bit rot / long term cold storage.
- Should have reasonable open source data recovery tools supporting the FS – to at least recover the most recently/accidentally deleted files.
- Should have seemless data integrity checks / resilience behind the scenes.
- Unexpected HDD disconnection or power failure during writing is likely never going to happen.
rsyncmight be occasionally used to write backup files from source.- slow read/write speeds are permissible.
