Looking for an archiving software
Posted by Particular-Way8801@reddit | sysadmin | View on Reddit | 9 comments
Hello, I am looking for a software for a particular set of users.
The do work designs (so heavy files, from a few GB to 100's) and at the end of the year, the final design should be properly archived to a location and supposedly immutable.
today this is done via a series of actions and scripts, as in copy from computer to remote location A, that copy on itself on a separate folder where users only have read access, once a file is copied, it can only be touched by admins (let's say when users see that said version of the file is the wrong one or corrupted and users want to upload a new one.
The current process is not acceptable anymore (too many steps, too many file corruption, not enough reporting) and I do not want to spend hours looking for lost file from 5 years ago.
I am looking for a software that would
1 - copy from the computer to the remote location and verify hash,
2 - in case of similar file, it should create revisions (or leave the last one and older one being moved to a subfolder) all while retaining the original time stamp
3 - properly report what was done so that we can easily track modifications or issues.
It can be a paid software (even better in case of issues, needing support), if you have any ideas
Low-You-5098@reddit
like this one ?
unauthorizeddinosaur@reddit
https://bvckup2.com/features
$149 for 1 server but it will do what you want. Once it’s set up, it’s very hands-off and generally just works without needing much ongoing attention.
MeetJoan@reddit
What's the storage target - on-prem NAS, cloud, or tape? That determines whether something like Archiware P5 or a simpler hash-verified copy tool makes more sense for your use case.
Particular-Way8801@reddit (OP)
NAS,
Cloud might be a future solution
Archiware seems interesting, overkill, but might be usuable, depeding on how much it cost, thanks for you help
TheFluffiestRedditor@reddit
Archivematica might be an option, if cost is a big constraint. Open source and no cost.
https://www.archivematica.org/en/
vogelke@reddit
Do you have any say in or control over the remote system? If so, maybe your archive system should be completely separate: you need something with a decent filesystem (ZFS or Btrfs) so the file-corruption problem goes away.
MeetJoan@reddit
What's the storage target - on-prem NAS, cloud, or hybrid? That changes the answer quite a bit, since tools like Archiware P5 handle large design file archiving well on-prem, while cloud targets open up different options with native immutability built in.
Outrageous-House6371@reddit
What you’re describing sounds less like a basic file copy tool and more like an enterprise document management or data archiving system with version control and audit trails. I’d look into solutions in the “digital asset management” or “records management” space rather than scripts or simple sync tools.
The hash verification plus immutable history requirement is usually where proper systems like that really start to matter, especially if you’re trying to avoid exactly the kind of silent corruption and missing file headaches you’re dealing with now.
Particular-Way8801@reddit (OP)
The DAM is a bit overkill in our situation (as in, I do not need to be able to visualize files directly) like people only look at them like a handfull of time per year normally
I do agree that the scripts/sync tool is too limited and too troublesome since this is a user facing solution.
But since it is only for 4/5 users, I would like to find an in-between solution