This ArchiverFS program can archive old files to most of the storage of the cloud which integrates with almost what many cloud storages are offering. It can move old files to any cloud storage that is able to be accessed by a UNC path. This includes all offerings from Amazon, Oracle, and others.
Steps to take
But on the ArchiverFS product page on their website, there are some steps that need to be taken when deciding to set up cloud archiving – consider these:
- How much data do you want move to?
- How fast is your internet connection?
- How large are the largest files that users might want to access again via links?
All three of these questions need to be answered as they are crucial to the performance of moving your old files to the cloud. First files need to be moved to the 2nd tier archive storage with the local internet connection and then users wanting to access those files will need to have recalled them over the internet. If you can move everything that has not been used in over 3 years to 2nd line storage, then usually as a guide it is recommended you allow for 75% of your total file system to be moved. Of course, the precise percentage will vary but you always can turn up or down the setting for as needed.
First, it is recommended that you calculate how long it will take to move 75% of your file system to cloud storage over the local internet connection. This is an easy calculation if you remember not to mix up Mb’s (Megabits) and MB’s (megabytes). File system sizes normally are calculated in MB’s and line speeds are normally calculated in Mb’s. You merely need to divide Mb’s by 8 for conversion to MB’s.
Then you should establish the size of the largest file that users might usually need to access and work out how long it takes a user to open that size of a file over the internet connection. You can also set limits to file sizes on files to be moved, which helps if there are a small number of files that are larger than the average.
If files are especially large, if the internet is not that fast or if it will take longer to move all files to cloud storage then it might be better using standalone storage on-site such as a NAS device.
Archiving over a VPN
When you have the cloud VM up and are running with a Windows operating system, you can then format your site-to-site VPN. Almost every one of the cloud providers will allow you to construct a ‘site-to-site VPN’amid your on-site infrastructure and cloud provision. This is a central VPN as it will allow connection between cloud service and internet infrastructure, as this is the way the files will be transferred or retrieved.
When figuring outbound connections for your VPN you will need to be sure that the server that ArchiverFS will run on is able to access it, as well as be sure that all your workstations also can access it. When any user at a workstation clicks on a link that is left behind by ArchiverFS all IO goes directly from that workstation to the 2nd line storage, it does not go by the ArchiverFS server.
After configuring the connections that are inbound, you must make certain that the cloud archive server is able to connect to on your network with at least 1 domain controller. The cloud server will have to act as a member of your domain specially to maintain permissions (assuming you do).
Now that you have your VPN set up and arranged any rules for firewalls, you need to be able to make sure that you can connect your cloud server as a member of your domain server. This is where you develop a testing share on your archive server to make certain that both the ArchiverFS server and all your users are set up to connect to the new testing share over the VPN.
Once all of this is done and you have arranged and tested cloud server and VPN you work with the Quick Setup Guide or User Guide to finish completing setup.
Archiving to Amazon Glacier
Amazon Glacier gives costs for GB storage that are so much cheaper than the others; they are as well nearly on par with a locally positioned NAS device (depending heavily on the exact device, service life). Amazon Glacier is really a great product but there is a problem. It is hard to fit in Amazon Glacier with services on-premise. At this time, you can only interact with it via the Amazon console or via the HTTP API. There is not any method to share Amazon storage to your network or to stand Amazon Glacier storage to a VM as a volume. But there are some methods to get around this.
Amazon Storage Gateway at http://awa.amazon.com/storagegateway/ allows the user to show Amazon storage volumes to the user’s local network as if they were hosted on local servers on-site. In addition, the users have set up policies that migrate old files from Amazon storage volumes to Glacier storage automatically.