Has anyone ever used a rsync based shared storage solution? I know that sounds weird but I’ll explain.
I am looking to setup Kubernetes but I am limited on network and storage speeds. I have considered ceph but it has a lot of overhead for what I am doing.
My though was I could setup a master storage system that could act as a sync point for storage on local nodes. My though was to use the kubernetes init containers to pull down the files from the master. After that I could have a periodic task that pushes changes to the master.
Effectively what I would be doing is creating a hub and spoke storage solution. The services I host don’t need shared storage between nodes and while it would be nice to have perfect reliability I don’t mind the potential for a little data loss or temporary breakage.
The biggest concern I have is that the databases some of my services use might get corrupted. Theoretically it can recove but that’s not a garentee. I will be taking snapshots on the master so that I can recover from a failure quickly.