Haven’t used it yet, but I think git annex is built for this. Plan to do the same eventually. It lets you keep the index on hot storage.