2 years ago
Hi, I want to migrate weaviate data volume from gcp. Any resources?
28 Replies
2 years ago
hi @Martynas
2 years ago
I have you on deck from Slack on your migration
2 years ago
-
Get your schema
curl -X GET "https://your-source-instance/v1/schema"
-H "Content-Type: application/json" > schema.json
-
Start a backup
https://weaviate.io/developers/weaviate/configuration/backups
-
Restore a backup assuming your name and number of nodes between source and target are identical.
hi @angelo how would we store the backup file on a railway weaviate instance?
2 years ago
You would have the backup file on your machine and then use the API to send it to your target instance
2 years ago
Nodes are a generic concept in the eyes of Weaviate, so if you are running a non-HA instance, you can assume you are running 1
and as far as I can see we can't scale replicas on volume services on railway
we have a concern for migration, as we are scalling we might need replicas for weaviate
2 years ago
Yep- I will need some time to see how we can mirror this
2 years ago
(almost 2 AM my time, but I can get to this first thing)
2 years ago
!remind me to figure out replicated weaviate in 8 hours
we have a concern for migration, as we are scalling we might need replicas for weaviate
This is a bigger concern for us right now, I bet we can do migration anyway.
2 years ago
my gut feeling is that we can do multiple instances and set up a reverse proxy
2 years ago
but we would need to sync those instances
2 years ago
I am not sure, will need to test and read up on it
2 years ago
We just ask users to set up follower DBs
2 years ago
and then pool connections
2 years ago
we'd still need a way to tell weaviate to coordinate
If we end up with scalling issues, would railway in any way support us to scale weaviate?
2 years ago
Yes
2 years ago
We'd just give your instance generous limits