a year ago
Hi, I want to migrate weaviate data volume from gcp. Any resources?
28 Replies
a year ago
hi @Martynas
a year ago
I have you on deck from Slack on your migration
a year ago
Get your schema
curl -X GET "https://your-source-instance/v1/schema" \
-H "Content-Type: application/json" > schema.jsonStart a backup
https://weaviate.io/developers/weaviate/configuration/backupsRestore a backup assuming your name and number of nodes between source and target are identical.
hi @angelo how would we store the backup file on a railway weaviate instance?
a year ago
You would have the backup file on your machine and then use the API to send it to your target instance
a year ago
Nodes are a generic concept in the eyes of Weaviate, so if you are running a non-HA instance, you can assume you are running 1
and as far as I can see we can't scale replicas on volume services on railway
we have a concern for migration, as we are scalling we might need replicas for weaviate
a year ago
Yep- I will need some time to see how we can mirror this
a year ago
(almost 2 AM my time, but I can get to this first thing)
a year ago
!remind me to figure out replicated weaviate in 8 hours
we have a concern for migration, as we are scalling we might need replicas for weaviate
This is a bigger concern for us right now, I bet we can do migration anyway.
a year ago
my gut feeling is that we can do multiple instances and set up a reverse proxy
a year ago
but we would need to sync those instances
a year ago
I am not sure, will need to test and read up on it
a year ago
We just ask users to set up follower DBs
a year ago
and then pool connections
a year ago
we'd still need a way to tell weaviate to coordinate
If we end up with scalling issues, would railway in any way support us to scale weaviate?
a year ago
Yes
a year ago
We'd just give your instance generous limits