2 months ago
Deploying convex with this https://railway.com/deploy/convex and i am running into issues with convex importing my backup. Its working but sometimes it uses way too much memory and hangs and errors and needs to be restarted. its not happening automatically, often when i restart it manually it works for a bit then. someone suggested to add a memory usage line to the docker image. but i don't how to change that after being deployed with that premade setup. first time seriously trying to use railway
3 Replies
im also seeing database timeout issues
Attachments
2 months ago
Your Convex backend is getting overwhelmed from your backup. Isn't there a way in Convex's options to chunk the backup? Alternatively, you could write a script that reads your entire data from Convex Cloud in chunks to your Railway's Convex deployment.
After that, it should be fine, as backups typically involve numerous read/write operations.
i will try to see how to do that. i unzipped the backup it made and for example my episodes table is 44GB apparently. in this jsonl format. you can import individual tables. maybe ill do that one after another and let it settle then.