Unable to connect to MySQL after migrating the region (to Metal)

2 years ago

Hello,

I migrated my MySQL database to another region (on Metal) and now I can't connect to the database at all (either via my backend service or via the “Data” tab of the MySQL service).

Solved

51 Replies

2 years ago

9841789e-8487-4afa-ab8b-2e53a0fbb8f2


2 years ago

mind sending a screenshots of the top part of your service settings?


2 years ago

1355651421432975530

1355651421755801760


2 years ago

thank you, and when was the last succesful deploy of your MySQL database?


2 years ago

the deployments still work fine, but the connection is no longer possible. I tried to migrate today, so deployments older than 1 day were working


2 years ago

so does it work when you redeploy it on a GCP region?


2 years ago

I will try


2 years ago

To me it looks like the redeploy is making the mysql server want to update, but it fails because it's trying to delete something it's not allowed to delete


2 years ago

The migration to GCP has just finished, but the problem persists


2 years ago

The logs seem to be the same

1355655976363233390


2 years ago

yea, that's what I thought


2 years ago

so it's not metal, it's just failing to update your mysql server


2 years ago

so the latest working deployment is a day old?


2 years ago

if I can have the timeframe then I can try tracking down the specific version


2 years ago

Ok okay, so it's certainly related to the fact that the release points to mysql:8 Docker image and therefore a minor release has been incremented due to a new deployment?


2 years ago

well I'm not sure, that's just my theory


2 years ago

From several months ago... 😅


2 years ago

how many months ago?


2 years ago

1355657653443100823


2 years ago

3 months


2 years ago

Dec 27, 2024 2:14 AM


2 years ago

mysql 8 was on mysql 8.4.3 three months ago

mysql 8.4.4 released 2 months ago


2 years ago

from the logs, it does seem like it's starting an 8.4.4 server


2 years ago

Do you have a backup of the database?


2 years ago

cause we probably shouldn't mess with the versions without having a backup


2 years ago

Do you know if the rollback button restarts a build? Or does it really use the previous build (and therefore the exact version that was there)

1355658271331192985


2 years ago

it redoes the build with the same configurations, but I'm not sure that'll help cause it'll still pull from mysql:8 which I think now routes to 8.4.4


2 years ago

nop


2 years ago

and you're not on pro plan so you can't do one from railway's side huh..


2 years ago

this is quite the pickle


2 years ago

and on this workspace I'm not a pro user, so I can't create a backup


2 years ago

there is one thing we could try, but it's kinda scuffed

you could go into your project settings, go to environments, enable PR environments with copy volume data enabled

that way it copies your database into a new service when you create a PR, then create a PR for your service

railway will then create a duplicate environment for you

then on your created PR environment you could try changing your database version to 8.4.3 and see if it works before doing it in the production environment


2 years ago

or if you don't care about the data in the database you could just try going mysql:8.4.3 directly and see what happens


2 years ago

I'm willing to take the risk: if there's a 30%+ chance that a version change will break the data, then I could code a service to retrieve the content of the voume before the version change


2 years ago

I don't think there's a major risk of data loss here, but if the data is important then i don't think any amount of risk is worth it


2 years ago

I'll test it with PR environments!


2 years ago

alright, def the safer approach


2 years ago

i'm gonna go eat the sushi I ordered and I'll be back in a bit, good luck! 🫡


2 years ago

Thank you for your help and "bon appétit"🇫🇷!


2 years ago

🤣 thank you


2 years ago

1355663742616211558


2 years ago

ah that is no bueno


2 years ago

seems it can't revert cause the upgrade already started


2 years ago

I'm out of ideas


2 years ago

yes, I'll try other things by downloading the data of the volume!

thanks for your help and the hints you gave me! 💯


2 years ago

no problem, good luck with this

sorry that I wasn't able to offer more help


2 years ago

It's already a lot!


2 years ago

$wa


2 years ago

$s


2 years ago

💀


2 years ago

!s


Status changed to Solved dev • over 1 year ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...