Unable to connect to MySQL after migrating the region (to Metal)
bluzzi
PROOP

10 months ago

Hello,

I migrated my MySQL database to another region (on Metal) and now I can't connect to the database at all (either via my backend service or via the “Data” tab of the MySQL service).

Solved

51 Replies

bluzzi
PROOP

10 months ago

9841789e-8487-4afa-ab8b-2e53a0fbb8f2


dev
MODERATOR

10 months ago

mind sending a screenshots of the top part of your service settings?


bluzzi
PROOP

10 months ago

1355651421432975600
1355651421755801900


dev
MODERATOR

10 months ago

thank you, and when was the last succesful deploy of your MySQL database?


bluzzi
PROOP

10 months ago

the deployments still work fine, but the connection is no longer possible. I tried to migrate today, so deployments older than 1 day were working


dev
MODERATOR

10 months ago

so does it work when you redeploy it on a GCP region?


bluzzi
PROOP

10 months ago

I will try


dev
MODERATOR

10 months ago

To me it looks like the redeploy is making the mysql server want to update, but it fails because it's trying to delete something it's not allowed to delete


bluzzi
PROOP

10 months ago

The migration to GCP has just finished, but the problem persists


bluzzi
PROOP

10 months ago

The logs seem to be the same

1355655976363233300


dev
MODERATOR

10 months ago

yea, that's what I thought


dev
MODERATOR

10 months ago

so it's not metal, it's just failing to update your mysql server


dev
MODERATOR

10 months ago

so the latest working deployment is a day old?


dev
MODERATOR

10 months ago

if I can have the timeframe then I can try tracking down the specific version


bluzzi
PROOP

10 months ago

Ok okay, so it's certainly related to the fact that the release points to mysql:8 Docker image and therefore a minor release has been incremented due to a new deployment?


dev
MODERATOR

10 months ago

well I'm not sure, that's just my theory


bluzzi
PROOP

10 months ago

From several months ago… 😅


dev
MODERATOR

10 months ago

how many months ago?


bluzzi
PROOP

10 months ago

1355657653443101000


bluzzi
PROOP

10 months ago

3 months


bluzzi
PROOP

10 months ago

Dec 27, 2024 2:14 AM


dev
MODERATOR

10 months ago

mysql 8 was on mysql 8.4.3 three months ago
mysql 8.4.4 released 2 months ago


dev
MODERATOR

10 months ago

from the logs, it does seem like it's starting an 8.4.4 server


dev
MODERATOR

10 months ago

Do you have a backup of the database?


dev
MODERATOR

10 months ago

cause we probably shouldn't mess with the versions without having a backup


bluzzi
PROOP

10 months ago

Do you know if the rollback button restarts a build? Or does it really use the previous build (and therefore the exact version that was there)

1355658271331193000


dev
MODERATOR

10 months ago

it redoes the build with the same configurations, but I'm not sure that'll help cause it'll still pull from mysql:8 which I think now routes to 8.4.4


bluzzi
PROOP

10 months ago

nop


dev
MODERATOR

10 months ago

and you're not on pro plan so you can't do one from railway's side huh..


dev
MODERATOR

10 months ago

this is quite the pickle


bluzzi
PROOP

10 months ago

and on this workspace I'm not a pro user, so I can't create a backup


dev
MODERATOR

10 months ago

there is one thing we could try, but it's kinda scuffed
you could go into your project settings, go to environments, enable PR environments with copy volume data enabled
that way it copies your database into a new service when you create a PR, then create a PR for your service
railway will then create a duplicate environment for you
then on your created PR environment you could try changing your database version to 8.4.3 and see if it works before doing it in the production environment


dev
MODERATOR

10 months ago

or if you don't care about the data in the database you could just try going mysql:8.4.3 directly and see what happens


bluzzi
PROOP

10 months ago

I'm willing to take the risk: if there's a 30%+ chance that a version change will break the data, then I could code a service to retrieve the content of the voume before the version change


dev
MODERATOR

10 months ago

I don't think there's a major risk of data loss here, but if the data is important then i don't think any amount of risk is worth it


bluzzi
PROOP

10 months ago

I'll test it with PR environments!


dev
MODERATOR

10 months ago

alright, def the safer approach


dev
MODERATOR

10 months ago

i'm gonna go eat the sushi I ordered and I'll be back in a bit, good luck! 🫡


bluzzi
PROOP

10 months ago

Thank you for your help and "bon appétit"🇫🇷!


dev
MODERATOR

10 months ago

🤣 thank you


bluzzi
PROOP

10 months ago

1355663742616211500


dev
MODERATOR

10 months ago

ah that is no bueno


dev
MODERATOR

10 months ago

seems it can't revert cause the upgrade already started


dev
MODERATOR

10 months ago

I'm out of ideas


bluzzi
PROOP

10 months ago

yes, I'll try other things by downloading the data of the volume!
thanks for your help and the hints you gave me! 💯


dev
MODERATOR

10 months ago

no problem, good luck with this
sorry that I wasn't able to offer more help


bluzzi
PROOP

10 months ago

It's already a lot!


dev
MODERATOR

10 months ago

$wa


dev
MODERATOR

10 months ago

$s


dev
MODERATOR

10 months ago

💀


dev
MODERATOR

10 months ago

!s


Status changed to Solved dev 10 months ago


Loading...