Database crashed and not starting up and I can't recover the volume
Anonymous
PROOP

3 months ago

I am not able to recover or start up my database service after it shows that its not having enough memory space on the device and I make changes on live size for th volume but its the same and I need to recover the production data.

I have tried shell and I can ssh into the container when I add sleep infinity as the start up command to keep the container running.

image.png

Attachments

$10 Bounty

27 Replies

Click on the volume mounted to your database, go to its settings, and increase the capacity.


Redeploy the database after.


Anonymous
PROOP

3 months ago

when you say increase the capacity what do you mean?


3 months ago

"volume size"

1772200437_wlZrMyg0SH.png

Attachments


Anonymous
PROOP

3 months ago

in the service i was attempting to restore and that is stuck and i am not able to resize the volume


Anonymous
PROOP

3 months ago

image.png

Attachments


Did you click on the volume?


Unless you're already at the max volume for your plan, there shouldn't be any restrictions.


Anonymous
PROOP

3 months ago

Yes I have clicked on the volume as you can see the attached shows 5GB and the logs still shows no space on the device

image.png

image.png


Is 5 GB the max you can get?


Also, did you redeploy the service?


Anonymous
PROOP

3 months ago

No I can get more but as you can see the volume seems to have enough space


3 months ago

Can you resize it and see if it changes anything?


Anonymous
PROOP

3 months ago

I have resize it to 10GB and is the same error


Anonymous
PROOP

3 months ago

Please what can i do to get the production data back


Status changed to Awaiting Railway Response uxuz 3 months ago


3 months ago

We've expanded the volume filesystem, and your database is back online.

Going forward, please keep an eye on disk usage and resize before hitting the volume limit.


Status changed to Awaiting User Response Railway 3 months ago


brody

We've expanded the volume filesystem, and your database is back online. Going forward, please keep an eye on disk usage and resize before hitting the volume limit.

Anonymous
PROOP

3 months ago

Thank you. I will keep an eye on the volume. But why was did volume increase didn't work please?


Status changed to Awaiting Railway Response Railway 3 months ago


Anonymous
PROOP

3 months ago

The service is back online but it does not seems to connect to the database still. I can see in the logs that its starting container and its getting stuck at that step


Anonymous
PROOP

3 months ago

Please can I have an update on this please


Anonymous
PROOP

3 months ago

Hello @Railway can I please have an update on this. This is production issue and I have been following on this since last week. I am keen to know if this is the priority support that its promised


3 months ago

The priority support is for platform issues, from what I can see, they fixed your primary issue within that time frame. Since your issue is now not platform related, there is nothing they can do to help you (except maybe some advice if they have time).

It says that the database is ready to accept connections, are you able to connect to it externally using something like data grip?


Anonymous
PROOP

3 months ago

Part of the logs show “ready to accept connections,” but the database it’s not able to connect in the same Railway. How is that not a platform issue?

You’re also overlooking the section of the logs that shows the container is still starting. If the container is in the process of starting up, how can the application successfully connect to it at that point?

Also, the fact that I can connect to the database externally doesn’t resolve the core problem. My application and the database are both running within Railway. The issue is that the database cannot connect internally within the same Railway environment, which is what actually matters for this setup.

So tell me how to differentiate between platform issue and other issues please


3 months ago

The issue is within postgres (not the platform) - they can't do anything to fix it.


3 months ago

the section of the logs that shows the container is starting

Railway logs arent the most reliable in terms of their order, if its said 'starting container' in a previous log then its probably an issue.


3 months ago

My postgres (re)starts with the exact same logs as what you've shown, so unless its silently errored, I would like to assume that its working. Is there a specific error that you are getting when trying to connect from your applications?


Anonymous
PROOP

3 months ago

I am not able to connect to the database because its will try and stop and since its not connecting I can't see the tables too. The app is not connecting too though so I had to spin another service to keep it afloat


3 months ago

Yeah but are you getting any specific errors? Like Failed to connect to [address]:5432?


Welcome!

Sign in to your Railway account to join the conversation.

Loading...