23 days ago
Hello Railway team,
We need your assistance recovering our production PostgreSQL service.
Our production database for kit-fin.com is currently offline.
This is our only up-to-date production database. We cannot afford any data loss.
The PostgreSQL service stopped after the storage volume became full ("No space left on device"), and it is no longer accepting connections.
Our goal is to recover the existing PostgreSQL volume without data loss.
We are NOT asking to recreate the database or restore an old backup.
If possible, please help us recover the existing PostgreSQL service using the safest non-destructive method available while preserving all current production data.
Please DO NOT:
- reset the database;
- recreate the PostgreSQL service;
- reinitialize the volume;
- restore any snapshot or backup;
unless we explicitly receive and approve a recovery plan first.
Once PostgreSQL is running again, we will immediately remove the large video data that contributed to the storage issue, create a fresh backup, and migrate file storage outside PostgreSQL to prevent this from happening again.
If you need logs, project details, or any additional information, we will provide them immediately.
Thank you very much for your assistance.
3 Replies
Status changed to Awaiting Railway Response Railway • 23 days ago
23 days ago
Your data is intact. The volume attached to the Postgres service is holding 479 MB of its 500 MB capacity, and Postgres stopped because it ran out of room to write, not because anything was lost or corrupted.
Your workspace is on the free trial, which caps volumes at 500 MB. The volume is already at that ceiling, so it cannot be expanded while the trial is active. Activating a paid plan raises the cap to 5 GB on Hobby. After that, open the volume's settings, increase its size, and redeploy the Postgres service. It will come back up with the existing data in place.
Nothing in that path deletes or recreates the volume.
Status changed to Awaiting User Response Railway • 23 days ago
22 days ago
Hi Brody,
Thank you.
I have upgraded my workspace to the Hobby plan.
However, I cannot find the existing Postgres service or the volume settings anywhere in the current Railway UI. I only see my application service with DATABASE_URL configured.
Could you please tell me exactly where to find the existing volume's settings, or send me a direct link to that Postgres resource?
Thank you!
Status changed to Awaiting Railway Response Railway • 22 days ago
22 days ago
Your Postgres service is in a separate project called brave-connection, not the same project as your app. Here is a direct link: brave-connection project. Since the volume was at 100% capacity, once you resize you should restart the service. Once Postgres is back up, you can clean out the video data as planned and resize further if needed (Hobby supports up to 5 GB).
Status changed to Awaiting User Response Railway • 22 days ago
Status changed to Solved mykal • 22 days ago