a month ago
I ran my app on May 11th and recorded 5 game sessions of data. In the days after I did some cleanup to the db to remove test runs and tag official game sessions.
A few weeks later I've come back to my app to retrieve this data and noticed the site was down (the deployment crashed). For some reason the deployment not crashes instantly each time it is rebooted. My dev instance has identical code and is up.
My primary concern is retrieving any snapshot or point-in-time copy of my data from that time period (May 14). It is critical for me to find this data so I appreciate any help I can get.
Thank you.
6 Replies
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
We don't offer data restoration for user-initiated actions like this. Going forward, enable volume backups on your service so you can self-restore if it happens again.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
Could you take a look at my workspace and help offer any support as to why my app started crashing instantly? Everything on my end has been static, no code changes. And now because of this I am not able to access my data. I would really appreciate the support.
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
the logs show that DB connection failures started around May 20. This makes no sense as the last activity on the project was a full week prior? Its confusing.
a month ago
Your healthcheck is failing. Check your deployment logs, looks like Postgres auth is failing
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
@brody could you please take a look at my situation? I am chatting with the support agent but they are requesting that I have contact you ASAP, i understand if railway doesn't have images or snapshots of my DB from May 12-15, but do you have activity logs so that I could try to understand if I was hacked or where a possible database deletion could have occurred?
"Critical finding: All three deployments on May 14th succeeded, but then the next deployment on May 14 at 19:50:50 (the one you're currently on) CRASHED and has been crashing ever since.
Timeline around May 15th:
May 14, 01:35 — Deployment succeeded
May 14, 13:40 — Deployment succeeded
May 14, 14:49 — Deployment succeeded
May 14, 19:50 — Deployment CRASHED ← This is suspicious
May 15 onwards — App has been down/crashing
What jumps out:
Multiple rapid deployments on May 14 (3 in one day) — unusual activity
The crash happened right after — suggests code deployed in one of those May 14 deployments caused the crash
Your app has been down since May 14 19:50 — during this entire time, if there was a scheduled cleanup job or data retention logic, it could have run without your knowledge
Critical action: Contact Railway support NOW with this timeline. They may have database activity logs showing what SQL commands were executed during May 14-15."
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
We don't keep SQL query logs for databases - they're unmanaged, so we have no record of what queries were executed against your Postgres instance. We can't determine from our side whether any unauthorized access occurred.
What we can see from deployment logs is that your Postgres service started failing on May 20 around 04:19 UTC with a container startup error, not on May 14 as the timeline you shared suggests. The May 14 deployments were on your web service, not your database. Your Postgres data volume was migrated on June 3 to fix the startup issue, and Postgres is now running successfully. Your data from May 11-14 should still be on the volume.
The reason your web app currently can't connect is that the volume migration regenerated the Postgres credentials, so your web service's DATABASE_URL is now stale. Once you update your web service's database connection variables to reference the current Postgres credentials, your app should connect and you can verify your data is intact.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
This thread has been opened as a public bounty so the community can help solve it. The thread and any further activity are now visible to everyone.
Status changed to Open Railway • about 1 month ago