20 days ago
Hi folks,
On 1 May 2026 (UTC), the two Postgres services in my project faithful-clarity (Postgres and Postgres-Y) both ended up empty within a 24-hour window. The application service staffwise-hr had been serving real production data prior to this. I need help understanding what happened so I can prevent recurrence before going live with paying customers.
Specifically, can you tell me:
- Were any destructive operations logged against either Postgres service on 30 April or 1 May 2026? Specifically:
DROP TABLE,DROP DATABASE,TRUNCATE, schema resets, or wholesale service deletion-and-recreation events. - Was either Postgres service deleted and recreated during this window? If so, when, and by which user/token in my workspace.
- Were there any
prisma migrate resetorprisma db push --accept-data-lossoperations issued against either DB? These would have come from thestaffwise-hrdeployment context or from external connections. - Did the
DATABASE_URLenvironment variable on thestaffwise-hrservice change during this window? If so, when, what was it changed from, and what was it changed to. - Are there any automatic snapshots or backups available for either Postgres service from before 30 April 2026? My understanding is that automatic backups were not enabled, but I want to confirm whether any system-level snapshot exists I could potentially restore from.
- What's your retention policy for query logs and audit logs on the plan I'm currently on, and how do I enable better retention going forward?
- Recommended best practices for preventing this scenario — staging environments, read-only roles, backup schedules, etc. I'd appreciate any specific Railway features that would have prevented or mitigated what happened.
Project: faithful-clarity Services involved: staffwise-hr, Postgres, Postgres-Y (the latter may now be named differently) Approximate window of concern: 30 April 2026 18:00 UTC to 1 May 2026 18:00 UTC
I'm a paying customer building a SaaS product on Railway and need to understand this before we onboard real customers. Any forensic detail you can share would be hugely appreciated.
Thanks,
Stephen Vickers
Viatec Business Solutions
0 Replies
20 days ago
This thread has been marked as public for community involvement, as it does not contain any sensitive or personal information. Any further activity in this thread will be visible to everyone.
Status changed to Open Railway • 20 days ago
Status changed to Solved svickerscbs • 20 days ago