a month ago
Project: grand-reverence (7a36cb67-38c8-4b93-9a4d-bdb5df18c35f)
Service: finance_platform, environment: qa (9d9e2879-bf23-4648-b4cd-466ee5512297)
Since ~05:46 UTC today, three consecutive CLI deployments of this service stall even though
their build logs show "image push" completed:
-
2a65e3c6-c232-4652-b741-5af6691e5333 — push complete 05:47:05Z (339MB, 5.9s), status stayed
BUILDING until we manually aborted.
-
7c2d881e-3f60-46b3-8177-f68320e01f2c — reached DEPLOYING after the abort, logged only
"Starting Container" at 05:59:44Z, then went silent; manually aborted.
-
ba935539-e2e9-4110-8031-a91cacb1038a — push complete 06:04:15Z, frozen at BUILDING since.
Deployments at 04:35Z and 05:16Z on the same service completed normally, and status.railway.com
shows no incident, so this looks like a stuck deploy state machine for this service. The live
deployment 169318eb-03bf-4065-b09c-b1c80fe7eacf must keep serving. Please unstick the pipeline
so ba935539 (or a fresh push) can roll out."
(Created with the help of your Railway Agent and Claude Code Fable. This is getting to the community because I am on a hobby plan)
11 Replies
a month ago
The deployment you reported as frozen at BUILDING is now showing as RUNNING, and subsequent deployments on this service have completed successfully. The stall across those three consecutive deploys appears to have been transient and has cleared.
a month ago
This thread has been marked as private. Any further activity in this thread will only be visible to you and Railway employees.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
The RUNNING deployment you found is a different project in this workspace: finance-platform-prod (a8c213a3-e84f-4dfa-b682-f8a46eb5a7d4), whose deploys are indeed healthy. This ticket is about finance-platform-qa (7a36cb67-38c8-4b93-9a4d-bdb5df18c35f), service finance_platform (d35091e2-5ba0-4eca-bfe5-040879e68438), environment qa (9d9e2879-bf23-4648-b4cd-466ee5512297). As of a few minutes ago the public API still reports deployment ba935539-e2e9-4110-8031-a91cacb1038a as status BUILDING (frozen for ~30+ minutes): its build log shows image push complete at 06:04:15Z, the deploy log shows a single Starting Container line at 06:04:24Z, and there has been no entrypoint output and no HTTP traffic since. No deployment on this qa service has completed since 05:16Z (169318eb, which is still the one serving). Please unstick ba935539 or this service's deploy state machine so a fresh push can roll out.
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
To correct our earlier message, we were indeed looking at the wrong project. Checking the correct qa environment now, the deployment you flagged as frozen has transitioned to RUNNING and two subsequent deployments on this service have completed successfully. The earlier two stuck deploys were cancelled as expected. The deploy pipeline for this service is flowing normally again, and fresh pushes should roll out without issue.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
The deployment is still stuck. It is in BUILDING state with last log message "Starting container" and it will remain in that state forever without moving to next stage.
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
Apologies for the repeated incorrect responses. We can confirm the issue on your qa service: the build completed and image push finished at 06:04 UTC, but the deploy workflow stalled after "Starting Container" and never reached your application entrypoint. Your previous deployment continues serving traffic normally. Try cancelling the stuck deployment from your dashboard and triggering a fresh deploy. If that does not clear it, please reply here.
Status changed to Awaiting User Response sam-a • about 1 month ago
a month ago
Hello Sam,
I completely removed the previous build in QA and tried to deploy a fresh build today. That build has failed to deploy int he same exact way.
This is happening only int he QA environment. The prod environment goes on smoothly.
Thank you for your help.
a month ago
This thread has been marked as private. Any further activity in this thread will only be visible to you and Railway employees.
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
Any updates please? I have been doing direct deploys to my prod but that is obviously not sustainable
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
This thread has been opened as a public bounty so the community can help solve it. The thread and any further activity are now visible to everyone.
Status changed to Open Railway • about 1 month ago
a month ago
Have you try Deploy Latest Commit? If it didn't work, Try deploy it as a new service
mayori
Have you try Deploy Latest Commit? If it didn't work, Try deploy it as a new service
a month ago
I have tried deleting the deployment and doign fresh deployments but nothing has worked so far. Last choice remaining is to delete the whole project and recreate it but I would rather not do that for obvious reasons
a month ago
The prod instance is identical in scope and size and that code works perfectly, including new deployments. Even deployments to prod where code is merged from qa work.
Only qa gets stuck after build with the last message being "starting container"
a month ago
This issue can be closed. The issue was a stuck Postgres session.
Claude Code found and fixed the issue/
Status changed to Solved mayori • about 1 month ago