24 days ago
Hello Railway Support,
Source-code updates are stuck in APPLYING, and no new deployment is created. Redeploying the previous build succeeds, but applying new function code remains stuck on both our existing research service and a newly created research service.
Increasing the research volume capacity did not resolve the issue.
Project ID:
a3bdd16f-e70e-4bf9-bcc2-8b00c754ca01
Environment ID:
4609c654-324d-4a8b-a114-bbdea8371572
Affected research services:
minute3-ten-days-stage-sl
e6886ea9-d2b4-44a1-ac1e-1c1b385ad6d7
bigbrain-research-independent
76da99da-6c57-4bd0-9027-6d6507c734b4
Stuck apply IDs:
4d21fbc5-8f78-4333-8c0b-6ad4d993835d
a1d4348c-2567-408d-bdc6-4065684df453
716482e3-f9a6-499f-a045-9d02527e46a1
Could you investigate and safely reset or cancel these stuck apply workflows so we can deploy the updated research code?
IMPORTANT: Please leave the live production trading service “bybitbot-v2” untouched. Do not restart, redeploy, or modify it.
Thank you.
1 Reply
Status changed to Awaiting Railway Response Railway • 24 days ago
24 days ago
The three applies are stuck because this environment's configuration is too large for the step that applies a change. Every apply carries the whole environment's config in one payload, and here that's close to a megabyte, almost all of it the PAIR_DATA_0 to PAIR_DATA_51 and PAIR_DATA_PARTS variables on stage-sl-paired-research (about 0.8 MB of values). That's over the size limit, so each apply fails a second after it starts and never reaches a deployment. Every change that needed an apply in this environment has been getting stuck the same way since October 24.
The fix is to move that dataset out of variables. That service already has a volume mounted and your research services already use S3-compatible storage, so either works. Deleting the PAIR_DATA variables doesn't go through the apply step, and it only redeploys stage-sl-paired-research. Once they're gone, re-apply the code updates for minute3-ten-days-stage-sl and bigbrain-research-independent and they'll go through.
The three stuck applies will clear themselves within a few hours and don't block new ones. We haven't changed anything in the project, and bybitbot-v2 isn't touched by any of this.
Status changed to Awaiting User Response Railway • 24 days ago
17 days ago
This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!
Status changed to Solved Railway • 17 days ago