Skip to content
Source-code updates are stuck
asadi753
OP

24 days ago

Hello Railway Support,

Source-code updates are stuck in APPLYING, and no new deployment is created. Redeploying the previous build succeeds, but applying new function code remains stuck on both our existing research service and a newly created research service.

Increasing the research volume capacity did not resolve the issue.

Project ID:

a3bdd16f-e70e-4bf9-bcc2-8b00c754ca01

Environment ID:

4609c654-324d-4a8b-a114-bbdea8371572

Affected research services:

minute3-ten-days-stage-sl

e6886ea9-d2b4-44a1-ac1e-1c1b385ad6d7

bigbrain-research-independent

76da99da-6c57-4bd0-9027-6d6507c734b4

Stuck apply IDs:

4d21fbc5-8f78-4333-8c0b-6ad4d993835d

a1d4348c-2567-408d-bdc6-4065684df453

716482e3-f9a6-499f-a045-9d02527e46a1

Could you investigate and safely reset or cancel these stuck apply workflows so we can deploy the updated research code?

IMPORTANT: Please leave the live production trading service “bybitbot-v2” untouched. Do not restart, redeploy, or modify it.

Thank you.

Solved

1 Reply

Status changed to Awaiting Railway Response Railway • 24 days ago


dizzydes90
EMPLOYEE

24 days ago

The three applies are stuck because this environment's configuration is too large for the step that applies a change. Every apply carries the whole environment's config in one payload, and here that's close to a megabyte, almost all of it the PAIR_DATA_0 to PAIR_DATA_51 and PAIR_DATA_PARTS variables on stage-sl-paired-research (about 0.8 MB of values). That's over the size limit, so each apply fails a second after it starts and never reaches a deployment. Every change that needed an apply in this environment has been getting stuck the same way since October 24.

The fix is to move that dataset out of variables. That service already has a volume mounted and your research services already use S3-compatible storage, so either works. Deleting the PAIR_DATA variables doesn't go through the apply step, and it only redeploys stage-sl-paired-research. Once they're gone, re-apply the code updates for minute3-ten-days-stage-sl and bigbrain-research-independent and they'll go through.

The three stuck applies will clear themselves within a few hours and don't block new ones. We haven't changed anything in the project, and bybitbot-v2 isn't touched by any of this.


Status changed to Awaiting User Response Railway • 24 days ago


Railway
BOT

17 days ago

This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!

Status changed to Solved Railway • 17 days ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...