Builds Looping

2 months ago

First instance of this happening: af017671-6584-4afc-a01a-202d72c4b44e (deployment)

This build was taking longer than usual. Normally ~2 mins, was sitting at > 15 before it failed. Looking at the build logs, it seems to have built my image several times.

I have now pushed up another commit and it seems to be doing the same thing again.

Affecting several services that all deploy from the same code.

Solved

16 Replies

2 months ago

image.png

Attachments



patrickhuntington
PRO

2 months ago

I'm seeing the same issue. Looks like the build loops several times and fails after 10-15min. I built fine an hour ago with no issues, usually finishes in 2 minutes


kylekz
PRO

2 months ago

also seeing this


kylekz
PRO

2 months ago

bun install just reported a slow filesystem which i guess is the problem? log is 5 minutes behind too

116D4EFD-CCAB-471B-A734-7459854504D7.png

Attachments


2 months ago

Yeah I've seen some copies hang for ages


2 months ago

This thread has been escalated to the Railway team.

Status changed to Awaiting Railway Response uxuz 2 months ago


2 months ago

scheduling build on Metal builder "production-builderv3-us-east4-dq5f"
scheduling build on Metal builder "production-builderv3-us-east4-p9w9"
scheduling build on Metal builder "builder-gmncyt"

Doesn't seem to be a specific builder, so yeah I'd guess network or FS.


Status changed to Awaiting Railway Response Railway 2 months ago


isaiahbuilds
PRO

2 months ago

same here. multiple different builds all taking forever, seem to be building multiple times, but not ever finishing


kylekz
PRO

2 months ago

third times the charm surely

4DC97E2D-F5AA-4582-9FD3-22631215E393.png

Attachments


2 months ago

The irony of your name


2 months ago

Hey everyone, the team is investigating and an incident has been called. The incident can be followed at https://status.railway.com/incident/XLFH3W8Q.


chandrika
EMPLOYEE

2 months ago

Hi all, we've called on incident for this: https://railway.instatus.com/incidents/XLFH3W8Q

We're seeing degraded build performance affecting queue times and the image registry. I'll keep updating the incident as we make progress.


Status changed to Awaiting User Response Railway 2 months ago


shiho26miyano
PRO

2 months ago

working now


Status changed to Awaiting Railway Response Railway 2 months ago


samkotlove
PRO

2 months ago

Is there no way to redeploy a failed build?

image.png

Attachments


2 months ago

Please try CMD/CTRL + K > Deploy latest commit.


chandrika
EMPLOYEE

2 months ago

The incident has been resolved


Status changed to Awaiting User Response Railway 2 months ago


Status changed to Solved uxuz 2 months ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...