Builds failing again us-east
Anonymous
PROOP

4 months ago

Builds taking three times as long and failing to push to registry.

ERROR: failed to build: failed to solve: failed to push production-us-east4-eqdc4a.railway-registry.com/23a0c0ed-ea98-40ea-b38d-fc55b47275c0:5683426b-f959-4162-be2b-60a83b7b0944: unknown: blob upload unknown to registry

Solved

15 Replies

Railway
BOT

4 months ago

Hey there! We've found the following might help you get unblocked faster:

If you find the answer from one of these, please let us know by solving the thread!


benanthony961
PRO

4 months ago

getting the same issue with same error. terrible timing frowning_face emoji


benanthony961
PRO

4 months ago

just got a successful build. 480 seconds


7fromheaven
PRO

4 months ago

ERROR: failed to build: failed to solve: failed to push production-us-east4-eqdc4a.railway-registry.com/: unknown: blob upload unknown to registry


7fromheaven

ERROR: failed to build: failed to solve: failed to push production-us-east4-eqdc4a.railway-registry.com/: unknown: blob upload unknown to registry

7fromheaven
PRO

4 months ago

Finally deployed after 14 minutes


Anonymous
PROOP

4 months ago

I am OP. Successfuly deploying now, as well.


I am OP. Successfuly deploying now, as well.

Hey Clayton and 7fromheaven, ack on the impact for build times. I however don't see a project id linked, can you provide one for me so that I can give that information to the engineering team for an investigation?


Status changed to Awaiting User Response Railway 4 months ago


sbdeals
PRO

4 months ago

Hi - i was running perfectly yesterday and am having the same issue. Over an hour and no logs after deploy. Us-east-4. My build is over an hour old and no logs, no deploys. Proj ID: 032da120-6679-4e48-b2b2-57a6f9d9e782


Status changed to Awaiting Railway Response Railway 4 months ago


sbdeals

Hi - i was running perfectly yesterday and am having the same issue. Over an hour and no logs after deploy. Us-east-4. My build is over an hour old and no logs, no deploys. Proj ID: 032da120-6679-4e48-b2b2-57a6f9d9e782

sbdeals
PRO

4 months ago

Here's another one. 032da120-6679-4e48-b2b2-57a6f9d9e782.


sbdeals
PRO

4 months ago

Okay - i have an update.

I had all my runners set to run on a cron Schedule. Logs showed only for the cron runs and I could NOT invoke cron runs early. I removed the cron for one of my runners, logs came back and the other runners crashed too.

Scary thing when its green deploy but no logs and no function


Railway
BOT

4 months ago

Hello!

We're acknowledging your issue and attaching a ticket to this thread.

We don't have an ETA for it, but, our engineering team will take a look and you will be updated as we update the ticket.

Please reply to this thread if you have any questions!


Ack, running an investigation into the reliability of the cron behavior. Sorry for the late reply, needed to add some instrumentation to see where the problem was. After we got a few more reports, we know it's on our side to fix. Will give you updates as we go along.


Status changed to Awaiting User Response Railway 4 months ago


Railway
BOT

4 months ago

This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!

Status changed to Solved Railway 4 months ago


4 months ago

Hello,

An update: We have made several changes to our CRON scheduling system, and from our internal metrics, we have seen this make a massive improvement in CRON execution delay and have eliminated missed CRONs. Additionally, the Run Now button starts the job much faster.

But please let us know if this isn't the case for you!

Best,
Brody


Status changed to Awaiting User Response Railway 4 months ago


Railway
BOT

4 months ago

🛠️ The ticket Scheduling Inaccuracy Issue has been marked as in progress.


Railway
BOT

3 months ago

✅ The ticket Scheduling Inaccuracy Issue has been marked as completed.


Railway
BOT

3 months ago

This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!

Status changed to Solved Railway 3 months ago


Loading...