Ongoing 499 Timeout Errors Across All Projects in US-WEST
tylerburr
PROOP

2 years ago

I mentioned this previously with the 499 error, but we're still encountering it across all of our projects. All of our projects are hosted in US-WEST. I initially thought it was just the core API endpoint, but overnight we experienced the same timeout error across everything.

Closed

25 Replies

tylerburr
PROOP

2 years ago

This issue has only started occurring recently and has never happened before.


2 years ago

project Id is very applicable here please


tylerburr
PROOP

2 years ago

1574cc15-2e31-4ab0-b5ee-ccca94ab4e7c


tylerburr
PROOP

2 years ago

f32c7086-f44b-4b6c-94b8-189b0c4e1555


tylerburr
PROOP

2 years ago

897abfe5-d734-41af-bc55-ee9941db3811


tylerburr
PROOP

2 years ago

I currently monitor these using Uptime Kuma and a NodePing server, and both report errors at the exact same time.


tylerburr
PROOP

2 years ago

1319023318267068466


2 years ago

can you tell me what those IDs are for exactly?


tylerburr
PROOP

2 years ago

They are the project IDs that NodePing and Uptime Kuma monitor.


2 years ago

okay thank you, will look into this when I'm back at my laptop


tylerburr
PROOP

2 years ago

Thanks! Let me know— I can move the projects to a different region to see if that resolves the issue. I'll wait until you let me know how you'd like to proceed.


2 years ago

for the first app, it looks like you are running into limitations with how you have your app configured, blocking code, not enough uvicorn workers, etc


tylerburr
PROOP

2 years ago

Ok I’ll look into that.


tylerburr
PROOP

2 years ago

Did you find anything else with the other projects?


tylerburr
PROOP

2 years ago

The only reason I'm asking is that I'm experiencing timeouts on all of them around the same time.


2 years ago

are they still happening right now?


tylerburr
PROOP

2 years ago

5:46pm was the last time


tylerburr
PROOP

2 years ago

MST


2 years ago

we haven't had any issues during that time, so it would have to be issues with your applications


tylerburr
PROOP

2 years ago

I’ll keep looking but all projects at the same time having the same issue?


tylerburr
PROOP

2 years ago

2:22am MST all projects reported timeouts again.


tylerburr
PROOP

2 years ago

2:24am MST got more alerts.


2 years ago

all green from our side on the monitors


tylerburr
PROOP

2 years ago

Hmm, alright. I'll continue investigating and run some additional tests. The code has been running smoothly for over a year, but this issue has only started occurring in the past month and a half.


2 years ago

sounds good, let me know what you find!


Welcome!

Sign in to your Railway account to join the conversation.

Loading...