Did it start happening today?

yes

first time around 4pm CET and 2nd time around 8pm CET

Do you see anything out of the ordinary (CPU or requests)? We've not seen any other reports in the same region.
Also, are you able to move to another region just in case?

Seem to be experiencing the same thing.

Multiple weeks of no issues sub 500ms average response times and now multi second responses times.

On EU West.

No abnormal metrics re ram, cpu, etc.

Restarted relevant services -> seems to be fixed for now (semi)

That's indeed odd, can y'all share your service URL that's getting affected? (the one that shows on your browser)

https://railway.com/project/aee72b99-ade1-4bd5-97b3-a391923eec04/service/d0f41034-db0f-43ad-b897-41cc4c98795c?environmentId=fc002695-6c6e-4890-bd9c-2577b2407b2c is this what you need? and yes indeed everything spiked. there seems to be many such cases happening today for other customers we'd be very happy that you could investigate this issue rapidly

!t

Hey team, may also be related https://discord.com/channels/713503345364697088/1442955960820957215 but in us east

for me it was pretty much everything here;
b1de9675-4644-4da5-b6b5-a45b8cbc4ed4

i had just done a mass restart last night and just woke up and things seem to be working just fine now

We recently switched to using bun as a runtime if this might help

I'm still seeing the network issues on my end. Is there an ETA for when this might be resolved?

We are also seeing huge network issues. Simple network requests like resolving a PubSub message or fetching something from Supabase is taking 10+ seconds to complete, we haven't made any kind of changes at all and these same actions took milliseconds the day before yesterday. We've been working non-stop on this for like 20 hours now and tried changing and optimizing every possible factor we can think of, but it just seems to boil down to extremely slow simple network operations, which causes massive cascading problems for us.

Things are so bad that we are going to try redeploying the whole service to Render just to see if it resolves it.

This is affecting thousands of users for us

as of about 50 minutes ago, these slowdowns seem to have drastically improved

@ThallesComH any news from your end?

Hey, sorry, not yet.

I did a ping on the team again and I'm waiting on their response.

Thanks your the best!

For everyone who is still experiencing network issues (@lemon, @Noé, @a): Please create your own thread. This will help us organize everything and provide a faster response, make sure to describe your issue in details and send your service URL (the one on the browser).

all network issues were resolved for us as of yesterday at around 4 PM UTC, through no change of ours. there absolutely was a serious network slowdown affecting us until then, which suddenly went away.

I'd appreciate a post mortem when you all figure it out, but I don't have any ongoing issues.

Would still be possible to create one? Then the team will be able to look deep into what caused your issue (even if already fixed). Mention that you don't have any issue and ping me if necessary!

@ThallesComH any news?