randomly seeing i/o timeouts
delivey
PROOP

4 months ago

hey, recently started seeing i/o timeouts after further investigations seems like railway is not sending final ACK back to server for TCP connection initialization. It was fine for months and randomly started failing 15 minutes ago, what could cause this?

Locally it works fine still.

Solved

32 Replies

4 months ago

Can you provide more information here?


delivey
PROOP

4 months ago

yep, what do you need?


delivey
PROOP

4 months ago

seems like it resolved itself, can ignore for now


delivey
PROOP

4 months ago

still looking ito it


delivey
PROOP

4 months ago

newest issue shows same


erikskrt
PRO

4 months ago

@Brody we just had this issue and project id was dfca2de8-200c-4fbb-b74c-74a8a8ee1296

if you guys want to retroactively look into it later, ik you're having a lot of other service issues right now


4 months ago

is this resolved for you?


delivey
PROOP

4 months ago

yeah its resolved for us


delivey
PROOP

4 months ago

I work with him


4 months ago

was this a problem from railway->external or external->railway?


delivey
PROOP

4 months ago

railway->external


delivey
PROOP

4 months ago

based on my investigation it wasnt sending the final ack for the 3-way tcp connection


delivey
PROOP

4 months ago

i was able to send requests, etc fine to external from my local


4 months ago

which service was it?


delivey
PROOP

4 months ago

it wasnt a dns issue because from logs i saw it resolved the ip fine and even tried connecting directly to ip on our staging service


delivey
PROOP

4 months ago

can i dm you


delivey
PROOP

4 months ago

dont wanna share name here


delivey
PROOP

4 months ago

or can i copy service id somehow


4 months ago

if you could link it to me that'd be ideal



4 months ago

Do you know which service/domain/IP you were trying to reach?


delivey
PROOP

4 months ago

yep


delivey
PROOP

4 months ago

is there a more private way for us to share


delivey
PROOP

4 months ago

internal service domain


delivey
PROOP

4 months ago

can also check logs its obvious there


delivey
PROOP

4 months ago

17:45 utc issue resolved


delivey
PROOP

4 months ago

started around 16:45 utc


delivey
PROOP

4 months ago

1468308904290291842


delivey
PROOP

4 months ago

@Phineas is there an update on this? we want to figure out if its a railway issue, multiple users saying same points to it, but no official response from Railway


delivey
PROOP

4 months ago

kind of a big deal to have external requests failing for an hr


4 months ago

Hello, I've done some digging and all of the reports (including yours) were an issue between us and the OVH network specifically. From our perspective, it looks like they had a small network outage at that time.

1468641837542805658


4 months ago

also related: https://discord.com/channels/713503345364697088/1468302298626134248 and yeah that external API was using OVH.


Status changed to Solved brody 4 months ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...