3 months ago
We are currently experiencing significant network latency issues, affecting both internal services and external connections.
The problem is most noticeable with Redis, where we are observing:
Increased connection latency
Slow responses on read/write operations
Intermittent delays that impact application performance
In addition, we are also seeing slowness on external network connections, which suggests the issue may not be limited to a single service.
These delays are impacting production workloads and message processing flows.
Could you please investigate whether there are any network constraints, routing issues, or infrastructure-related problems that could be causing this behavior?
Thank you for your support.
32 Replies
3 months ago
Do you have any logs that confirm this? Timestamps?
3 months ago
Any logs?
3 months ago
Is it stuck at any specific step in the logs?
3 months ago
I will escalate this to the team, if you can please paste your project id here (You can copy it from the Command Palette Cntrl + K -> Copy Project Id)
3 months ago
!t
3 months ago
This thread has been escalated to the Railway team.
Status changed to Awaiting Railway Response medim • 3 months ago
3 months ago
my service has to download a big file (48GB). it projects a 10 hours download time for it atm. was much quicker when i did my first test with it yesterday. something is bogging down the network
fredlllll
my service has to download a big file (48GB). it projects a 10 hours download time for it atm. was much quicker when i did my first test with it yesterday. something is bogging down the network
3 months ago
Open your own help thread please.
Just adding an update that my application is also down and my pgsql instance refuses to redeploy, no build or deploy logs, just like the user's screenshot above. I could deploy a new instance just fine. I also cannot access my db backups, which is a bit scary
project id b2c2cc4a-b910-4934-b4f7-97105dac491a for reference
3 months ago
Team is looking into it.
3 months ago
@Belkior could I get a link to the service?
Status changed to Awaiting User Response noahd • 3 months ago
3 months ago
^ +1. Been over an hour now
Status changed to Awaiting Railway Response Railway • 3 months ago
Status changed to Awaiting User Response Railway • 3 months ago
noahd
Could y'all provide links to your services?
3 months ago
I am not comfortable sharing in this public discord thread, can I create like a support ticket somehow?
Status changed to Awaiting Railway Response Railway • 3 months ago
sleechie
I am not comfortable sharing in this public discord thread, can I create like a support ticket somehow?
3 months ago
If you select a service and copy the link you're currently viewing in your browsers URL bar nobody but you or Railway employees can view that.
Status changed to Awaiting User Response Railway • 3 months ago
noahd
If you select a service and copy the link you're currently viewing in your browsers URL bar nobody but you or Railway employees can view that.
3 months ago
Status changed to Awaiting Railway Response Railway • 3 months ago
noahd
Could y'all provide links to your services?
3 months ago
https://railway.com/project/d34309af-b9a7-449a-9b5c-ba971e53f0fd/service/33952d6f-afb9-4ed9-89a5-e78a64988443?environmentId=8a117448-5fc3-4f5e-a71e-461384d58fd8
Original thread waiting to hear back from you and unable to access PRODUCTION: https://station.railway.com/support/urgent-typesense-service-down-1176b665
sleechie
https://railway.com/project/b2c2cc4a-b910-4934-b4f7-97105dac491a/service/7f35c89e-f98f-40d1-911a-6d4e9a608084/database?environmentId=577ff1fb-468a-48a8-8704-d2e087abb6fc
3 months ago
Looks like you just had a successful deploy. We're seeing recovery on the host internally but are continuing to monitor it. Can you take a peek and let me know how it looks?
Status changed to Awaiting User Response Railway • 3 months ago
noahd
Looks like you just had a successful deploy. We're seeing recovery on the host internally but are continuing to monitor it. Can you take a peek and let me know how it looks?
3 months ago
This is what I'm seeing. After this screenshot, I attempted to redeploy which is still stuck at build with zero build logs
Attachments
Status changed to Awaiting Railway Response Railway • 3 months ago
sleechie
This is what I'm seeing. After this screenshot, I attempted to redeploy which is still stuck at build with zero build logs
3 months ago
And also, if it wasn't clear, my production flask app is inaccessible which I assume is related to the db instance
sleechie
And also, if it wasn't clear, my production flask app is inaccessible which I assume is related to the db instance
3 months ago
OK, back online. Whatever you did, thank you!!!
3 months ago
Glad its online! And to all of y'all.
We had an issue with degraded performance of a single host. We sent out a notification in app and via email with a link to the service of yours which would be experiencing the issue.
Generally speaking things are all back online and show healthy!
Would like to apologize for this as it isn't the end user experience we want. We're working towards preventing it from ever occurring in the future!
Thank you all!
Status changed to Awaiting User Response Railway • 3 months ago
3 months ago
If you still have some issues, can you try a redeploy then let me know? Want to make sure all is well with everyone. Might be helpful if you're still having an issue to create a support thread and give me a link to it.
3 months ago
This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!
Status changed to Solved Railway • 3 months ago