Latency Spike
injung
PROOP

2 months ago

We're seeing a severe latency spike in the Singapore region.

There have been no deployments, config changes, or traffic pattern changes on our side, but response times have increased by more than 10x compared to normal. p95/p99 latency is now spiking into multi-second / tens-of-seconds range.

Railway's status page still shows everything as normal, but this looks like an incident or host-level degradation to us.

Could the Railway team please investigate and resolve this as soon as possible?

2026-05-04_12.59.40.png

Attachments

Duplicate

12 Replies

injung
PROOP

2 months ago

THIS IS A MAJOR INCIDENT. We’re seeing severe latency spikes every 4 minutes, with no traffic changes on our side. This strongly looks like a host-level issue.


injung
PROOP

2 months ago

We tried scaling out replicas, but it did not help.

This exact repeated spike pattern has happened before (Railway incident).

Could someone from the Railway team please look into this urgently? This looks like host-level or platform-level degradation, and we are losing tons of money right now because of it.


injung
PROOP

2 months ago

2026-05-04_2.12.04.png

Attachments


2 months ago

Do you have performance logging in place to isolate exactly where the latency is originating from? Would be helpful for isolating the cause


injung
PROOP

2 months ago

At the moment, it looks DB-related from our side. The latency is showing up mostly inside ActiveRecord / PostgreSQL queries, including normally fast indexed lookups. We're not seeing any corresponding deployments, config changes, or traffic changes that would explain this.

Also, scaling out app replicas did not improve the issue, which makes us suspect the bottleneck is not in the Rails app layer itself, but somewhere around the database or underlying host/network path.

We're still investigating, but based on what we can see so far, the slowdown appears to be happening around DB access.


2 months ago

thanks for sharing, this is very useful information, regarding the PostgreSQL database - did you deploy the Railway provided one (Right Click -> Database -> PostgreSQL) or is this a custom one / template deployment?


injung
PROOP

2 months ago

I used the Railway provided Postgres


2 months ago

Thank you, I'm asking some more people about this 🙏


injung
PROOP

2 months ago

Thaks. I hope this can be resolved soon.


Anonymous
PRO

2 months ago

Same in europe, we didn't change anything, metrics are the same


iacopoinved
PRO

2 months ago

Same issue here, my services were not redeployed nor modified. Now a request that was taking 1-2 seconds before takes from 7 to 30+ seconds


2 months ago

with the additional reports, I'll escalate this to the team, thanks for flagging guys!


2 months ago

This thread has been escalated to the Railway team.

Status changed to Awaiting Railway Response dev 2 months ago


Railway
BOT

2 months ago

Status changed to Duplicate Railway 2 months ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...