Offline re: Temporary Performance Degradation Notice

Railway's own console: Your service's container is not running (status: exited). Deploy or restart your service, then try again.

It seems to have refused all connections for 30minutes now, dashboard claims it to be online but nothing can connect to it (incluidng the railway UI).

@Chandrika any chance of escalation?

Please do not ping team members.

Are there any error logs?

2026-06-10T15:19:34.831785Z 0 [System] [MY-015015] [Server] MySQL Server - start.

2026-06-10T15:19:34.948592Z 0 [Warning] [MY-015655] [Server] Server ignores the discovered container restrictions as --container_aware is OFF

2026-06-10T15:19:34.948618Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 9.7.0) starting as process 1

2026-06-10T15:19:34.948626Z 0 [System] [MY-015603] [Server] MySQL Server has access to 48 logical CPUs.

2026-06-10T15:19:34.948800Z 0 [System] [MY-015603] [Server] MySQL Server has access to 412550615040 bytes of physical memory.

2026-06-10T15:19:34.954949Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.

2026-06-10T15:19:35.150472Z 1 [Warning] [MY-012582] [InnoDB] io_setup() failed with EAGAIN. Will make 5 attempts before giving up.

2026-06-10T15:19:35.150529Z 1 [Warning] [MY-012583] [InnoDB] io_setup() attempt 1.

2026-06-10T15:19:35.650787Z 1 [Warning] [MY-012583] [InnoDB] io_setup() attempt 2.

2026-06-10T15:19:36.151062Z 1 [Warning] [MY-012583] [InnoDB] io_setup() attempt 3.

2026-06-10T15:19:36.651297Z 1 [Warning] [MY-012583] [InnoDB] io_setup() attempt 4.

2026-06-10T15:19:37.151565Z 1 [Warning] [MY-012583] [InnoDB] io_setup() attempt 5.

2026-06-10T15:19:37.651857Z 1 [ERROR] [MY-012584] [InnoDB] io_setup() failed with EAGAIN after 5 attempts.

even for infra issues spanning 40mins ?

Same issue with PostgreSQL. Deployment shows Online but dashboard can't connect and all app connections time out.

▎ Logs show:

▎ ERROR (catatonit:2): failed to exec pid1: No such file or directory

▎ repeating in a loop after volume mount.

I got back online by migrating to US East from EU West (but by god it's slow)

connections timing out -> railway official degradation notice -> deployment started crashing

45mins total now

not a peep from railway

time and time again issues with stateful deployments that are not publicly acknowledged

Try pressing Ctrl/Cmd + K and redeploy from source.

I assume redeployments didn’t get it back online?

crashloop

innodb failed to initialize

Ok that seems to fixed the issue so far. Thank you!

So unlikely related to the OP, which is unacknowledged issues with railway metal infra/stateful deployments in EUW