a month ago
Service "web" on the Hobby plan appears to have been frozen/suspended at the
host level twice today, with zero app involvement — no crash, no restart.
Incident windows (UTC):
-
~04:32 UTC — ~5 min
-
~15:57–16:35 UTC — ~38 min
Why I believe this is host-level, not my app:
-
ALL my in-process apscheduler jobs report being missed simultaneously:
"Run time of job ... was missed by 0:17:54"
"Run time of job ... was missed by 0:27:13"
The whole process was suspended, not one blocked call.
-
No error/traceback/restart/OOM in logs. The same process resumes and
just finds the wall clock jumped forward ~17–38 min.
-
Railway's own internal health checks (100.64.x HEAD /health) also stopped
getting responses during the window — unreachable from inside, not just
the public edge.
-
Metrics show NO resource pressure during the freeze:
- CPU flat ~0 vCPU
- Memory flat ~330 MB (no ceiling, no leak over 6h)
- Network egress burst on resume (all missed jobs firing at once)
Container was resident in memory but got zero CPU scheduling under no load of
my own. Looks like host-level suspend / node contention / migration.
Has anyone seen this on Hobby? Anything I can do, or is this infra-side?
Happy to share exact timestamps / project ID privately with a Railway staff
member.
5 Replies
a month ago
Hobby-tier services can be temporarily pre-empted during periods when Pro/Enterprise users require additional resources. This is documented behavior and can result in CPU scheduling being paused without an app-level crash or restart. Your logs confirm the freeze window you described. There is no configuration change that prevents this on the Hobby plan. Upgrading to Pro would give your workloads higher scheduling priority.
Status changed to Awaiting User Response Railway • about 1 month ago
Railway
Hobby-tier services can be temporarily pre-empted during periods when Pro/Enterprise users require additional resources. This is [documented behavior](https://docs.railway.com/deployments/reference#deployments-paused---limited-access) and can result in CPU scheduling being paused without an app-level crash or restart. Your logs confirm the freeze window you described. There is no configuration change that prevents this on the Hobby plan. Upgrading to Pro would give your workloads higher scheduling priority.
a month ago
"Thanks — that matches my evidence. Before I close: can a human confirm whether my node (project 4c3574c6...) actually saw contention during those two windows today, and whether twice-in-one-day after months of zero freezes is expected? I've been on Hobby for months with no prior occurrence. Monitoring for recurrence."
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
We don't have per-node contention telemetry we can share for specific time windows, so we can't confirm exactly what triggered the pre-emption on your service during those two windows. As for twice in one day after months of none, the docs describe this as rare for Hobby and there is no guaranteed frequency or SLA, so an occasional cluster of events is within the expected range even after a long quiet stretch. If the pattern persists or worsens, upgrading to Pro would remove the pre-emption exposure entirely.
Status changed to Awaiting User Response Railway • about 1 month ago
Railway
We don't have per-node contention telemetry we can share for specific time windows, so we can't confirm exactly what triggered the pre-emption on your service during those two windows. As for twice in one day after months of none, the [docs](https://docs.railway.com/deployments/reference#deployments-paused---limited-access) describe this as rare for Hobby and there is no guaranteed frequency or SLA, so an occasional cluster of events is within the expected range even after a long quiet stretch. If the pattern persists or worsens, upgrading to Pro would remove the pre-emption exposure entirely.
a month ago
This is the second automated reply. I'm explicitly asking to escalate to a human engineer who can confirm whether node X had a real fault vs. normal pre-emption during those windows
Status changed to Awaiting Railway Response Railway • about 1 month ago
a month ago
The specific distinction you're asking about, whether those freezes were a host fault vs. routine pre-emption, is not something we can determine for individual service windows. Your logs confirm the pattern you described (simultaneous missed jobs with no crash or restart), which is consistent with the documented Hobby-tier pre-emption, and that is the most specific determination we can provide for these events.
Status changed to Awaiting User Response Railway • about 1 month ago
Status changed to Solved ilan316 • about 1 month ago