a month ago
Summary
Every deploy for two services in one project has failed since ~2026-08-29 10:00 UTC with a single terse build-log line and no further diagnostic detail: railpack prepare exited with an error. The last successful deploy for both services was 2026-08-28 19:16:24 UTC — nothing in either service's config changed between then and now. I isolated this to a platform-side regression, not our code: redeploying the exact commit that succeeded 15 hours earlier, through the identical path, fails identically.
Environment
- Project: bump-platform-server — ad744a78-dcb6-442a-b908-abf40241d5b4
-
- Environment: production — cd4e4abf-605b-43f1-b4ba-88ec43680c78
-
- Affected services (both builder=RAILPACK, root directory=/packages/platform-server in a pnpm monorepo):
-
- platform-server-prod — b1006cc0-269d-4726-8b5c-f2fb8821bd80
- platform-server — 79846b58-9968-4fda-b646-9abf2d7240fd
- Timeline (deployment id | service | status | UTC timestamp)
-
- 52d4eaa2-c05a-4604-9806-8521f98ed56d | platform-server-prod | SUCCESS | 2026-08-28 19:16:24
-
- 5917e33a-ec1f-4583-bddb-65bcfb00da64 | platform-server | SUCCESS | 2026-08-28 19:16:24
-
- fd51a9f8-5ca4-4522-9e37-d0bc019ae82f | platform-server-prod | FAILED | 2026-08-29 10:00:12
-
- eaad5f57-b698-4735-adc3-2fec07b35ac4 | platform-server-prod | FAILED | 2026-08-29 10:01:15
-
- 330b54ab-e138-42d2-b9fa-7d2cfed3f820 | platform-server-prod | FAILED | 2026-08-29 10:02:32
-
- e7e3b2ee-9d6c-467e-91ef-62ac94cb4fcd | platform-server | FAILED | 2026-08-29 10:04:21
-
- 62f290a5-4a99-442d-b903-59467f3a999f | platform-server | FAILED (known-good commit, see below) | 2026-08-29 10:05:42
-
- b5b440bf-915b-472b-9464-3cf09838d29d | platform-server | FAILED | 2026-08-29 10:07:08
-
- 68724bbf-e727-4488-ad98-600e8b7fee7a | platform-server | FAILED | 2026-08-29 10:07:44
-
- 1bb8f0c3-0fda-4a2b-a7bb-c29475c6a461 | platform-server-prod | FAILED | 2026-08-29 10:09:30
-
- cffca189-6967-4dd9-aab2-5953128d4169 | platform-server-prod | FAILED | 2026-08-29 10:27:51
-
- ed05951f-1355-44fb-8201-0e9443a8b2b6 | platform-server-prod | FAILED | 2026-08-29 11:05:52
Every failed attempt produced byte-identical build log output (only the snapshot hash/size and builder-node name differ).
Isolation testing performed
- CLI vs API upload path — reproduced via both
railway up --ciand the deploy API. Same failure both ways. - Builder node — deploys were scheduled on two different Metal builder nodes (builder-cnronl and builder-szkett observed in logs). Same failure on both.
- Service-specific config/cache — reproduced on two different services in the same project with identical config. Same failure on both.
- Our code — deployed the exact commit (9a7cf52) that produced the last successful build (2026-08-28 19:16:24 UTC), through the identical deploy path. It failed identically (deployment 62f290a5-4a99-442d-b903-59467f3a999f). I also bisected our new commit's diff (deploying various subsets of the changed files) — every variant failed the same way, including zero code changes at all. This rules out our code as the cause.
- Platform status — status.railway.com showed "Fully Operational" at the time, no incident listed (acknowledged that page only tracks broad/high-impact incidents). Separately, browsing Central Station's own "Newest Questions" right now, I see several other users reporting build/deploy failures in this same window (Aug 28 evening onward), including one titled "The status for the most recent incident say resolved, but my deployments are still failing" — which suggests this may not be isolated to our project.
Full build log (representative — every attempt above matches this)
scheduling build on Metal builder "builder-cnronl"
scheduling build on Metal builder "builder-cnronl"
fetched snapshot sha256:60e7903592dbebba5ce0deab64d8c49e9f285a51b677001fac45eef6ea47fbdf (585 kB bytes)
fetching snapshot
unpacking archive
using build driver railpack-v0.38.0
railpack prepare exited with an error
No further stdout/stderr is exposed — this is the complete log, confirmed via both the dashboard and railway logs --build --json.
Impact
Production is not down — both services are still serving their last successful build, verified live (/healthz returns healthy, application endpoints return 200). We simply cannot ship new deploys until this is resolved.
Ask
Since our own testing rules out our code, config, and a single bad builder node, we suspect a regression in railpack-v0.38.0's "prepare" step itself, or something in our project's cached build state on Railway's side. Could you:
- Surface the actual underlying error from railpack's prepare step (the platform-side log only shows the one-line wrapper above, no cause).
- Check whether anything changed in this project's build pipeline / cached build state between 2026-08-28 19:16 UTC and 2026-08-29 10:00 UTC.
Happy to provide any additional deployment IDs, account info, or run further tests on request.
1 Replies
a month ago
The build log surfaces only the wrapper message, but the deployment's own step record carries the underlying error: Root directory "/packages/platform-server" was not found in the deployed source. Every failed deployment in the list shows this same error at the BUILD_IMAGE step, and each fails in about 5 seconds, which is consistent with the prepare step finding no matching directory in the uploaded snapshot and exiting immediately. The uploaded snapshot across all attempts is 585 kB, which is notably small for a pnpm monorepo that should contain a packages/platform-server subtree. When deploying via railway up, verify you are running from the monorepo root (not from within a subdirectory), and check whether a .railwayignore or updated .gitignore is now excluding the packages/ directory from the upload.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!
Status changed to Solved Railway • about 1 month ago