a month ago
Hello, the linked volume is in an error state following Railway-initiated redeployment of the database service. Triggering another service deploy manually doesn't help, I believe a Railway team member will be needed here.
14 Replies
a month ago
Hello same problem for me
a month ago
same here..
Same for me. Why those Railway-initiated redeployments? Why do they fail?
a month ago
Same for me, redeploying has worked but not great to have it go down unexpectedly.
a month ago
Same for me. Volume was already migrated to new region (if that's the reason of this automatic trigger) but results in "Volume migration failed". I did a "retry deployment" and it went through succesfully.
Now I have a second volume trying to migrate with "Waiting to migrate to new region.", which is already in the Metal/europe new region, it's been more than 60minutes, for ~150MB, and still "waiting to migrate"
a month ago
I’ve also had two Postgres deployments fail.
Same for me, it also happened on a Qdrant instance (as for a postgres instance, and 2 different environment with a Postgres on each of them)
a month ago
Same for (some of) our deployments.
a month ago
I had the same issue, but clicking redeploy manually seems to resolve it.
same here.. is there some info about this somewhere? was this a scheduled thing that I wasn't aware of?
a month ago
!t
a month ago
This thread has been escalated to the Railway team.
Status changed to Awaiting Railway Response uxuz • about 1 month ago
also.. it's pretty weird to have the message
Volume migration failed.
There was an error migrating your volume to the new region.
when i wasn't aware that my volumes were being moved to a new region.. which region is it going to?
That's just a generic error message. They are likely using the same mechanisms for this as region to region moves.
Same for me. I got random database deployment which was failed and no logs. But the app works as expected.
Same issue. My case: In two of my projects, postgres and redis are affected. App works, but I can't reach the tables in Postgres/Data on the dashboard.
a month ago
I have the same issue with the volume migration failing.
My django app appears to be working. I am a little inexperienced with deployment, so just wondering if there is anything I need to do?
a month ago
Hello,
okarmazin, I have raised your migration failure to the team.
For everyone else, please provide direct links to the service that has a failed migration.
@Brody to each service? in all environments? basically for me, it's every service in every environment that has an attached volume
actually, one of them didn't fail.. so it's 5 services in total, should I link them all?
a month ago
yes please
a month ago
Here is my service that shows the migration failure:
https://railway.com/project/d0b593be-ac30-4b46-a419-678d4e83e1ba/service/418760e3-0327-48d3-a504-edee661cf994?environmentId=114250e8-bea3-4b33-b452-03d65ba9977f
https://railway.com/project/58cd7410-04d6-4c6e-a74d-fa7c78455231/service/ade6159a-a640-4f0d-b8b8-44dc80f7c770/data?environmentId=2d4912ad-d701-4872-994e-f32abb7f7b48
https://railway.com/project/58cd7410-04d6-4c6e-a74d-fa7c78455231/service/bbaa4d1d-0308-42f6-af70-fdb46f52f6b2/data?environmentId=2d4912ad-d701-4872-994e-f32abb7f7b48
https://railway.com/project/58cd7410-04d6-4c6e-a74d-fa7c78455231/service/e5de860e-c1a7-4322-90c9-3472876b77c2/data?environmentId=2d4912ad-d701-4872-994e-f32abb7f7b48
https://railway.com/project/58cd7410-04d6-4c6e-a74d-fa7c78455231/service/e5de860e-c1a7-4322-90c9-3472876b77c2?environmentId=7809a736-5e75-42e0-846f-b3b17dac958e
https://railway.com/project/58cd7410-04d6-4c6e-a74d-fa7c78455231/service/ade6159a-a640-4f0d-b8b8-44dc80f7c770/data?environmentId=7809a736-5e75-42e0-846f-b3b17dac958e
a month ago
https://railway.com/project/36300550-6af0-468b-b469-81b8474d7459/service/fc5ea55b-02a0-478c-af49-65a74c2a6527?environmentId=f9de6805-f9ac-4a2c-ba9e-ba412d217539
https://railway.com/project/36300550-6af0-468b-b469-81b8474d7459/service/6b71c6ce-3a50-4408-9aca-9c3e8a2a055e?environmentId=f9de6805-f9ac-4a2c-ba9e-ba412d217539
a month ago
https://railway.com/project/ad2fe3e4-05ab-4d67-a5da-87f5bb5bf1ee/service/932c4061-a767-45c1-b821-592845724010?environmentId=71e28411-a28b-4e00-9928-0d3e929d942c
https://railway.com/project/ad2fe3e4-05ab-4d67-a5da-87f5bb5bf1ee/service/47281ba9-d7ed-4d42-8ce7-4b1ffbf01501/data?environmentId=71e28411-a28b-4e00-9928-0d3e929d942c
a month ago
a month ago
This also happened to me - both of my services have now been redeployed in the last two days (one of them failed the first time) and are working fine, but now the observability graph shows double the data usage for each of the two volumes, which has triggered my monitors. Is it possible that the volumes are now being double-tracked?
a month ago
Hello, my services failed again this morning :
a month ago
Hey there everyone,
So update, there are a variety of reasons why this would report the way it does and it's hard to exfil that information publicly.
However, what I can say is that we are working on a fix where if a Railway initiated migration fails (move your stuff to Metal!) it will not show as a red failure on your project. If you need a 1 to 1 manual migration from the Railway team, I would make a private thread with the team and we can work with you there.
Status changed to Awaiting User Response Railway • about 1 month ago
a month ago
On my side, I already migrated everything to Metal 2 or 3 months ago.
However in the past few days, I got 4 or 5 automatic deployments from railway telling me my services were being migrated to metal. Either volumes (where migration failed but was already on metal) or services (reporting successful metal deployment but was already in metal prior).
yes, moved to metal months ago, but my postgres volume still has a volume migration failed sticker on it.. is it safe to redeploy the service and will that resolve the volume migration failed error?
a month ago
Status changed to Awaiting Railway Response Railway • about 1 month ago
Status changed to Awaiting User Response chandrika • about 1 month ago
adelelsawaf
https://railway.com/project/69b7bbfd-c33f-4ea5-99b8-412c134a04f7/service/26fa8933-edde-47ee-8048-9a4951a83a9e/settings?environmentId=fb618fa5-dc92-47ac-b52b-e585aaee0273same problem for this service
a month ago
Hi there, I've responded on your private thread with us — you should be all set now
a month ago
!s
Status changed to Solved brody • 27 days ago