Railway Crash
charlesfr
PROOP

2 years ago

In my main project it looks my volume migrations has crashed and is preventing from any deployments being made in my account (see screenshot with applying progress bar)

In a new project (second screenshot) I try to recreate the services and deployment seems stuck with "This volume is undergoing a migration." message.

Can someone fix this?

Solved

52 Replies

charlesfr
PROOP

2 years ago

8d879f33-f85b-48af-9456-051141e48b4d


Naive question, how large is your storage on the volume?



This thread has been escalated to the Railway team.

Status changed to Awaiting Railway Response angelo-railway over 1 year ago


charlesfr
PROOP

2 years ago

single digit Gb


charlesfr
PROOP

2 years ago


That shouldn't cause any weirdness then.


That's unrelated, flagging.


charlesfr
PROOP

2 years ago

are you sure? All my builds are freezing (tried in both Hobby and Pro workspace)


I misunderstood, thought it was purely based on the migration.


How long has it been stuck in this state, 20 minutes?


charlesfr
PROOP

2 years ago

I'd say about an hour


Understood, escalating.


charlesfr
PROOP

2 years ago

thanks, this is the second project which is also still stuck - I suspect as a result of the migration in the first project

8d879f33-f85b-48af-9456-051141e48b4d

1260382456003956700


Flagged.


charlesfr
PROOP

2 years ago

If you're able to do any anything that resembles a "hard reset" on this project that'd be much appreciated so I get this back up asap


Can you try making a new service? We can then move the volume.


charlesfr
PROOP

2 years ago

on it


charlesfr
PROOP

2 years ago

actually the volume doesn't really matter (downloaded on launch) - it can be discarded

I just need to get services back up


2 years ago

Can you not recreate the service from a gh repo?


2 years ago

if the volume contents don’t matter, that should be the easiest solution


charlesfr
PROOP

2 years ago

no it bugs out here

1260385489312288828


2 years ago

Not in the same project, create a new project


Oof, team is working on this, what's weird is that this project is in a weird state but not seeing much other reports. Investigating.


2 years ago

Sorry this doesn't look stuck?


2 years ago

1260386304143786000


charlesfr
PROOP

2 years ago

correct, looks like the build went through!


charlesfr
PROOP

2 years ago

it seems as if the volume migration was culprit…


2 years ago

?


2 years ago

It looks fine


2 years ago

Where's the error


charlesfr
PROOP

2 years ago

There's two projects:

  1. Original project (still bugging out)

  2. Recreated project (now working)


2 years ago

Link original plz


charlesfr
PROOP

2 years ago

this one


That one shows that it's working.


charlesfr
PROOP

2 years ago

Not working: c5ad221b-8b00-4b24-b8c9-eac5b00a9054
Working: 8d879f33-f85b-48af-9456-051141e48b4d



2 years ago

I unstaged the change there for you. Can you try re-applying it?


charlesfr
PROOP

2 years ago

done


charlesfr
PROOP

2 years ago

if they don't go through feel free to discard them


2 years ago

I'm reseting this, please leave it for now. I'm going to dig into why it's not working


charlesfr
PROOP

2 years ago

let me know when project can be deleted


2 years ago

We're still working on this internally. Probably 24h from now or so


charlesfr
PROOP

2 years ago

ok np


charlesfr
PROOP

2 years ago

Hi team - same issue as above but on different project, volume migration is frozen… Can you please help?

https://railway.app/project/f1b5f347-c845-4e49-a7a2-c861816cffd6

Thanks!

1260652415477350400


Got eyes on, raising.


So this will take some time as of late because of load.


2 years ago

oh it just went through

extra context, im working with charles on the team this project is in.

the service has been in Singapore long before adding a volume, its strange that adding a volume would need any kind of migration


Yea, actions will go through, they are just taking very long.


2 years ago

what was most odd is that the ui told us that it was being migrated to us-west


Yep, that's likely an issue with out error messaging but most everything is tied to workflow bottlenecks that we are facing with our queues, builds, settings, and migrations.

We are still triaging.


charlesfr
PROOP

2 years ago

"@cooper" can I go ahead and delete this project? c5ad221b-8b00-4b24-b8c9-eac5b00a9054


2 years ago

Yup!


Railway
BOT

2 years ago

This thread has been marked as solved automatically due to a lack of recent activity. Please open a new thread if you require further assistance. Thank you!

Status changed to Solved Railway over 1 year ago


Loading...