2 months ago
My current minio service volume usage is around 80%. Could that be a reason for the failing redeployments?
also came across the change in stance of open-source by minio. I don't think that should be an issue as I am able to setup a new minio service
87 Replies
2 months ago
Please provide a link to the deployment that is failing
@Alisher can you allocate more volume storage? I am approaching near to 250GB already on this minio service
Also the serivce restart command gives a success feedback, but not able to see the reset in memory/cpu usage like it used to until a couple of days back
could it be like the running service is not able to stop to yield to the new containers? 🤔
I usually do a hourly restart of the minio bucket service to bring down the memory usage and thus my cost. but due to this issue, I am not able to bring down my memory usage and it is resulting into huge cost for me!
@angelo ?
Tagging online employees as this is resulting in unwanted cost for us!
2 months ago
You need the volume resized?
2 months ago
Above 250GB?
2 months ago
Hello!
We're acknowledging your issue and attaching a ticket to this thread.
We don't have an ETA for it, but, our engineering team will take a look and you will be updated as we update the ticket.
Please reply to this thread if you have any questions!
@angelo why are my two threads closed? I don't see the issues resolved right?
2 months ago
Please stop tagging team members - #🛂|readme #5
They were closed as they were duplicates.
2 months ago
Is your MinIO bucket currently offline?
Hey, I am not sure how to proceed here, even the threads are closed on the support platform
Hey @Brody can you please suggest how to proceed here - you have closed both the threads and nobody is replying to this discord thread too! I am totally blocked - Monday would result in peak traffic in production!
2 months ago
Please stop tagging team members.
2 months ago
Your MinIO is online from my understanding, so I don't believe the urgency is super high here.
2 months ago
https://railway.com/project/d8a9cdda-ca19-44a5-814f-1ecaff088212/volume/474bd174-3c34-4c41-bcc2-05323e718473/metrics?environmentId=35b2e7d0-c9aa-46dd-a20c-2d320f146eb6
volume which need to be extended
https://railway.com/project/d8a9cdda-ca19-44a5-814f-1ecaff088212/service/9d0d3525-a0aa-4f9b-9f49-be6bb3f4cef2/metrics?environmentId=82212507-616a-4d85-a946-87879ae84c13
service which has the redeployment issue
2 months ago
2 months ago
🛠️ The ticket Unable to deploy has been marked as in progress.
2 months ago
what does this mean? marking it as in-progress?
@Brody I tried two things
Tried to create a duplicate of the Bucket service with a new volume - it works
Tried to disconnect the existing Bucket service volume and attach it to the new Bucket Copy service - it gets stuck in the same deployment step
Creating containers
does this mean there is some issue with the volume? Can you please extend the limit of my volume?
2 months ago
Please stop pinging team members. Your MinIO service is online, and this thread is within its SLA.
2 months ago
We will extend the volume's space when we are able to come back to this thread.
2 months ago
Replying from the account associated with the plan - please prioritise this thread!
2 months ago
The volume has been resized to 500GB.
Thanks. Would I now be able to initiate redeployment of the service successfully?
2 months ago
I would recommend doing restarts instead of redeploys, since a caveat with volumes is that no two deployments can be online at the same time, so you would experience more downtime with redeploys than you would with instant restarts.
2 months ago
I generally do restarts every 1 hour to keep the memory usage in check. But redeploy when required
2 months ago
When is a redeploy required? A restart would restart Minio and then free the memory it used.
2 months ago
but restarts are also not happening right now. That is why I was trying redeploy
2 months ago
even now, restart is not working - I don't see the memory dropping
2 months ago
can you check?
like I mentioned earlier. I noticed that service deployments get stuck when I attach this particular volume to them.
2 months ago
what can be done here? This is costing me like atleast 5x of the actual requirement
2 months ago
are you still available? checking on this?
2 months ago
should I open another thread for this?
2 months ago
Please avoid creating duplicate threads.
2 months ago
understood, what should be my next step to resolve the service restarts?
2 months ago
bumping this up for reply
2 months ago
bumping this - as the cost is not under control!!
2 months ago
I just noticed the service was redeployed automatically (atleast I did not initiate it) and was successful, bringing the memory usage down.
2 months ago
was there any issue identified or action taken from the Railway team?
2 months ago
Should be fixed now
2 months ago
Thanks for the update. May I know the issue identified? Also, is there any way to waive of the extra cost incurred?
2 months ago
It was a state issue on our end. We have already fixed this issue going forward.
2 months ago
Would like to understand why was there a delay of 3days for the resolution? What is the support SLA for my account? Is this justified to charge me for your side of mistake?
2 months ago
Since there was no downtime reported, the SLA is 3 days from the last user response.
2 months ago
Just asking - could this have been resolved on the same day I opened thread if my thread had priority?
2 months ago
Yes, for enterprise users, the response time is 1 hour.
2 months ago
We would love to give all users the same level of support, but unfortunately, that is not feasible given the volume we operate at.
2 months ago
Thanks for responding.
Would it be possible to share the issue in brief? I am not sure how the cost incurred is justified for me!
Also, I would like to use Railway Storage Buckets (as they are s3 api compatible), but looking forward for the object-versioning feature as Grist service depends on that feature!
2 months ago
Meanwhile while Storage Buckets lack the object-versioning feature, how much can you extend my existing volume to?
2 months ago
I had shared a brief on the issue above; that would be all I am able to say at this time.
At the current spend, 500GB is the ceiling of what we can offer.
2 months ago
Any idea by when can I expect the object-versioning feature in Storage Buckets?
What should be the spend if I want to extend beyond 500GB?
2 months ago
With only 3 upvotes on that feature request post, we unfortunately would not be able to prioritize it anytime soon.
The spend that would come along with 80% use of a 500GB would likely be sufficient.
Status changed to Solved brody • 2 months ago
2 months ago
✅ The ticket Unable to deploy has been marked as completed.



