a month ago
My current minio service volume usage is around 80%. Could that be a reason for the failing redeployments?
also came across the change in stance of open-source by minio. I don't think that should be an issue as I am able to setup a new minio service
87 Replies
a month ago
Please provide a link to the deployment that is failing
@Alisher can you allocate more volume storage? I am approaching near to 250GB already on this minio service
Also the serivce restart command gives a success feedback, but not able to see the reset in memory/cpu usage like it used to until a couple of days back
could it be like the running service is not able to stop to yield to the new containers? 🤔
I usually do a hourly restart of the minio bucket service to bring down the memory usage and thus my cost. but due to this issue, I am not able to bring down my memory usage and it is resulting into huge cost for me!
@angelo ?
Tagging online employees as this is resulting in unwanted cost for us!
a month ago
You need the volume resized?
a month ago
Above 250GB?
a month ago
Hello!
We're acknowledging your issue and attaching a ticket to this thread.
We don't have an ETA for it, but, our engineering team will take a look and you will be updated as we update the ticket.
Please reply to this thread if you have any questions!
@angelo why are my two threads closed? I don't see the issues resolved right?
a month ago
Please stop tagging team members - #🛂|readme #5
They were closed as they were duplicates.
a month ago
Is your MinIO bucket currently offline?
Hey, I am not sure how to proceed here, even the threads are closed on the support platform
Hey @Brody can you please suggest how to proceed here - you have closed both the threads and nobody is replying to this discord thread too! I am totally blocked - Monday would result in peak traffic in production!
a month ago
Please stop tagging team members.
a month ago
Your MinIO is online from my understanding, so I don't believe the urgency is super high here.
a month ago
https://railway.com/project/d8a9cdda-ca19-44a5-814f-1ecaff088212/volume/474bd174-3c34-4c41-bcc2-05323e718473/metrics?environmentId=35b2e7d0-c9aa-46dd-a20c-2d320f146eb6
volume which need to be extended
https://railway.com/project/d8a9cdda-ca19-44a5-814f-1ecaff088212/service/9d0d3525-a0aa-4f9b-9f49-be6bb3f4cef2/metrics?environmentId=82212507-616a-4d85-a946-87879ae84c13
service which has the redeployment issue
a month ago
a month ago
🛠️ The ticket Unable to deploy has been marked as in progress.
a month ago
what does this mean? marking it as in-progress?
@Brody I tried two things
Tried to create a duplicate of the Bucket service with a new volume - it works
Tried to disconnect the existing Bucket service volume and attach it to the new Bucket Copy service - it gets stuck in the same deployment step
Creating containers
does this mean there is some issue with the volume? Can you please extend the limit of my volume?
a month ago
Please stop pinging team members. Your MinIO service is online, and this thread is within its SLA.
a month ago
We will extend the volume's space when we are able to come back to this thread.
a month ago
Replying from the account associated with the plan - please prioritise this thread!
a month ago
The volume has been resized to 500GB.
Thanks. Would I now be able to initiate redeployment of the service successfully?
a month ago
I would recommend doing restarts instead of redeploys, since a caveat with volumes is that no two deployments can be online at the same time, so you would experience more downtime with redeploys than you would with instant restarts.
a month ago
I generally do restarts every 1 hour to keep the memory usage in check. But redeploy when required
a month ago
When is a redeploy required? A restart would restart Minio and then free the memory it used.
a month ago
but restarts are also not happening right now. That is why I was trying redeploy
a month ago
even now, restart is not working - I don't see the memory dropping
a month ago
can you check?
like I mentioned earlier. I noticed that service deployments get stuck when I attach this particular volume to them.
a month ago
what can be done here? This is costing me like atleast 5x of the actual requirement
a month ago
are you still available? checking on this?
a month ago
should I open another thread for this?
a month ago
Please avoid creating duplicate threads.
a month ago
understood, what should be my next step to resolve the service restarts?
25 days ago
bumping this up for reply
25 days ago
bumping this - as the cost is not under control!!
25 days ago
I just noticed the service was redeployed automatically (atleast I did not initiate it) and was successful, bringing the memory usage down.
25 days ago
was there any issue identified or action taken from the Railway team?
25 days ago
Should be fixed now
25 days ago
Thanks for the update. May I know the issue identified? Also, is there any way to waive of the extra cost incurred?
25 days ago
It was a state issue on our end. We have already fixed this issue going forward.
25 days ago
Would like to understand why was there a delay of 3days for the resolution? What is the support SLA for my account? Is this justified to charge me for your side of mistake?
25 days ago
Since there was no downtime reported, the SLA is 3 days from the last user response.
25 days ago
Just asking - could this have been resolved on the same day I opened thread if my thread had priority?
25 days ago
Yes, for enterprise users, the response time is 1 hour.
25 days ago
We would love to give all users the same level of support, but unfortunately, that is not feasible given the volume we operate at.
25 days ago
Thanks for responding.
Would it be possible to share the issue in brief? I am not sure how the cost incurred is justified for me!
Also, I would like to use Railway Storage Buckets (as they are s3 api compatible), but looking forward for the object-versioning feature as Grist service depends on that feature!
25 days ago
Meanwhile while Storage Buckets lack the object-versioning feature, how much can you extend my existing volume to?
25 days ago
I had shared a brief on the issue above; that would be all I am able to say at this time.
At the current spend, 500GB is the ceiling of what we can offer.
25 days ago
Any idea by when can I expect the object-versioning feature in Storage Buckets?
What should be the spend if I want to extend beyond 500GB?
25 days ago
With only 3 upvotes on that feature request post, we unfortunately would not be able to prioritize it anytime soon.
The spend that would come along with 80% use of a 500GB would likely be sufficient.
Status changed to Solved brody • 25 days ago
23 days ago
✅ The ticket Unable to deploy has been marked as completed.



