2 years ago
When running a rust app that is trying to save a tar file on local disk yields the error below. Are there local disk limitations that don't allow for the tar to be saved? ProjectId: c455cbf9-7425-4a74-8c1d-17d41c5d793b. The app runs fine in Google Cloud Run.
https://docs.rs/tar/latest/src/tar/entry.rs.html#658-661
2024-03-26T22:42:52.143152Z INFO windmillworker::globalcache: Failed to untar piptar. Error: Custom { kind: Other, error: TarError { desc: "failed to unpack /tmp/windmill/cache/pip/protobuf==4.25.3/google/protobuf/internal/enum_type_[wrapper.py](wrapper.py)", io: Custom { kind: Other, error: TarError { desc: "failed to unpack google/protobuf/internal/enum_type_[wrapper.py](wrapper.py) into /tmp/windmill/cache/pip/protobuf==4.25.3/google/protobuf/internal/enum_type_[wrapper.py](wrapper.py)", io: Custom { kind: Other, error: "failed to write entire file" } } } } }
2024-03-26T22:42:52.143575Z ERROR windmillworker::globalcache: Failed to extract piptar protobuf==4.25.3. Error: ExecutionErr("Failed to untar piptar /tmp/windmill/cache/pip/protobuf==4.25.3")
40 Replies
2 years ago
There are zero limitations on the filesystem. Maybe the deployment is missing a system library and therefore is unable to untar the file?
The same containers work just fine in Google Cloud run but don't in railway. Was hoping to understand what's missing on the railway side as it still seems buggy at times (volumes not allowed in certain locations, ui kicks you out or all options for creating new projects not available, etc). Are these documented anywhere or you just find out when using it?
2 years ago
volumes not allowed in certain locations
yeah railway prevents you from mounting to system pathsui kicks you out or all options for creating new projects not available
never seen this before, mind sharing some screenshots / screen recordings?
i have done "untaring" on railway both in code and with the tar cli, no issues, unfortunaly it works elsewhere does not rule out code issues.
the error triggered comes when using rust:
https://docs.rs/tar/latest/src/tar/entry.rs.html#658-661
Is it the railway architecture?
are you with railway?
2 years ago
may i ask why im seeing mention of .py files?
2 years ago
Is it the railway architecture?
nopeare you with railway?
nope
2 years ago
what are the .py files for, is this rust or python?
2 years ago
can i see your rust code for where this is erroring
2 years ago
oh wait, you are using a python wrapped library
2 years ago
that is an issue with the way their bindings work
2 years ago
neither of us work for railway
2 years ago
they do, if this was a platform issue
2 years ago
haha the answer being this isnt a platform issue
2 years ago
as mentioned, i have untared files on railway in the past without issues
respectfully, that doesn't prove this case is the same as those, people thought it was python
2 years ago
this is not an issue with railway
2 years ago
this is an issue with the library you are using
2 years ago
are you using a dockerfile? maybe try a different runtime image
2 years ago
agree with milo
railway is great but right now is only suitable for dev loads or hobby projects, but they're getting there. I mean they didn't even have volumes before. Which is why I gave it another try
I think it could be either way, just can't be certain without having all the info though
2 years ago
are you using nixpacks?
2 years ago
or a dockerfile
2 years ago
railway runs a whole lot of business class users and helps them scale, that take is simply incorrect
2 years ago
okay, what is the runtime image?
2 years ago
is it based on distroless? alpine? ubuntu?
2 years ago
the library might not work on that
it works on cloud run, running prod there, was just trying to test out railway
ARG DEBIANIMAGE=debian:bookworm-slim ARG RUSTIMAGE=rust:1.76-slim-bookworm
ARG PYTHON_IMAGE=python:3.11.8-slim-bookworm
FROM ${DEBIAN_IMAGE} as nsjail
do you guys know if the limitations are listed somewhere?
unallowed locations for volumes
no volumes for replicas
architectures supported
etc
2 years ago
> unallowed locations for volumes
system paths, i dont have a list unfortunaly
> no volumes for replicas
> architectures supported
amd64