Disk related error in rust app
spiderk
PROOP

2 years ago

When running a rust app that is trying to save a tar file on local disk yields the error below. Are there local disk limitations that don't allow for the tar to be saved? ProjectId: c455cbf9-7425-4a74-8c1d-17d41c5d793b. The app runs fine in Google Cloud Run.

https://docs.rs/tar/latest/src/tar/entry.rs.html#658-661

2024-03-26T22:42:52.143152Z INFO windmillworker::globalcache: Failed to untar piptar. Error: Custom { kind: Other, error: TarError { desc: "failed to unpack /tmp/windmill/cache/pip/protobuf==4.25.3/google/protobuf/internal/enum_type_wrapper.py", io: Custom { kind: Other, error: TarError { desc: "failed to unpack google/protobuf/internal/enum_type_wrapper.py into /tmp/windmill/cache/pip/protobuf==4.25.3/google/protobuf/internal/enum_type_wrapper.py", io: Custom { kind: Other, error: "failed to write entire file" } } } } }

2024-03-26T22:42:52.143575Z ERROR windmillworker::globalcache: Failed to extract piptar protobuf==4.25.3. Error: ExecutionErr("Failed to untar piptar /tmp/windmill/cache/pip/protobuf==4.25.3")

40 Replies

2 years ago

There are zero limitations on the filesystem. Maybe the deployment is missing a system library and therefore is unable to untar the file?


spiderk
PROOP

2 years ago

The same containers work just fine in Google Cloud run but don't in railway. Was hoping to understand what's missing on the railway side as it still seems buggy at times (volumes not allowed in certain locations, ui kicks you out or all options for creating new projects not available, etc). Are these documented anywhere or you just find out when using it?


2 years ago

volumes not allowed in certain locations
yeah railway prevents you from mounting to system paths

ui kicks you out or all options for creating new projects not available
never seen this before, mind sharing some screenshots / screen recordings?

i have done "untaring" on railway both in code and with the tar cli, no issues, unfortunaly it works elsewhere does not rule out code issues.


spiderk
PROOP

2 years ago

the error triggered comes when using rust:
https://docs.rs/tar/latest/src/tar/entry.rs.html#658-661
Is it the railway architecture?
are you with railway?


2 years ago

may i ask why im seeing mention of .py files?


2 years ago

Is it the railway architecture?
nope

are you with railway?
nope


spiderk
PROOP

2 years ago

oh, was hoping they could take a look at the projectid


spiderk
PROOP

2 years ago

it's rust, the error comes from that section


2 years ago

what are the .py files for, is this rust or python?


2 years ago

can i see your rust code for where this is erroring


2 years ago

oh wait, you are using a python wrapped library


2 years ago

that is an issue with the way their bindings work


spiderk
PROOP

2 years ago

you looking at the project?


2 years ago

neither of us work for railway


spiderk
PROOP

2 years ago

lol, do the railway folks ever stop by?
why python are you looking at?


2 years ago

they do, if this was a platform issue


spiderk
PROOP

2 years ago

that's the question, I guess


2 years ago

haha the answer being this isnt a platform issue


spiderk
PROOP

2 years ago

how would you know if you haven't seen the project?


2 years ago

as mentioned, i have untared files on railway in the past without issues


spiderk
PROOP

2 years ago

respectfully, that doesn't prove this case is the same as those, people thought it was python


2 years ago

this is not an issue with railway


2 years ago

this is an issue with the library you are using


2 years ago

are you using a dockerfile? maybe try a different runtime image


2 years ago

agree with milo


spiderk
PROOP

2 years ago

railway is great but right now is only suitable for dev loads or hobby projects, but they're getting there. I mean they didn't even have volumes before. Which is why I gave it another try


spiderk
PROOP

2 years ago

I think it could be either way, just can't be certain without having all the info though


2 years ago

are you using nixpacks?


2 years ago

or a dockerfile


2 years ago

railway runs a whole lot of business class users and helps them scale, that take is simply incorrect


spiderk
PROOP

2 years ago

a docker image


2 years ago

okay, what is the runtime image?


spiderk
PROOP

2 years ago

it's not public, it's an EE version


2 years ago

is it based on distroless? alpine? ubuntu?


2 years ago

the library might not work on that


spiderk
PROOP

2 years ago

it works on cloud run, running prod there, was just trying to test out railway


spiderk
PROOP

2 years ago

ARG DEBIANIMAGE=debian:bookworm-slim ARG RUSTIMAGE=rust:1.76-slim-bookworm
ARG PYTHON_IMAGE=python:3.11.8-slim-bookworm

FROM ${DEBIAN_IMAGE} as nsjail


spiderk
PROOP

2 years ago

do you guys know if the limitations are listed somewhere?

  • unallowed locations for volumes

  • no volumes for replicas

  • architectures supported
    etc


2 years ago

> unallowed locations for volumes
system paths, i dont have a list unfortunaly

> no volumes for replicas

> architectures supported
amd64


spiderk
PROOP

2 years ago

a'ight, thanks for the info


Loading...