cron and volumes
magic-beppo
PROOP

a year ago

Dear Railway Team,

I have a cron job (python) that executes 2 python scripts (webscraping 2 supermarket pages in the UAE for fruit&vegetable prices). The python script is supposed to write & append data to a csv file on a persistent volume that I created at /data. The cron job seems to work judging from the fact that some space is occupied after the execution. So I presume that the volumes is being used and the csv files are being created, but I only see that some of the 5GB is being occupied without seeing the 2 csv files. Why? How can I make the visible? How can I download them?

Thanks in advance!

Josef

4 Replies

brody
EMPLOYEE

a year ago

This thread has been marked as public for community involvement, as it does not contain any sensitive or personal information. Any further activity in this thread will be visible to everyone.

Status changed to Open brody over 1 year ago


brody
EMPLOYEE

a year ago

We do not yet provide a file viewer, instead you should send the data to a Postgres database.


magic-beppo
PROOP

a year ago

Would you have a code snippet for me?


magic-beppo
PROOP

a year ago

If I export into csv (in addition to the postgres table), how can I download the csv file?


brody
EMPLOYEE

a year ago

It would take a lot more than a code snippet, and unfortunately we can't offer coding help here.

Once you have data in a database you can use software like dbgate to export a csv.


Loading...