Will deploying and using a web scraper on Railway lead to a ban?
dauvnir
TRIALOP

a year ago

Hi, I am a student, and I’ve created a full-stack app that includes web scrapers. I’d like to deploy it here, but I’m concerned that deploying it could result in my account being permanently banned. I know Railway’s policies prohibit activities like using user bots or crypto mining, which I understand, but what about web scrapers? Can anyone clarify if using web scrapers might lead to a ban?

Solved

8 Replies

a year ago

Do you have explicit permission to scrape what you are scraping?


dauvnir
TRIALOP

a year ago

Do you have explicit permission to scrape what you are scraping?

I am scraping comic book covers and converting them to strings from websites that translate them into English (scanlation websites). These websites do not own the images, and neither do I.


a year ago

That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?


dauvnir
TRIALOP

a year ago

That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?

To be honest, I didn’t know about the things you mentioned until now. I am still learning about web development. In my project, I included contact forms and URLs, along with the logos of the websites, so users know where I got the images. Additionally, when a user clicks on an image, they are redirected to the page where the scanlations are hosted.

I created a hub where different scanlations are gathered in one place. I do not receive any monetary benefit from this; it's simply a project to help me get hired.


a year ago

I would say this is a relatively safe project then, I don't foresee you catching a ban.


dauvnir
TRIALOP

a year ago

Thank you for your response and time. Good night.


a year ago

No problem!


a year ago

One more thing, please upgrade to a Paid plan, we tend to be far more lenient with Hobby users.


Status changed to Solved brody over 1 year ago


Loading...