Will deploying and using a web scraper on Railway lead to a ban?
dauvnir
TRIALOP

a year ago

Hi, I am a student, and I’ve created a full-stack app that includes web scrapers. I’d like to deploy it here, but I’m concerned that deploying it could result in my account being permanently banned. I know Railway’s policies prohibit activities like using user bots or crypto mining, which I understand, but what about web scrapers? Can anyone clarify if using web scrapers might lead to a ban?

Solved

8 Replies

brody
EMPLOYEE

a year ago

Do you have explicit permission to scrape what you are scraping?


dauvnir
TRIALOP

a year ago

Do you have explicit permission to scrape what you are scraping?

I am scraping comic book covers and converting them to strings from websites that translate them into English (scanlation websites). These websites do not own the images, and neither do I.


brody
EMPLOYEE

a year ago

That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?


dauvnir
TRIALOP

a year ago

That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?

To be honest, I didn’t know about the things you mentioned until now. I am still learning about web development. In my project, I included contact forms and URLs, along with the logos of the websites, so users know where I got the images. Additionally, when a user clicks on an image, they are redirected to the page where the scanlations are hosted.

I created a hub where different scanlations are gathered in one place. I do not receive any monetary benefit from this; it's simply a project to help me get hired.


brody
EMPLOYEE

a year ago

I would say this is a relatively safe project then, I don't foresee you catching a ban.


dauvnir
TRIALOP

a year ago

Thank you for your response and time. Good night.


brody
EMPLOYEE

a year ago

No problem!


brody
EMPLOYEE

a year ago

One more thing, please upgrade to a Paid plan, we tend to be far more lenient with Hobby users.


Status changed to Solved brody over 1 year ago


Loading...