a year ago
Hi, I am a student, and I’ve created a full-stack app that includes web scrapers. I’d like to deploy it here, but I’m concerned that deploying it could result in my account being permanently banned. I know Railway’s policies prohibit activities like using user bots or crypto mining, which I understand, but what about web scrapers? Can anyone clarify if using web scrapers might lead to a ban?
8 Replies
a year ago
Do you have explicit permission to scrape what you are scraping?
I am scraping comic book covers and converting them to strings from websites that translate them into English (scanlation websites). These websites do not own the images, and neither do I.
a year ago
That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?
a year ago
That's a pretty big grey area then, do you at least respect rules in robots.txt files? and follow other best practices like have a url or email in the user agent so webmasters can contact you for blacklist requests?
To be honest, I didn’t know about the things you mentioned until now. I am still learning about web development. In my project, I included contact forms and URLs, along with the logos of the websites, so users know where I got the images. Additionally, when a user clicks on an image, they are redirected to the page where the scanlations are hosted.
I created a hub where different scanlations are gathered in one place. I do not receive any monetary benefit from this; it's simply a project to help me get hired.
a year ago
I would say this is a relatively safe project then, I don't foresee you catching a ban.
a year ago
Thank you for your response and time. Good night.
a year ago
One more thing, please upgrade to a Paid plan, we tend to be far more lenient with Hobby users.
Status changed to Solved brody • over 1 year ago