3 months ago
I'm tired of bot traffic and inflated usage from bots.
also last month my usage seemingly doubled while running the same code as the month prior.
either ai bots doubled or you doubled the price on us because the user count for my app is the same.
Plus you charge so much while half the time i was still unable to access the service and you still haven't resolved that issue the bounty is still waiting.
(the bounty thread https://station.railway.com/questions/production-rails-app-hitting-infrastruct-3fc1050a)
so why am i paying for twice as much cpu and ram usage in a month while having downtime that wasn't happening before?
(yesterday I put on the new cloudflare feature for DDOS under attack) but what are we supposed to do?
will the Cloudflare feature stop the bots and stop the weird web application firewall issues?
just wondering if anyone else has dealt with this and found an effective way because i don't mind paying for users but when people scrape and abuse its not cool.
0 Threads mention this feature
1 Replies
3 months ago
Have you tried putting the site behind Cloudflare and configuring its bot controls? A good first step is a robots.txt file to tell legitimate AI crawlers which areas they shouldn’t access. Cloudflare can then enforce blocking or rate-limit crawlers that ignore it before the requests reach Railway and consume application resources.
It may also be worth checking which URLs are receiving the traffic - sometimes bots discover filtered or dynamically generated pages and create a huge crawl space. Blocking those paths in robots.txt, caching them, and adding Cloudflare rate limits can make a significant difference.
This is largely configurable by the application owner, although better traffic and usage visibility from Railway would certainly help confirm whether bots are actually responsible for the increase.