IP Block of Discord's crawlers on my project

diwasmainali1
HOBBY

9 days ago

Hello, I have isolated a platform-level networking issue. My application (yeld-production.up.railway.app), served via the custom domain www.cramandconquer.com, is failing to generate a link preview only on Discord.

I have confirmed the following through extensive testing:

  1. The site is live and meta tags are correct: It works perfectly on other platforms like the Twitter Card Validator.

  2. It is not a User-Agent block: I ran a PowerShell Invoke-WebRequest from my own IP while spoofing the Discordbot/2.0 user agent, and I received a StatusCode: 200 OK response.

  3. Discord's infrastructure is being blocked: Despite my own test succeeding, Discord's official embed generator consistently returns an "Internal error".

This evidence proves that the issue is not in my application code or configuration. Your platform's firewall is allowing requests that pretend to be Discord from my IP, but is blocking the real requests from Discord's own IP ranges.

Could you please investigate your network firewall logs for blocked traffic from Discord's IPs to my project and whitelist them? This is preventing a critical feature of my application from working.

Thank you.

Solved$10 Bounty

4 Replies

brody
EMPLOYEE

4 days ago

Hello,

We do not block any outbound requests to any 3rd parties under any circumstances.

Best,
Brody

Status changed to Awaiting User Response railway[bot] • 4 days ago

brody

Hello,We do not block any outbound requests to any 3rd parties under any circumstances.Best,Brody

diwasmainali1
HOBBY

4 days ago

Hello Brody,

Thank you for replying. I believe there is a misunderstanding. The issue is with inbound traffic. Discord bots are trying to crawl my website to generate link previews, so they're making HTTP requests to my Railway-hosted application.

I have experimented with turning off Cloudflare and still found that the Discord bot is getting filtered from reaching my website. Even in the HTTP logs, when I try to generate embeds, I see nothing, which indicates that Discord's requests are not reaching my application at all. This strongly suggests there is filtering occurring at the network level before traffic reaches my application.

Additional Evidence:

  • I can successfully spoof Discord's user agent (Discordbot/2.0) from my own IP and receive a 200 OK response

  • Other social media platforms (Facebook, LinkedIn, Twitter) can successfully crawl and generate previews for the same URL

  • The complete absence of any log entries when Discord attempts to crawl suggests the requests are being blocked before they reach my application

Thank you for replying and your assistance in resolving this bug.

Kind regards,

Diwas

Status changed to Awaiting Railway Response railway[bot] • 4 days ago

brody
EMPLOYEE

4 days ago

Ah yes there was a misunderstanding, sorry about that.

But similarly, we do not block inbound requests unless there is a DDOS senario, and I can't imagine Discord is attempting to DDOS your application.

I'm going to open this thread up to our community in hopes that they will be able to help you pinpoint the issue with your application or setup, as the Railway team can only provide support for the Railway platform and product.

Status changed to Awaiting User Response railway[bot] • 4 days ago

brody
EMPLOYEE

4 days ago

This thread has been marked as public for community involvement, as it does not contain any sensitive or personal information. Any further activity in this thread will be visible to everyone.

Status changed to Open brody • 4 days ago

Status changed to Solved diwasmainali1 • 4 days ago

diwasmainali1
HOBBY

4 days ago

Sorry to bother you brody! This is an issue with cloudflare. Thanks for being helpful tho, Railway rocks!

heart1

Status changed to Awaiting Railway Response railway[bot] • 4 days ago

Status changed to Solved diwasmainali1 • 4 days ago

IP Block of Discord's crawlers on my project - Railway Help Station