a month ago
I have a simple website hosted on Railway right now. When I tried to get ChatGPT t access it, I learned it keeps hitting Cache Miss and is unable to view the page. I was able to reproduce this with curl by passing in a GPTBot user-agent and have been unable to find a way around it. Is there a way to allow ChatGPT and other AI chatbots to be able to access my deploy?
2 Replies
a month ago
Our edge proxy does block requests from known AI bot user-agents (like GPTBot) on *.up.railway.app domains, and there is currently no setting to disable this. Using a custom domain with Cloudflare proxying enabled (orange cloud) will route traffic through Cloudflare's edge instead, which should allow AI bots to reach your service.
Status changed to Awaiting User Response Railway • about 1 month ago
Railway
Our edge proxy does block requests from known AI bot user-agents (like GPTBot) on `*.up.railway.app` domains, and there is currently no setting to disable this. Using a custom domain with Cloudflare proxying enabled (orange cloud) will route traffic through Cloudflare's edge instead, which should allow AI bots to reach your service.
a month ago
When I set it up to go via Cloudflare, it still shows x-cache: MISS and indicates it is still hitting Fastly as well. It shows it is going through Cloudflare too so it seems to be Cloudflare -> Fastly -> blocked.
Status changed to Awaiting Railway Response Railway • about 1 month ago
Status changed to Open Railway • about 1 month ago