Cloudflare proxied web apps forbidden on Railway varnish cache server
bogdoslavik
FREEOP

23 days ago

My website https://app.mydream.video/ proxied via Cloudflare DNS
Before it works well, but last night it is stops working. Showing

Error 403 Forbidden

Forbidden

Error 54113

Details: cache-sin-wsat1880030-SIN 1771656353 3813162234

Varnish cache server

When I disable Cloudflare proxy - then it is works. But I want to use cloudflare for caching and protection.

How to fix this issue? Thank you!

33 Replies

Status changed to Awaiting Railway Response Railway 23 days ago


23 days ago

It seems like our changelog announcing DDoS protection has provoked someone, and since we are still establishing a baseline with Fastly, full DDoS mitigations weren't applied.

https://status.railway.com/cmlvw0n6u00129w5qnapyib77


Status changed to Awaiting User Response Railway 23 days ago


jeromevvb
PRO

23 days ago

Its not working for me when i disabled Cloudfare Proxy


Status changed to Awaiting Railway Response Railway 23 days ago


23 days ago

Can you let me know what isn't working?


Status changed to Awaiting User Response Railway 23 days ago


jeromevvb

Its not working for me when i disabled Cloudfare Proxy

bogdoslavik
FREEOP

23 days ago

After disabling proxy need to wait some time, while DNS will be propaginated


Status changed to Awaiting Railway Response Railway 23 days ago


23 days ago

The incident has already been resolved; there's no longer a need to change anything.


Status changed to Awaiting User Response Railway 23 days ago


anishs37
PRO

23 days ago

Still getting 503 varnish cache errors on endpoints on my end. Tried pushing out new builds as well. Let us know if any action has to be taken on our ends.


Status changed to Awaiting Railway Response Railway 23 days ago


brody

The incident has already been resolved; there's no longer a need to change anything.

bogdoslavik
FREEOP

23 days ago

I still receive Error 403 Forbidden

Forbidden

Error 54113

Details: cache-sin-wsat1880093-SIN 1771658356 1830674490

Varnish cache server

from https://app.mydream.video/ and https://api.mydream.video/
while Cloudflare proxy is enabled


brody

The incident has already been resolved; there's no longer a need to change anything.

jeromevvb
PRO

23 days ago

It wasnt working on my Wifi, switching to my cellular data and its working now...
I guess it might be related to some cache issues

Do i still need to use cloudfare as proxy now that you guys have fastly?


anishs37

Still getting 503 varnish cache errors on endpoints on my end. Tried pushing out new builds as well. Let us know if any action has to be taken on our ends.

23 days ago

503 or 403?


brody

503 or 403?

anishs37
PRO

23 days ago

503 error: here is the full error for one of the endpoints, that was not there before this outage. - <?xml version="1.0" encoding="utf-8"?>

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"

"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">

<html>

<head>
<title>503 backend write error</title>
</head>
<body>
<h1>Error 503 backend write error</h1>
<p>backend write error</p>
<h3>Error 54113</h3>
<p>Details: cache-[redacting this for public forum]</p>
<hr>
<p>Varnish cache server</p>
</body>
</html>


anishs37

503 error: here is the full error for one of the endpoints, that was not there before this outage. - <?xml version="1.0" encoding="utf-8"?><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN""http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html><head><title>503 backend write error</title></head><body><h1>Error 503 backend write error</h1><p>backend write error</p><h3>Error 54113</h3><p>Details: cache-[redacting this for public forum]</p><hr><p>Varnish cache server</p></body></html>

23 days ago

Please provide a URL that I can curl to see this error.


brody

Please provide a URL that I can curl to see this error.

anishs37
PRO

23 days ago

Any way I can message it privately to you as it is an internal server URL our team would prefer not be in public. Let us know.


codechr1s
PRO

23 days ago

This is not resolved. After the 503 earlier too many requests we are now getting this error 403 varnish cache server. What’s going on today?


anishs37
PRO

23 days ago

Update: On our end, systems seem to be recovering without 503 errors. Weird.


codechr1s
PRO

23 days ago

It’s region specific. Asia is down.

Error 403 Forbidden

Forbidden

Error 54113

Details: cache-bkk2310020-BKK 17716642701172363908

Varnish cache server


codechr1s

It’s region specific. Asia is down.Error 403 ForbiddenForbiddenError 54113Details: cache-bkk2310020-BKK 17716642701172363908Varnish cache server

jeromevvb
PRO

23 days ago

I confirm this. Down again


tim-nocode
PRO

23 days ago

Asia, same issue with 403 forbidden error with cloudflare proxy enabled.

When I switch off proxy application start working


tappoyo
PRO

23 days ago

down again. my service fails with a 503.

"Same machine same service in the most recent hop on cache-ams21027-AMS: scJ4iSV4UkyHDI2juJNzrcUzYk/oO1PMCyYg4bz5Utg!AMS!cache-ams21027-AMS"

I'm not using any proxy, just my domain directly configured into Railway.


brody

The incident has already been resolved; there's no longer a need to change anything.

pedonebrian
HOBBY

22 days ago

Still having this issue on all of my sites. Turned off Cloudflare proxy and working, but don’t want to leave that off.


tim-nocode

Asia, same issue with 403 forbidden error with cloudflare proxy enabled.When I switch off proxy application start working

pedonebrian
HOBBY

22 days ago

Same issue here.


codechr1s
PRO

22 days ago

Hello Railway? Anyone care to look at this? It’s been multiple hours now.


codechr1s

Hello Railway? Anyone care to look at this? It’s been multiple hours now.

pedonebrian
HOBBY

22 days ago

Yes agreed, still having the issue here. Needed to turn off Cloudflare proxy and don’t want to leave it like that.


xxxl
PRO

22 days ago

Still having this issue on all of my sites.


johndavi
PRO

22 days ago

Goddang it, after everything this week. I am getting this right now all of the sudden


codechr1s
PRO

22 days ago

10 hrs later…

Error 403 Forbidden

Forbidden

Error 54113

Details: cache-bkk2310021-BKK 1771699897 866316240

Varnish cache server


johndavi
PRO

22 days ago

Back again, it is coming and going throughout the day


codechr1s

10 hrs later…Error 403 ForbiddenForbiddenError 54113Details: cache-bkk2310021-BKK 1771699897 866316240Varnish cache server

pedonebrian
HOBBY

22 days ago

Not sure if anyone is helping yet from Railway, but turning off Cloudflare proxy and it works.


pedonebrian

Not sure if anyone is helping yet from Railway, but turning off Cloudflare proxy and it works.

johndavi
PRO

22 days ago

Where is that set? Is that w/in Railway? I am otherwise not using CF.


22 days ago

Hello all, we are still looking into it, thank you for your continued patience.


brody

Hello all, we are still looking into it, thank you for your continued patience.

tim-nocode
PRO

22 days ago

Any news?)


22 days ago

Are you still seeing this?


brody

Are you still seeing this?

tim-nocode
PRO

21 days ago

I don't try enable proxy on cloudflare before i see message that problem resolved.

Is problem resolved?


kylebrowning
HOBBY

10 days ago

IM still seeing this @brody


Loading...