a year ago
I'm running a fastAPI service in railway. I setup a /healthcheck endpoint. It worked well when I exposed it publicly and bound it to 0.0.0.0:8000 (I've also specified the PORT=8000 env var).
However, I want an nginx reverse proxy to be the only publicly exposed service since that backend service will work alongside a separate nextjs frontend service (that won't be publicly exposed either).
In trying to communicate the service privately though, I changed the host to :: (same 8000 port) as per the private networking docs: https://docs.railway.app/guides/private-networking#listen-on-ipv6 and railway can't hit the /healthcheck endpoint anymore and so the build logs say the service never came online. Any thoughts?
0 Replies
a year ago
Uvicorn does not support dual stack binding (IPv6 and IPv4) from the CLI, so while that start command will work to enable access from within the private network, this prevents you from accessing the app from the public domain if needed, I recommend using Hypercorn instead
a year ago
health checks use ipv4
a year ago
an example hypercorn start command would be hypercorn main:app --bind [::]:$PORT
a year ago
of course you'd want to set a fixed PORT service variable
a year ago
will bring that up to the applicable person
a year ago
yeah but i wouldnt disable the health check, i would use hypercorn
Noted!
Our production systems are battle tested on uvicorn. I can't justify switching over given that railway only has healthchecks over ipv4 though. It would also be a non trivial change in the codebase
a year ago
thats fair, but without a health check railway wont know when your app is able to handle traffic
Yup, understood. I'm running an MVP to test out the viability of switching our k8s cluster over to railway. If we do decide to pull the trigger on the migration we would consider switching to accomodate for the healthchecks
a year ago
sounds good, and with the upcoming runtime im sure adding ipv6 capabilities to the health check would be already done by default or easy enough to implement
Nice! That's good to hear!
Do you have a rough ETA for when those changes would land?
a year ago
runtime v2 is pre-alpha right now, so i dont have any real eta to give you, and in fact the v2 runtime doesnt even support any health checks right now
Coming back to this, my nginx service isn't able to communicate with the fastapi service
a year ago
lets see the nginx.conf
I've disabled the healthcheck and have nginx pointed to [http://upcodes-backend.railway.internal:8000](http://upcodes-backend.railway.internal:8000)
server {
listen 80;
location /v0 {
proxy_pass http://upcodes-backend.railway.internal:8000;
}
location / {
proxy_pass http://upcodes-frontend.railway.internal;
}
}a year ago
nginx is not ideal for this, but i assume you dont want to switch to caddy?
Is there are reason why nginx wouldn't work? Happy to switch if that helps/is easier
a year ago
nginx tries to resolve the domains at first start, this is not ideal for two resaons, the private network is not available at first start, the services do not have static ip(v6) addresses
a year ago
of course nginx can be configured to not do these things, but caddy doesnt do them by default
a year ago
yep that template covers your use case, though mine calls the backend endpoint /api but thats a simple change
a year ago
/api/* -> /v0/*
a year ago
yeah you would need to deploy the template and then eject from it
a year ago
sounds good