Custom domain stuck on "Issuing TLS certificate"
yekta-ko
PROOP

a month ago

Hi Railway team,

Our custom domain eu.otel.confident-ai.com has been stuck on "Issuing TLS certificate" for over an hour, and the edge is serving an expired certificate, causing a production outage for our EU customers.

Service details:

Project: Honest Dolphin (22fb7f66-ed07-448b-9b9b-a6d7aaff2321)

Environment: EU (2be6ccf9-6026-411c-9382-429bddeea969)

Service: otel-server (8015a312-005e-42f1-83af-cac1ff63bf81)

Domain: eu.otel.confident-ai.com → target port 8080

What's happening:

The edge at qcgqlece.up.railway.app (69.46.46.106) is serving a Let's Encrypt cert that expired Jun 1 2026 (serial 062DD878A9305E5EA919086ED1C072FAB9D7), so TLS-verifying clients fail.

Certificate Transparency logs show a valid LE cert for this exact hostname was issued 2026-05-09 (expires 2026-08-07) — but your edge never picked it up.

The Railway-generated domain on the same service (railway.eu.otel.confident-ai.com) serves a valid cert, so this is isolated to the custom domain.

What we've already verified/tried on our side:

DNS: CNAME → qcgqlece.up.railway.app, resolving correctly, DNS-only (not Cloudflare-proxied)

No CAA records blocking issuance; DNSSEC validates cleanly (checked via Google/Cloudflare/Quad9 resolvers)

Deleted and re-added the custom domain — it returned to "Issuing TLS certificate" but the edge still serves the expired cert ~1h later

Note: earlier today this hostname's DNS pointed at a decommissioned host (since corrected), so your ACME client may have accumulated failed validations and be stuck in backoff or hit an LE rate limit.

Ask: please force re-issuance (or deploy the existing valid May 9 cert) for eu.otel.confident-ai.com. This is customer-impacting — EU trace ingestion is down on the primary hostname.

Thanks,

Yekta

yekta@confident-ai.com

$20 Bounty

1 Replies

Railway
BOT

a month ago

This thread has been opened as a public bounty so the community can help solve it. The thread and any further activity are now visible to everyone.

Status changed to Open Railway 26 days ago


You need to add a TXT record to _railway-verify.eu.otel.confident-ai.com.


Welcome!

Sign in to your Railway account to join the conversation.

Loading...