Backend Performance Degradation - Server Timeout Issues Requiring Investigation
sanjeevani-octet
FREEOP

7 months ago

Dear Railway Support Team,

I am writing to report a critical performance issue with my Django backend deployment that requires immediate investigation.

Project Details:

Issue Summary: My Django backend, which was functioning perfectly until approximately 15 august, is now experiencing consistent server timeouts and unresponsiveness. This appears to be an infrastructure-level issue as:

  • No code changes were deployed when the issue began

  • The application was working flawlessly for 6 months prior to this

  • Frontend applications are receiving timeout errors when making API calls

  • The issue is consistent across all endpoints

Impact:

  • Frontend application deployed on Vercel is failing due to API timeouts

  • User experience is severely degraded

  • Additional costs are being incurred on the frontend due to extended function execution times waiting for responses

  • Service is essentially unusable in current state

Technical Details:

  • Error pattern: timeout error

  • Typical response time before issue: 4-5 secounds

  • Current response time: 30+ secounds

  • Affected endpoints: All endpoints

Request:

  1. Immediate investigation into server performance degradation

  2. Resolution timeline for restoring normal service performance

  3. Root cause analysis of what changed in your infrastructure

  4. Confirmation that this is being treated as a priority issue

This appears to be a Railway infrastructure issue rather than an application problem, given that the same codebase was performing optimally before 15 august. I would appreciate urgent attention to this matter as it's significantly impacting my application's availability.

Please provide:

  • Acknowledgment of this issue

  • Expected resolution timeline

  • Any immediate steps I can take while waiting for a fix

I can provide additional logs, monitoring data, or any other information needed to help diagnose this issue.

Thank you for your prompt attention to this matter.

50 Replies

Railway
BOT

7 months ago


sanjeevani-octet
FREEOP

7 months ago

Please reply fast as this is a critical issue


I am confused as you are on the legacy hosts which have no one on the instance. Can you describe more about your issue?


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

https://octet.design/colors/mood-based/sophisticated-elegant/
Click on this url . this url is giving timeout error .
Now the frontend is on vercel and backend app is on railway. so every api is taking more than 30 sec time to respond to the frontend application .
Previously it was on railway metal server then one of your support team member told to switch to the legacy server and after it starts working fine.
Now the same issues of long api response time are started coming on legacy server .
I hope you understand and provide me a solution.


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

please reply fast


What's the specific network error that you are seeing?


Status changed to Awaiting User Response Railway 7 months ago


(I need it for the platform team.)


sanjeevani-octet
FREEOP

7 months ago

504


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

Look this error I am getting

Attachments


Okay, try now, I think I see the issue.


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

Not working


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago


I don't see this URL on your dahsboard.


Status changed to Awaiting User Response Railway 7 months ago


and the API you are reporting to not be availible is returning: https://api.addding.com/


sanjeevani-octet
FREEOP

7 months ago

Still The reponse time is taking too much time like more than 15 secounds


Status changed to Awaiting Railway Response Railway 7 months ago


I wouldn't know what else to do here- the host it's self is performing fine. You will need to resolve the issue with your code.


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

https://api.addding.com/colorpalette/categories?collection=accessibility-focused --- can you check this url ?
It is from the host and talking long time to load the response . Is it a host issue or Code issue ?


Status changed to Awaiting Railway Response Railway 7 months ago


It loaded in like 250ms for me... which is... weird.


Status changed to Awaiting User Response Railway 7 months ago


Look, I am not doubting that you are facing this issue, however, it's hard to trace down, so I will need logs and timestamps more so than just screenshots that load fine on my machine.



Status changed to Awaiting Railway Response Railway 7 months ago


Instant


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

WARNING: database "railway" has a collation version mismatch

DETAIL: The database was created using collation version 2.36, but the operating system provides version 2.41.

HINT: Rebuild all objects in this database that use the default collation and run ALTER DATABASE railway REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.

is this a major issue ?


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet

WARNING: database "railway" has a collation version mismatchDETAIL: The database was created using collation version 2.36, but the operating system provides version 2.41.HINT: Rebuild all objects in this database that use the default collation and run ALTER DATABASE railway REFRESH COLLATION VERSION, or build PostgreSQL with the right library version. is this a major issue ?

That would affect performance sometimes


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

How to resolve it ?


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

can you check this logs as you asked ?

Attachments


sanjeevani-octet
FREEOP

7 months ago

are you there ?


sanjeevani-octet
FREEOP

7 months ago

?????


sanjeevani-octet
FREEOP

7 months ago

Are you there ?


sanjeevani-octet

can you check this logs as you asked ?

sanjeevani-octet
FREEOP

7 months ago

I have provided you with the logs . can you check ?


Railway
BOT

7 months ago

Hello!

We're acknowledging your issue and attaching a ticket to this thread.

We don't have an ETA for it, but, our engineering team will take a look and you will be updated as we update the ticket.

Please reply to this thread if you have any questions!


Forgive me, I logged off at 4 AM my time, I have escalated this to the platform team.


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

How Much time Do I have to wait ? I am Frustated with your service because its not the issue from my side and i am paying for the vercel bill due to timeout issues.


Status changed to Awaiting Railway Response Railway 7 months ago


Are you still getting timeouts?


Status changed to Awaiting User Response Railway 7 months ago


We just observed that we have fixed most if not all stalls on writes, if not that, then it's a different issue.


If you need to avoid a "network" issue, you can deploy the front-end and connect via the private network.


sanjeevani-octet
FREEOP

7 months ago

Can you this logs I am asking you this issue .

Attachments


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

Are you there ?


angelo-railway

If you need to avoid a "network" issue, you can deploy the front-end and connect via the private network.

sanjeevani-octet
FREEOP

7 months ago

Can you provide me a guide to this ?


angelo-railway

If you need to avoid a "network" issue, you can deploy the front-end and connect via the private network.

sanjeevani-octet
FREEOP

7 months ago

Look I Have deployed the frontend : https://palettes-staging-production.up.railway.app/colors/city-inspired/
Go to any page and you will be able to see that response is coming in 40 to 50 secounds . Now please check this

Attachments


sanjeevani-octet
FREEOP

7 months ago

??


Your plan SLO states that you are entitled to response time responses within a 24 hour period. I understand that you may be frustrated, but please keep in mind that there is someone across from this screen. We are trying to engage with you to solve this issue.

When hitting that link, I am getting: around 2 to 3 seconds. Not 40. So I am a bit confused on how that you are getting that figure.

Attachments


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

Ok Here I am giving a step by step process to see the API timings going 40 seconds and above.

Backend Service: addding-django
Go to Octet-projects and open addding-django service then the latest deployment and in that open Http logs. Now keep watching the logs

Now open a other Railway window for Frontend Project
Frontend Service: Palettes-staging
Go to triumphant-radiance and open Palettes-staging service then the latest deployment and in that open Http logs. Now keep watching the logs

After this two steps you have to visit this URL https://palettes-staging-production.up.railway.app/colors/city-inspired/hong-kong-skyline/ and try to use this application and now check the logs for addding-django and Palettes-staging and you will see that APIs are calling to the addding-django service and the response time are more than 40 seconds


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet

WARNING: database "railway" has a collation version mismatchDETAIL: The database was created using collation version 2.36, but the operating system provides version 2.41.HINT: Rebuild all objects in this database that use the default collation and run ALTER DATABASE railway REFRESH COLLATION VERSION, or build PostgreSQL with the right library version. is this a major issue ?

7 months ago

Hi there,

To resolve this issue, run ALTER DATABASE railway REFRESH COLLATION VERSION; from your SQL client when connected the railway database.

Please give that a go and let us know if you see any improvement.

Regards,
Christian


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

7 months ago

We have resolved this databse issue and still the error is there. Now this issue is here from very long time and I am not getting a proper solution from Your side and my costs are going very high like 100 dollars a weak.


Status changed to Awaiting Railway Response Railway 7 months ago


sanjeevani-octet

Ok Here I am giving a step by step process to see the API timings going 40 seconds and above.Backend Service: addding-djangoGo to Octet-projects and open addding-django service then the latest deployment and in that open Http logs. Now keep watching the logsNow open a other Railway window for Frontend Project Frontend Service: Palettes-stagingGo to triumphant-radiance and open Palettes-staging service then the latest deployment and in that open Http logs. Now keep watching the logsAfter this two steps you have to visit this URL https://palettes-staging-production.up.railway.app/colors/city-inspired/hong-kong-skyline/ and try to use this application and now check the logs for addding-django and Palettes-staging and you will see that APIs are calling to the addding-django service and the response time are more than 40 seconds

sanjeevani-octet
FREEOP

7 months ago

Have you checked this ?


Railway
BOT

7 months ago

✅ The ticket Database Performance Issue has been marked as completed.


We have, we found that there is a possible issue with the network on your workload.


Status changed to Awaiting User Response Railway 7 months ago


sanjeevani-octet
FREEOP

6 months ago

So How to reolve it ?


Status changed to Awaiting Railway Response Railway 6 months ago


6 months ago

If the issue you are experiencing is still present, then any remaining issues would be on your side, either at the application level, due to incorrect configurations or setup, or issues with your local network. I have gone through all the links and reproduction steps you gave Angelo, and nothing is timing out for me or took anywhere near 40 seconds. I'm sorry, but we are not able to help further, as everything is operating correctly on our side.


Status changed to Awaiting User Response Railway 6 months ago


sanjeevani-octet
FREEOP

6 months ago

I’m extremely disappointed with this response. If you are unwilling to acknowledge or assist with the ongoing issues I’ve been facing, then there’s no point in continuing with your platform. I am moving all of my services to AWS directly and cancelling my plan with you effective immediately. Your lack of support and accountability has made it clear that this is not a reliable long-term solution.


Status changed to Awaiting Railway Response Railway 6 months ago


Loading...