n8n redis connection timing out after update
siamcomm
HOBBYOP

18 days ago

My n8n instance on Railway has been running fine until today when I updated the Primary container with the latest version of n8n.

After Redeploy, both the Primary and Worker containers cannot connect to the Redis server.

I have attached a screenshot of the Primary container logs after I Redeploy and the container runs for awhile. It then crashes on its own.
No other configuration changes have been made.

Project ID: outstanding-learning

$10 Bounty

30 Replies

siamcomm
HOBBYOP

18 days ago

n8n redis connection timing out after update


siamcomm
HOBBYOP

18 days ago

I have tried rolling back all 4 n8n containers to 2 weeks ago and I'm still seeing redis connection timeouts and the UI error "Cannot GET /projects/wfVfXkYfvphTp1eX/workflows"


siamcomm
HOBBYOP

18 days ago

This is very frustrating. Can anyone help?


This isn't recommended but is n8n able to connect to Redis (and/or Postgres if applicable) through the public URL?


siamcomm
HOBBYOP

18 days ago

I tried changing it and it still timed out.
Another thing to note is the Railway UI won't load the data from the Redis server either.
Would this indicate an infrastructure issue on the Railway side?
And I have Redeployed this as well.

1442888507147420000


Are you able to connect to Redis through a database client (eg, Datagrip)?


siamcomm
HOBBYOP

18 days ago

I haven't tried. But my guess would be no since nothing else in the same environment will connect to it.


siamcomm
HOBBYOP

18 days ago

Downloading it now to give it a try. Not confident.


siamcomm
HOBBYOP

18 days ago

That's a roger o Datagrid. It gets a successful ping to the public URL.


siamcomm
HOBBYOP

18 days ago

I have been able to connect through it also.


Are you able to write keys and values to it?


(I'd assume yes)


siamcomm
HOBBYOP

18 days ago

I've not used DataGrid before so I'm not sure how to test for that.


That's fine. This might be something related to Railway as you're able to connect from your local machine, I'm not too sure. This is out of my area of knowledge unfortunately. Sorry couldn't be of much help.


siamcomm
HOBBYOP

18 days ago

Thanks for trying @pepper . Yes, it's a bit out of my comfort zone as well.


siamcomm
HOBBYOP

17 days ago

UPDATE: This is obviously a Railway issue. Where are all the support folks from Railway here?
I have removed most of the QUEUEBULL related vars. I have kept QUEUEBULLREDISURL, QUEUEBULLREDISPASSWORD, and QUEUEBULLREDISTIMEOUT_THRESHOLD.
This is because I could connect from my PC and see the Redis data in DataGrid using the Public URL. The Private data connection failed in DataGrid.

So if I can connect to the data remotely, why can't Railway connect container to container?


siamcomm
HOBBYOP

17 days ago

Log files for Primary container showing the recurring crashes.

1443097403367620630


Note that using the private network URL will not work outside of your project. It’s only available within your Railway project.


siamcomm
HOBBYOP

17 days ago

Understood. But it also wasn't working within my Railway project either.

I believe I have this resolved.
I reset all of the specific QUEUE_BULL vars to the Public URL credentials and kept the QUEUE_BULL_REDIS_URL value set to the public URL.
I did this on both the Primary and Worker containers and … drum roll please … everything came up beautifully in n8n with active Workflows operational again.

I realize using the Public URL is not recommended. But this is the only way I have been able to get his working.

I would welcome some input from Railway on this and any help on getting the environment working on the latest version of n8n with the proper Redis configuration.


(Another lil reminder that you will be charged egress fees when using public URL.)


brody
EMPLOYEE

17 days ago

Hello, Railway employee here.

I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.


siamcomm
HOBBYOP

15 days ago

This is bullshit! It is NOT a misconfiguration. All I did was update n8n and it trashed YOUR configuration.
This was installed from your original n8n package.
I would like everyone to know this. I installed your package, and then did an update, now you want to blame me for a mis-configuration.


siamcomm
HOBBYOP

15 days ago

Big middle finger to you guys. Railway has just scored a major black mark in my book


siamcomm
HOBBYOP

15 days ago

IT IS A PLATFORM ISSUE!


siamcomm
HOBBYOP

15 days ago

Lazy dickheads!


siamcomm
HOBBYOP

15 days ago

Adjust your platform to handle potential upgrades.


siamcomm
HOBBYOP

15 days ago

@pepper So now I will get charged extra because their private network no longer works? Fucking idiots!


siamcomm
HOBBYOP

15 days ago

@Brody You didn't even offer any helpful advice. If it is not a platofrm issue, why don;t you offer some suggestions about how this is misconfigured? How could this have gone from working to broken just from an update. I would really like some possible solutions to fix this problem.
I don't know how your team has set this up or why the networks connections within my container have suddenly stopped working.
Please pull your finger out of your ass and help me understand how I can fix the problem.
Thank you.


brody

Hello, Railway employee here.I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.

siamcomm
HOBBYOP

15 days ago

Useless reply.


brody

Hello, Railway employee here.I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.

siamcomm
HOBBYOP

15 days ago

You didn't even offer any helpful advice. If it is not a platofrm issue, why don;t you offer some suggestions about how this is misconfigured? How could this have gone from working to broken just from an update. I would really like some possible solutions to fix this problem.
I don't know how your team has set this up or why the networks connections within my container have suddenly stopped working.
Please pull your finger out of your ass and help me understand how I can fix the problem.


Loading...