n8n redis connection timing out after update

3 months ago

My n8n instance on Railway has been running fine until today when I updated the Primary container with the latest version of n8n.

After Redeploy, both the Primary and Worker containers cannot connect to the Redis server.

I have attached a screenshot of the Primary container logs after I Redeploy and the container runs for awhile. It then crashes on its own.
No other configuration changes have been made.

Project ID: outstanding-learning

$10 Bounty

30 Replies

3 months ago

n8n redis connection timing out after update


3 months ago

I have tried rolling back all 4 n8n containers to 2 weeks ago and I'm still seeing redis connection timeouts and the UI error "Cannot GET /projects/wfVfXkYfvphTp1eX/workflows"


3 months ago

This is very frustrating. Can anyone help?


This isn't recommended but is n8n able to connect to Redis (and/or Postgres if applicable) through the public URL?


3 months ago

I tried changing it and it still timed out.
Another thing to note is the Railway UI won't load the data from the Redis server either.
Would this indicate an infrastructure issue on the Railway side?
And I have Redeployed this as well.

1442888507147420000


Are you able to connect to Redis through a database client (eg, Datagrip)?


3 months ago

I haven't tried. But my guess would be no since nothing else in the same environment will connect to it.


3 months ago

Downloading it now to give it a try. Not confident.


3 months ago

That's a roger o Datagrid. It gets a successful ping to the public URL.


3 months ago

I have been able to connect through it also.


Are you able to write keys and values to it?


(I'd assume yes)


3 months ago

I've not used DataGrid before so I'm not sure how to test for that.


That's fine. This might be something related to Railway as you're able to connect from your local machine, I'm not too sure. This is out of my area of knowledge unfortunately. Sorry couldn't be of much help.


3 months ago

Thanks for trying @pepper . Yes, it's a bit out of my comfort zone as well.


3 months ago

UPDATE: This is obviously a Railway issue. Where are all the support folks from Railway here?
I have removed most of the QUEUEBULL related vars. I have kept QUEUEBULLREDISURL, QUEUEBULLREDISPASSWORD, and QUEUEBULLREDISTIMEOUT_THRESHOLD.
This is because I could connect from my PC and see the Redis data in DataGrid using the Public URL. The Private data connection failed in DataGrid.

So if I can connect to the data remotely, why can't Railway connect container to container?


3 months ago

Log files for Primary container showing the recurring crashes.

1443097403367620630


Note that using the private network URL will not work outside of your project. It’s only available within your Railway project.


3 months ago

Understood. But it also wasn't working within my Railway project either.

I believe I have this resolved.
I reset all of the specific QUEUE_BULL vars to the Public URL credentials and kept the QUEUE_BULL_REDIS_URL value set to the public URL.
I did this on both the Primary and Worker containers and … drum roll please … everything came up beautifully in n8n with active Workflows operational again.

I realize using the Public URL is not recommended. But this is the only way I have been able to get his working.

I would welcome some input from Railway on this and any help on getting the environment working on the latest version of n8n with the proper Redis configuration.


(Another lil reminder that you will be charged egress fees when using public URL.)


3 months ago

Hello, Railway employee here.

I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.


3 months ago

This is bullshit! It is NOT a misconfiguration. All I did was update n8n and it trashed YOUR configuration.
This was installed from your original n8n package.
I would like everyone to know this. I installed your package, and then did an update, now you want to blame me for a mis-configuration.


3 months ago

Big middle finger to you guys. Railway has just scored a major black mark in my book


3 months ago

IT IS A PLATFORM ISSUE!


3 months ago

Lazy dickheads!


3 months ago

Adjust your platform to handle potential upgrades.


3 months ago

@pepper So now I will get charged extra because their private network no longer works? Fucking idiots!


3 months ago

@Brody You didn't even offer any helpful advice. If it is not a platofrm issue, why don;t you offer some suggestions about how this is misconfigured? How could this have gone from working to broken just from an update. I would really like some possible solutions to fix this problem.
I don't know how your team has set this up or why the networks connections within my container have suddenly stopped working.
Please pull your finger out of your ass and help me understand how I can fix the problem.
Thank you.


brody

Hello, Railway employee here.I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.

3 months ago

Useless reply.


brody

Hello, Railway employee here.I can confirm that this is not a platform issue; it would be a misconfiguration on your end. Unfortunately, we cannot provide support for third-party software, so I will continue to leave this to the community.

3 months ago

You didn't even offer any helpful advice. If it is not a platofrm issue, why don;t you offer some suggestions about how this is misconfigured? How could this have gone from working to broken just from an update. I would really like some possible solutions to fix this problem.
I don't know how your team has set this up or why the networks connections within my container have suddenly stopped working.
Please pull your finger out of your ass and help me understand how I can fix the problem.


Loading...