autodeploys not working
slicksammy
PROOP

2 months ago

When I push github it doesnt work. I have to disconnect and reconnect for it to work. Works in sandbox but not prod.

Solved

16 Replies

scanlyas
PRO

2 months ago

Same problem here.


chandrika
EMPLOYEE

2 months ago

Hi folks, we're tracking this! It's a known issue where GitHub push events aren't triggering deploys for some services. Our engineering team has identified the root cause and is working on a fix. Disconnecting and reconnecting the repo is the workaround for now, though as you've seen it only works in some environments. We'll update this thread when the fix is out


Status changed to Awaiting User Response Railway 2 months ago


2 months ago

We fixed a bug that broke GitHub connections for some services. Your staging and sandbox services have been restored automatically. For your production api and sidekiq services, the connection was created before the fix could reach them. If auto-deploy still isn't working there, please disconnect and reconnect the GitHub repo on those services and it should be good.


slicksammy
PROOP

2 months ago

ofc its not working again..good job guys


Status changed to Awaiting Railway Response Railway 2 months ago


chandrika
EMPLOYEE

2 months ago

Hey, could you please share a bit more on what exactly happened? If you could please make sure + confirm you've disconnected and reconnected the GitHub repo on those services, that would be awesome


Status changed to Awaiting User Response Railway 2 months ago


slicksammy
PROOP

2 months ago

Still not working and i disconnected and reconnected


Status changed to Awaiting Railway Response Railway about 2 months ago


slicksammy
PROOP

2 months ago

Please do not make any changes to my environment without discussion. We have had some back and forth and as is I would much rather do the manual add/remove than having some other side effects.


2 months ago

We won't.


Status changed to Awaiting User Response Railway about 2 months ago


2 months ago

We have added more logging around this. Could you please try reconnecting your source again?


slicksammy
PROOP

2 months ago

just pushed and no deploy in prod.


Status changed to Awaiting Railway Response Railway about 2 months ago


2 months ago

Right, but have you removed and re-added the GitHub source?


Status changed to Awaiting User Response Railway about 2 months ago


tamaravasey
PRO

2 months ago

I am also getting poor github-railway connectivity. I have readded the github source mutliple times, but it seems fruitless and often I end up with a worse situation, and Ive sunk a lot of time into it. have raised my own ticket but chiming in here to demonstrate it is widespread.


Status changed to Awaiting Railway Response Railway about 2 months ago


[Broadcast] Hey, Angelo here. I'm using a tool to reach out to everyone reporting this issue at once. We've been investigating why auto-deploys and PR environments silently stop triggering, and have traced it to upstream GitHub API requests not being handled gracefully on our end. We've shipped additional monitoring to measure the false positive rate and pinpoint exactly where the issue lies. We'll follow up once we land a core fix. In the meantime, disconnecting and reconnecting your repo at the service level (Settings > Source Repo) is the best workaround. Sorry for the trouble.


Status changed to Awaiting User Response Railway about 2 months ago


timomeh
EMPLOYEE

2 months ago

I'm currently investigating this. From what I can see, it looks like this fails when new GitHub App permissions are missing. We've update the permission our app needs some time ago, but it requires that you accept these new permissions.

@slicksammy (and everyone else reading this) Could you please do the following:

  1. Go into your GitHub Organization Settings. In the sidebar under "Third-Party Access", click on GitHub Apps
    1. If you have your repos in a personal GitHub Account and not an Organization, go into your Account Settings instead, and navigate to Integrations -> Applications -> Installed GitHub Apps
  2. In the list you should see "Railway App"
  3. Check if it says "Permission updates requested" next to our app.
  4. If so, click on "Review request" and approve the new permissions.
  5. Disconnect and reconnect the GitHub Repo from services that didn't auto-deploy anymore (we'll work on making this seamless)

It would be very helpful if you could tell me if it indeed says that permission updates are requested. And if you approve the new permissions, let me know and I will double check if this solves the issue.

Thanks in advance for your help!

[edit] Added step 5 to reconnect the GitHub Repo from the service. Also added info for personal GitHub Accounts vs. Organizations


tamaravasey
PRO

2 months ago

I have no request or option to update permissions.

The link that appears in Railway asking you to check permissions links to a page that is for github third party apps and doesnt have any Railway apps in there.


Status changed to Awaiting Railway Response Railway about 2 months ago


tamaravasey

I have no request or option to update permissions. The link that appears in Railway asking you to check permissions links to a page that is for github third party apps and doesnt have any Railway apps in there.

timomeh
EMPLOYEE

2 months ago

Do you see Railway App in the list of installed github apps? Railway is a GitHub Third Party app, so if it's not in the list of your organization (or your personal account, depending on if you're using an organization or your account), it means that you don't have the installation, which would explain why it's not working.

If that's the case, then:

  1. Go to https://railway.com/account
  2. Under Account Integrations -> GitHub, does it say "GitHub App Installed?"
  3. Click "Configure", ensure that you've installed the GitHub App to the correct organization or account

Status changed to Awaiting User Response Railway about 2 months ago


Railway
BOT

18 days ago

This thread has been marked as solved automatically due to a lack of recent activity. Please re-open this thread or create a new one if you require further assistance. Thank you!

Status changed to Solved Railway 18 days ago


Welcome!

Sign in to your Railway account to join the conversation.

Loading...