56ecf4a7-da41-4ba0-a70c-7708dac4054f

may i ask if this is planetscale to postgres on railway?

Yes!

would you happen to know how much data you have in planetscale?

Not much, less than 1GB of data.

any reason you arent going to a mysql database on railway?

Internal needs, my team it's more familiar with Postgres now. Is this a problem?

nope just curious

how long does the connection stay alive before it dies like that?

Max 3 minutes running

does any data make it into the postgres database?

Yep

It's working, it seems to stop for a non particular reason

what pgloader command are you running?

LOAD database
     from mysql://root@localhost:3306/DATABASE
     into postgresql://postgres:PWD@HOST/railway

 WITH include drop, create tables, create indexes, reset sequences, snake_case identifiers,
      workers = 16, concurrency = 4,
      multiple readers per thread, rows per range = 50000;

I tested with 1 worker, 1 concurrency, 5k chunk. Same error… :/

if you had just deployed a postgres database on railway, it would be postgres 16, is pgloader fully compatible with that version?

Yep, just checked.

I've made once without errors when testing, but it's inconsistent

pgloader that was released in 2022 is compatible with postgres 16 that was released in 2023?

Just worked again. I plan to keep running the process until I have the final version of my data.

It seems to lost the connection when processing sometimes and pgloader does not have a mechanism to reconnect automatically.

i think this is just instabilities with pgloader, no one else has reported any issues with their database connections in a good while

I'm going with this. Much appreciate the help anyway!

sorry i couldnt get you a better solution, i just dont have any way of testing this for myself