Cant run my fastapi server on railway
spotcalendar
HOBBYOP

a year ago

trying to run the prompt chunker service on railway but it fails to start,

Solved

23 Replies

spotcalendar
HOBBYOP

a year ago

ccb57578-3010-4835-bb4c-2018b5b7f683


a year ago

it's likely that you are running into the 500mb memory limit on the Trial plan


spotcalendar
HOBBYOP

a year ago

so i should upgrade it ig


spotcalendar
HOBBYOP

a year ago

to 5$ plan


spotcalendar
HOBBYOP

a year ago

i hae one query which is

how is more fees added afterwards ?


a year ago

With the hobby plan, you get $5 worth of usage included every month. You will pay for the amount of resources used during the billing cycle (one month), you only pay $5 (the cost of the hobby plan) if you usage is <= $5, think of it as a $5 minimum spend.


spotcalendar
HOBBYOP

a year ago

i boguth the hobby plan


spotcalendar
HOBBYOP

a year ago

seeing if this works now


a year ago

You will need to redeploy all your services for the new limits to apply


spotcalendar
HOBBYOP

a year ago

in local takes 68s

1359588107069948000


spotcalendar
HOBBYOP

a year ago

68ms


spotcalendar
HOBBYOP

a year ago

but on railway same thing takes 6-7s


spotcalendar
HOBBYOP

a year ago

any reasons why ?


spotcalendar
HOBBYOP

a year ago

i m have put like time logs, will be able to share that in a moment


a year ago

looks like you're running something that uses GPU?


spotcalendar
HOBBYOP

a year ago

yes


spotcalendar
HOBBYOP

a year ago

sentence transformers


spotcalendar
HOBBYOP

a year ago

but small text like these shouldn't take 7s


spotcalendar
HOBBYOP

a year ago

ig


a year ago

there are no GPUs on Railway, you would be running the embeddings on CPU when on Railway


spotcalendar
HOBBYOP

a year ago

so there is no way to solve the latency for this ?


a year ago

run a more CPU efficient model, or use an external AI service


a year ago

!s


Status changed to Solved brody 11 months ago


Loading...