Cant run my fastapi server on railway
spotcalendar
HOBBYOP

10 months ago

trying to run the prompt chunker service on railway but it fails to start,

Solved

23 Replies

spotcalendar
HOBBYOP

10 months ago

ccb57578-3010-4835-bb4c-2018b5b7f683


brody
EMPLOYEE

10 months ago

it's likely that you are running into the 500mb memory limit on the Trial plan


spotcalendar
HOBBYOP

10 months ago

so i should upgrade it ig


spotcalendar
HOBBYOP

10 months ago

to 5$ plan


spotcalendar
HOBBYOP

10 months ago

i hae one query which is

how is more fees added afterwards ?


uxuz
MODERATOR

10 months ago

With the hobby plan, you get $5 worth of usage included every month. You will pay for the amount of resources used during the billing cycle (one month), you only pay $5 (the cost of the hobby plan) if you usage is <= $5, think of it as a $5 minimum spend.


spotcalendar
HOBBYOP

10 months ago

i boguth the hobby plan


spotcalendar
HOBBYOP

10 months ago

seeing if this works now


adam
MODERATOR

10 months ago

You will need to redeploy all your services for the new limits to apply


spotcalendar
HOBBYOP

10 months ago

in local takes 68s

1359588107069948000


spotcalendar
HOBBYOP

10 months ago

68ms


spotcalendar
HOBBYOP

10 months ago

but on railway same thing takes 6-7s


spotcalendar
HOBBYOP

10 months ago

any reasons why ?


spotcalendar
HOBBYOP

10 months ago

i m have put like time logs, will be able to share that in a moment


brody
EMPLOYEE

10 months ago

looks like you're running something that uses GPU?


spotcalendar
HOBBYOP

10 months ago

yes


spotcalendar
HOBBYOP

10 months ago

sentence transformers


spotcalendar
HOBBYOP

10 months ago

but small text like these shouldn't take 7s


spotcalendar
HOBBYOP

10 months ago

ig


brody
EMPLOYEE

10 months ago

there are no GPUs on Railway, you would be running the embeddings on CPU when on Railway


spotcalendar
HOBBYOP

10 months ago

so there is no way to solve the latency for this ?


brody
EMPLOYEE

10 months ago

run a more CPU efficient model, or use an external AI service


brody
EMPLOYEE

10 months ago

!s


Status changed to Solved brody 10 months ago


Loading...