ChromaDB
dev
MODERATOROP

2 years ago

Description: The AI-native embedding database

Category: Storage

URL: https://railway.app/template/kbvIRV

8 Replies

yungprtymfk
HOBBY

2 years ago

Hi there! I changed host to 0.0.0.0, but I'm not able to access the service from my local machine. Please help.

When I run docker image with Chroma locally and request through Postman: GET http://0.0.0.0:8000/api/v1, I get code 200 response. But when requesting GET https://chroma-dev-123.up.railway.app/api/v1, I receive 503 - Service unavailable.


brody
EMPLOYEE

2 years ago

Ah yes, fragly forgot a very important setting.

https://help.railway.app/questions/connection-errors-with-chroma-template-6ab3976f#solution


dev
MODERATOROP

2 years ago

Thanks for flagging, I've implemented the missing setting! 🤣


yungprtymfk
HOBBY

2 years ago

Thanks a lot guys! It works! But FYI: 1) using $PORT param in uvicorn command does not work, because it passes string and not number. 2) Chroma is actually running without any Authorization and is accessible just by url.


dev
MODERATOROP

2 years ago

Chroma should be running with authorization 🤔

I just ran through the docs again and I believe that the template is properly set up in accordance with the docs (https://docs.trychroma.com/deployment/auth). I'll make a new deployment of the template later and see if I can reproduce


brody
EMPLOYEE

2 years ago

I updated the solution in my previously linked post to hopefully fix the PORT issue.


dev
MODERATOROP

2 years ago

Thanks brody, updated the template accordingly!


alexprotonotarios
PRO

3 months ago

I note that as the service is being used memory usage keeps creeping up (started from 1 GB and currently at 6GB after 2 weeks). Is that expected or some memory leak? If vectors are kept in memory after upload, wouldnt they be cleared at some point?

Edit: Apologies I have noted that these are known issues with chroma. See: https://github.com/chroma-core/chroma/issues/4024

I guess for now this can be mitigated by restarting it once in a while.


Loading...