Cannot connect to ChromaDB service

nedwize
HOBBY

a year ago

I have a NodeJS, Express server which connects to ChromaDB instance using private networking. But the connection gets refused when the webserver tries to connect to the ChromaDB instance. I've tried setting the custom startup command on the ChromaDB instance to be

  • uvicorn [chromadb.app](chromadb.app):app --workers 1 --host :: --port 8000 --proxy-headers --log-config chromadb/log_config.yml --timeout-keep-alive 30

But it doesn't work.

7 Replies

a year ago

Please share the URL that you are using in your app to connect to the chromadb instance.


princerumi
PRO

a year ago

Hi Brody,

I am new to Railway and have deployed my Chroma instance here. I followed your conversation in this thread and tried using the following custom start command:
uvicorn chromadb.app:app --workers 1 --host chroma.railway.internal --port 8000 --proxy-headers --log-config chromadb/log_config.yml --timeout-keep-alive 30

My server is up and running, but I'm unsure how to access it from my application as well as my local system. Could you provide some guidance on this?


a year ago

That is not the start command I gave in the thread you linked, please use the correct start command i have previously provided.

And please read through everything else I had said in that big message I sent.


nedwize
HOBBY

a year ago

Hi Brody,

This is the URL that I'm using to connect - http://chroma.railway.internal:8000


a year ago

Make sure you are using the correct start command for chroma


nedwize
HOBBY

a year ago

I tweaked the start command a bit and it started working. The problem is that I cannot use an alpine based image because the package chromadb-default-embed crashes on using alpine. (I get the error - Error: Error loading shared library ld-linux-aarch64.so.1: No such file or directory)

On searching more about this I found that this is an alpine problem so I tried with node:18-buster and node:bookworm but both fail to connect to Chroma. Note that I've added ENABLE_ALPINE_PRIVATE_NETWORKING=true variable but it doesn't matter, even removing it does not work.

Will be very helpful if you could point me to a better direction here.


a year ago

I'm really not sure why you are having troubles, my instructions in the thread you linked have worked for multiple users.