Curious, why not use replicas?

I'm under the impression that replicas are strictly for horizontal scaling the same service. For our use case we need separate services as each has its own distinct code, env variables, etc.

Fair enough, I was without that context.

Is this a worker per customer or something?

Nope. It’s a separate service per model/provider integration that we have, since each has different code, env vars, upstream credentials, routing, etc.

Got it. What are the most services you could see yourself needing for the foreseeable future?

I think something like 200 would be good.

What workspace is this in regards to?

It's titled as follows: EmpirioLabs.ai Dev

Done! 200 services.

Thank you Brody! Really appreciate the quick help here 🙏

No problem, but I do need to mention that while I did answer you here within a few minutes, it was just out of pure luck. For support from the team when needed, you would want to open a thread on the Central Station, as Discord threads are mainly community-based and have no support SLA.

I see, thanks for the heads up!

So in short, if you need to ask something that only a team member can help with, use Central Station. If you need to ask something that a team member isn't required for, Discord is fine.