shared-azure-openai-tpm
PublicThis example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.
aksasp-netasp-net-coreazureazure-container-registryazure-kubernetes-serviceazure-openaiazure-openai-servicechatgptcsharp
Creat:2023-11-10T16:23:45
Update:2024-10-11T16:18:37
11
Stars
0
Stars Increase