One aspect of calling into lots of LLMs is you have lots of API keys. These are stored in environment variables like OPENAI_API_KEY, ANTHROPIC_API_KEY - you can also feed these as direct arguments in code to LiteLLM.
You can also integrate a secrets manager like AWS Secrets Manager, Azure Key Vault and Google Secret Manager.
No comments:
Post a Comment