litellm-mirror/litellm/proxy/vertex_ai_endpoints
Krish Dholakia da77706c26
Litellm stable dev (#5711)
* feat(aws_base_llm.py): prevents recreating boto3 credentials during high traffic

Leads to 100ms perf boost in local testing

* fix(base_aws_llm.py): fix credential caching check to see if token is set

* refactor(bedrock/chat): separate converse api and invoke api + isolate converse api transformation logic

Make it easier to see how requests are transformed for /converse

* fix: fix imports

* fix(bedrock/embed): fix reordering of headers

* fix(base_aws_llm.py): fix get credential logic

* fix(converse_handler.py): fix ai21 streaming response
2024-09-14 23:22:59 -07:00
..
google_ai_studio_endpoints.py Litellm stable dev (#5711) 2024-09-14 23:22:59 -07:00
langfuse_endpoints.py feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints 2024-08-19 17:58:39 -07:00
vertex_endpoints.py fix case when gemini is used 2024-09-10 17:06:45 -07:00