5 commits

Author	SHA1	Message	Date
Ishaan Jaff	0b51712aab	mark test as flaky	2024-09-02 19:44:28 -07:00
Krish Dholakia	f9e6507cd1	LiteLLM Minor Fixes + Improvements (#5474) ... * feat(proxy/_types.py): add lago billing to callbacks ui Closes https://github.com/BerriAI/litellm/issues/5472 * fix(anthropic.py): return anthropic prompt caching information Fixes https://github.com/BerriAI/litellm/issues/5364 * feat(bedrock/chat.py): support 'json_schema' for bedrock models Closes https://github.com/BerriAI/litellm/issues/5434 * fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models * fix: linting fixes * fix: handle key errors * fix(bedrock/chat.py): fix bedrock ai21 streaming object * feat(bedrock/embed): support bedrock embedding optional params * fix(databricks.py): fix usage chunk * fix(internal_user_endpoints.py): apply internal user defaults, if user role updated Fixes issue where user update wouldn't apply defaults * feat(slack_alerting.py): provide multiple slack channels for a given alert type multiple channels might be interested in receiving an alert for a given type * docs(alerting.md): add multiple channel alerting to docs	2024-09-02 14:29:57 -07:00
Krrish Dholakia	d43441ae5d	fix(anthropic.py): support setting cache control headers, automatically ... Don't require user to manually pass in 'extra_headers' for anthropic cache control usage	2024-08-27 13:57:03 -07:00
Ishaan Jaff	78a2013e51	add test for large context in system message for anthropic	2024-08-14 17:03:10 -07:00
Ishaan Jaff	76a5f5d433	move claude prompt caching to diff file	2024-08-14 16:28:12 -07:00