Commit graph

38 commits

Author SHA1 Message Date
Krish Dholakia
72e961af3c
LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567)
* fix(utils.py): return citations for perplexity streaming

Fixes https://github.com/BerriAI/litellm/issues/5535

* fix(anthropic/chat.py): support fallbacks for anthropic streaming (#5542)

* fix(anthropic/chat.py): support fallbacks for anthropic streaming

Fixes https://github.com/BerriAI/litellm/issues/5512

* fix(anthropic/chat.py): use module level http client if none given (prevents early client closure)

* fix: fix linting errors

* fix(http_handler.py): fix raise_for_status error handling

* test: retry flaky test

* fix otel type

* fix(bedrock/embed): fix error raising

* test(test_openai_batches_and_files.py): skip azure batches test (for now) quota exceeded

* fix(test_router.py): skip azure batch route test (for now) - hit batch quota limits

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* All `model_group_alias` should show up in `/models`, `/model/info` , `/model_group/info` (#5539)

* fix(router.py): support returning model_alias model names in `/v1/models`

* fix(proxy_server.py): support returning model alias'es on `/model/info`

* feat(router.py): support returning model group alias for `/model_group/info`

* fix(proxy_server.py): fix linting errors

* fix(proxy_server.py): fix linting errors

* build(model_prices_and_context_window.json): add amazon titan text premier pricing information

Closes https://github.com/BerriAI/litellm/issues/5560

* feat(litellm_logging.py): log standard logging response object for pass through endpoints. Allows bedrock /invoke agent calls to be correctly logged to langfuse + s3

* fix(success_handler.py): fix linting error

* fix(success_handler.py): fix linting errors

* fix(team_endpoints.py): Allows admin to update team member budgets

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-09-06 17:16:24 -07:00
Krish Dholakia
f458f565af
Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
2024-08-23 20:42:35 -07:00
Ognjen Francuski
765e020e75 Update handling of 'litellm.ssl_verify' in HTTP handlers to allow for custom, self-signed certificates. 2024-08-20 10:16:03 +02:00
Haadi Rakhangi
c6716673c1 added put method in http_handler 2024-08-19 21:10:18 +05:30
Haadi Rakhangi
7f1c3f5edf implemented RestAPI and added support for cloud and local Qdrant clusters 2024-08-19 20:46:30 +05:30
Ishaan Jaff
5962267bf5 delete object from gcs 2024-08-01 14:25:25 -07:00
Krrish Dholakia
6202f9bbb0 fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Krrish Dholakia
c583cbdbcd fix: fix linting errors 2024-07-31 07:19:45 -07:00
Ishaan Jaff
82e5ea059b fix predibase timeout exceptions 2024-07-30 22:52:08 -07:00
Ishaan Jaff
da494da12c support timeouts on http handler 2024-07-30 22:49:00 -07:00
David Manouchehri
54e0b29079
feat(httpx): Send litellm version upstream. 2024-07-08 05:40:32 +00:00
Krrish Dholakia
7210fe6926 fix(http_handler.py): cleanup custom mounting logic 2024-07-04 15:32:50 -07:00
Krrish Dholakia
8571cb45e8 fix(http_handler.py): add retry logic for httpx.ConnectError 2024-06-28 22:35:26 -07:00
Krrish Dholakia
c151a1d244 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krrish Dholakia
a7122f91a1 fix(support-'alt=sse'-param): Fixes https://github.com/BerriAI/litellm/issues/4459 2024-06-28 10:40:47 -07:00
Ishaan Jaff
38995def54 refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Krrish Dholakia
46d57526c4 fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Krrish Dholakia
d45db9a5a2 fix(http_handler.py): retry on httpx connection errors
Fixes https://github.com/BerriAI/litellm/issues/4097
2024-06-13 12:54:58 -07:00
Krrish Dholakia
35e4323095 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
5d3674b63d fix(main.py): fix typing for image gen response 2024-06-04 08:29:30 -07:00
Krrish Dholakia
a16a1c407a fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
f1ce7bb300 fix(http_handler.py): add bool check for os.getenv verif ssl value 2024-06-01 14:07:41 -07:00
Krrish Dholakia
22a0c400dd fix(http_handler.py): support verify_ssl=False when using httpx client 2024-06-01 13:56:45 -07:00
Krrish Dholakia
93c3635b64 fix: fix streaming with httpx client
prevent overwriting streams in parallel streaming calls
2024-05-31 10:55:18 -07:00
Krrish Dholakia
324bf027f5 fix(anthropic.py): fix parallel streaming on anthropic.py
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Krrish Dholakia
d2229dcd21 feat(databricks.py): adds databricks support - completion, async, streaming
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Krrish Dholakia
64650c0279 feat(bedrock_httpx.py): working bedrock command-r sync+async streaming 2024-05-11 19:39:51 -07:00
Krrish Dholakia
59c8c0adff feat(bedrock_httpx.py): working cohere command r async calls 2024-05-11 15:04:38 -07:00
Krrish Dholakia
62a8bf134f fix(http_handler.py): fix linting error 2024-04-19 15:45:24 -07:00
Josh Mandel
f411443e58 fix: Stream completion responses from anthropic. (Fix 3129) 2024-04-19 16:13:19 -05:00
Krrish Dholakia
26286a54b8 fix(anthropic_text.py): add support for async text completion calls 2024-04-15 08:15:00 -07:00
Ishaan Jaff
9be250c0f0 add exit and aenter 2024-04-06 19:27:26 -07:00
Ishaan Jaff
5c796b4365 async streaming anthropic 2024-04-06 17:53:06 -07:00
Ishaan Jaff
58c4b02447 feat - make anthropic async 2024-04-06 15:50:13 -07:00
Krrish Dholakia
1d341970ba feat(vertex_ai_anthropic.py): add claude 3 on vertex ai support - working .completions call
.completions() call works
2024-04-02 22:07:39 -07:00
Krrish Dholakia
05029fdcc7 feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai 2024-03-23 15:53:04 -07:00