Commit graph

41 commits

Author SHA1 Message Date
Ishaan Jaff
d0af5abdbf fix linting error 2024-09-10 13:29:02 -07:00
Ishaan Jaff
0d6081e370 pass llm provider when creating async httpx clients 2024-09-10 11:51:42 -07:00
Ishaan Jaff
93c1db4a79 rename get_async_httpx_client 2024-09-10 10:38:01 -07:00
Krish Dholakia
2cab33b061 LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567)
* fix(utils.py): return citations for perplexity streaming

Fixes https://github.com/BerriAI/litellm/issues/5535

* fix(anthropic/chat.py): support fallbacks for anthropic streaming (#5542)

* fix(anthropic/chat.py): support fallbacks for anthropic streaming

Fixes https://github.com/BerriAI/litellm/issues/5512

* fix(anthropic/chat.py): use module level http client if none given (prevents early client closure)

* fix: fix linting errors

* fix(http_handler.py): fix raise_for_status error handling

* test: retry flaky test

* fix otel type

* fix(bedrock/embed): fix error raising

* test(test_openai_batches_and_files.py): skip azure batches test (for now) quota exceeded

* fix(test_router.py): skip azure batch route test (for now) - hit batch quota limits

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* All `model_group_alias` should show up in `/models`, `/model/info` , `/model_group/info` (#5539)

* fix(router.py): support returning model_alias model names in `/v1/models`

* fix(proxy_server.py): support returning model alias'es on `/model/info`

* feat(router.py): support returning model group alias for `/model_group/info`

* fix(proxy_server.py): fix linting errors

* fix(proxy_server.py): fix linting errors

* build(model_prices_and_context_window.json): add amazon titan text premier pricing information

Closes https://github.com/BerriAI/litellm/issues/5560

* feat(litellm_logging.py): log standard logging response object for pass through endpoints. Allows bedrock /invoke agent calls to be correctly logged to langfuse + s3

* fix(success_handler.py): fix linting error

* fix(success_handler.py): fix linting errors

* fix(team_endpoints.py): Allows admin to update team member budgets

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-09-06 17:16:24 -07:00
Krish Dholakia
6592de3ef9 Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
2024-08-23 20:42:35 -07:00
Ognjen Francuski
f9093a6432 Update handling of 'litellm.ssl_verify' in HTTP handlers to allow for custom, self-signed certificates. 2024-08-20 10:16:03 +02:00
Haadi Rakhangi
ba87dfdb60 added put method in http_handler 2024-08-19 21:10:18 +05:30
Haadi Rakhangi
9df92923d8 implemented RestAPI and added support for cloud and local Qdrant clusters 2024-08-19 20:46:30 +05:30
Ishaan Jaff
de09800ef1 delete object from gcs 2024-08-01 14:25:25 -07:00
Krrish Dholakia
368af6975a fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Krrish Dholakia
c88c689705 fix: fix linting errors 2024-07-31 07:19:45 -07:00
Ishaan Jaff
860125c45e fix predibase timeout exceptions 2024-07-30 22:52:08 -07:00
Ishaan Jaff
782b53a283 support timeouts on http handler 2024-07-30 22:49:00 -07:00
David Manouchehri
739e3a723e feat(httpx): Send litellm version upstream. 2024-07-08 05:40:32 +00:00
Krrish Dholakia
bd41a8868a fix(http_handler.py): cleanup custom mounting logic 2024-07-04 15:32:50 -07:00
Krrish Dholakia
fb4047a672 fix(http_handler.py): add retry logic for httpx.ConnectError 2024-06-28 22:35:26 -07:00
Krrish Dholakia
a765bae2b6 fix(http_handler.py): raise more detailed http status errors 2024-06-28 15:12:38 -07:00
Krrish Dholakia
66e3a4f30e fix(support-'alt=sse'-param): Fixes https://github.com/BerriAI/litellm/issues/4459 2024-06-28 10:40:47 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Krrish Dholakia
e2a3895dfc fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Krrish Dholakia
ed213ffdee fix(http_handler.py): retry on httpx connection errors
Fixes https://github.com/BerriAI/litellm/issues/4097
2024-06-13 12:54:58 -07:00
Krrish Dholakia
12ed3dc911 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
f8b5aa3df6 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
661b67e71c fix(main.py): fix typing for image gen response 2024-06-04 08:29:30 -07:00
Krrish Dholakia
69244aabf3 fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
b6843756d7 fix(http_handler.py): add bool check for os.getenv verif ssl value 2024-06-01 14:07:41 -07:00
Krrish Dholakia
500741ed08 fix(http_handler.py): support verify_ssl=False when using httpx client 2024-06-01 13:56:45 -07:00
Krrish Dholakia
3896e3e88f fix: fix streaming with httpx client
prevent overwriting streams in parallel streaming calls
2024-05-31 10:55:18 -07:00
Krrish Dholakia
ccee9e4eb1 fix(anthropic.py): fix parallel streaming on anthropic.py
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Krrish Dholakia
143a44823a feat(databricks.py): adds databricks support - completion, async, streaming
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Krrish Dholakia
68596ced04 feat(bedrock_httpx.py): working bedrock command-r sync+async streaming 2024-05-11 19:39:51 -07:00
Krrish Dholakia
5185580e3d feat(bedrock_httpx.py): working cohere command r async calls 2024-05-11 15:04:38 -07:00
Krrish Dholakia
287c4f33de fix(http_handler.py): fix linting error 2024-04-19 15:45:24 -07:00
Josh Mandel
7115f74ca6 fix: Stream completion responses from anthropic. (Fix 3129) 2024-04-19 16:13:19 -05:00
Krrish Dholakia
1cd0551a1e fix(anthropic_text.py): add support for async text completion calls 2024-04-15 08:15:00 -07:00
Ishaan Jaff
494d71b063 add exit and aenter 2024-04-06 19:27:26 -07:00
Ishaan Jaff
3c10bfb497 async streaming anthropic 2024-04-06 17:53:06 -07:00
Ishaan Jaff
32c3aab34e feat - make anthropic async 2024-04-06 15:50:13 -07:00
Krrish Dholakia
bd7040969b feat(vertex_ai_anthropic.py): add claude 3 on vertex ai support - working .completions call
.completions() call works
2024-04-02 22:07:39 -07:00
Krrish Dholakia
c328630af3 feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai 2024-03-23 15:53:04 -07:00