Commit graph

8190 commits

Author SHA1 Message Date
Krrish Dholakia
c9a6404263 test: reduce vertex test to avoid exhausting limits 2024-06-12 22:32:45 -07:00
Ishaan Jaff
d2ec0a66dd (ci/cd) run again 2024-06-12 22:26:15 -07:00
Ishaan Jaff
4379a35067 fix vertex test 2024-06-12 22:22:16 -07:00
Krish Dholakia
c6a4f44d76 Merge pull request #4160 from BerriAI/litellm_vertex_completion_httpx
feat(vertex_httpx.py): Support Vertex AI system messages, JSON Schema, etc.
2024-06-12 22:09:16 -07:00
Krrish Dholakia
a84021c848 test(test_amazing_vertex_completion.py): reduce vertex tests to avoid exhausting quota 2024-06-12 22:08:43 -07:00
Ishaan Jaff
e8ae825f87 ci/cd run again 2024-06-12 21:47:13 -07:00
Krrish Dholakia
ab4b1d931b fix(vertex_httpx.py): support json schema 2024-06-12 21:46:43 -07:00
Ishaan Jaff
823f908efc fix test_spend_logs_payload 2024-06-12 21:44:33 -07:00
Ishaan Jaff
b2f25b0fdb ci/cd run again 2024-06-12 21:22:04 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
e60b0e96e4 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Ishaan Jaff
f70a3cc588 ci/cd predibase is an unstable provider 2024-06-12 21:10:30 -07:00
Ishaan Jaff
bab917c71f ui - new build 2024-06-12 20:34:55 -07:00
Ishaan Jaff
a4218ca92a Merge pull request #4167 from BerriAI/litellm_add_azure_ai_litellm_ui
[UI] add Azure AI studio models on UI
2024-06-12 20:33:14 -07:00
Ishaan Jaff
994b88118b feat - add azure ai studio models on litellm ui 2024-06-12 20:28:16 -07:00
Krrish Dholakia
afebf867f6 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Ishaan Jaff
de0e37ebfb feat - litellm_model_cost_map 2024-06-12 20:03:46 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Ishaan Jaff
412632985f ui - new build 2024-06-12 19:47:58 -07:00
Ishaan Jaff
7b1a99b816 Merge pull request #4164 from BerriAI/litellm_fix_error_inernal_users_sso_saw
[Admin UI] Fix error Internal Users see when using SSO
2024-06-12 19:45:10 -07:00
Ishaan Jaff
b4274bc852 fix model hub not loading 2024-06-12 19:38:31 -07:00
Ishaan Jaff
be7340c5a9 fix - sso pass correct role for user 2024-06-12 19:37:58 -07:00
Ishaan Jaff
cc91db907b fix - error internal users see on SSO 2024-06-12 17:42:08 -07:00
Ishaan Jaff
2603f9fbca Merge pull request #4158 from BerriAI/litellm_fix_clarifai
[Fix] Add ClarifAI support for LiteLLM Proxy
2024-06-12 17:17:16 -07:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
ffba5c6299 feat - add aysnc support for clarif ai 2024-06-12 16:33:56 -07:00
Ishaan Jaff
23c466d2df feat - add async support for clarifai 2024-06-12 16:32:16 -07:00
Ishaan Jaff
9f2dc76a58 test - making mistral embedding request on proxy 2024-06-12 15:10:20 -07:00
Ishaan Jaff
dbdf102a01 feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
4d30182720 Merge pull request #4152 from BerriAI/litellm_support_vertex_text_input
[Feat] Support `task_type`, `auto_truncate` params
2024-06-12 13:25:45 -07:00
Ishaan Jaff
67938564b4 fix - comment on /user/new 2024-06-12 13:16:39 -07:00
Krish Dholakia
58fa6e0cc8 Merge pull request #3861 from Manouchehri/aks-oidc-1852
feat(util.py/azure.py): Add OIDC support when running LiteLLM on Azure + Azure Upstream caching
2024-06-12 12:47:08 -07:00
Krish Dholakia
2d701e6e63 Merge pull request #3712 from Manouchehri/oidc-bedrock-httpx-caching-part-1
Add IAM cred caching for OIDC flow
2024-06-12 12:44:58 -07:00
Ishaan Jaff
e3aa887f95 test_vertexai_embedding_embedding_latest 2024-06-12 11:00:27 -07:00
Ishaan Jaff
ccfc988d71 vertex embeddings optional_params 2024-06-12 10:56:36 -07:00
Krrish Dholakia
77328e4a28 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00
Ishaan Jaff
e525dd2226 test test_vertexai_embedding_embedding_latest 2024-06-12 10:13:48 -07:00
Ishaan Jaff
910188df8d feat - support vertex text input 2024-06-12 10:11:44 -07:00
Ishaan Jaff
1255c154bb test - support vertex ai ertexai_embedding_embedding 2024-06-12 09:32:32 -07:00
Ishaan Jaff
e4b36d71cf feat - support vertex ai dimensions 2024-06-12 09:29:51 -07:00
Ishaan Jaff
5377a16236 Merge pull request #4145 from BerriAI/litellm_add_embedding_004
[Feat] add VertexAI `vertex_ai/text-embedding-004` , `vertex_ai/text-multilingual-embedding-002 `
2024-06-12 08:51:07 -07:00
Krrish Dholakia
43e85a3993 fix(proxy/_types.py): support logging k,v pairs to spend logs with spend_logs_metadata param 2024-06-12 08:42:35 -07:00
Ishaan Jaff
f76612e4d6 add text-embedding-004 2024-06-12 08:31:37 -07:00
Ishaan Jaff
568dcf2c64 ci/cd run again 2024-06-11 23:28:09 -07:00
Ishaan Jaff
8fbb2b98f7 (ci/cd) run again 2024-06-11 23:22:43 -07:00
Ishaan Jaff
2622f33bbd ci/cd fix predibase 500 errors 2024-06-11 23:15:48 -07:00
Ishaan Jaff
1056ab1b47 (ci/cd) run again 2024-06-11 22:03:47 -07:00
Ishaan Jaff
6cc3b3048a fix new team test 2024-06-11 22:03:03 -07:00
Ishaan Jaff
206791f166 Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
[FEAT]  log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Krrish Dholakia
47cf36646e fix(__init__.py): fix linting error 2024-06-11 18:42:01 -07:00