Commit graph

16623 commits

Author SHA1 Message Date
Ishaan Jaff
86818ddffc comment on using boto3 2024-08-13 20:28:40 -07:00
Ishaan Jaff
6f7b204294 docs - set litellm config as s3 object 2024-08-13 20:26:29 -07:00
Krrish Dholakia
742e3cbccf feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Ishaan Jaff
4e7b0ce76e feat read config from s3 2024-08-13 20:18:59 -07:00
Ishaan Jaff
1475ae59f3 add helper to load config from s3 2024-08-13 20:16:54 -07:00
David Manouchehri
9617e578f3
(models): Add chatgpt-4o-latest. 2024-08-14 03:03:22 +00:00
Artem Zemliak
5290490106
Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
Ishaan Jaff
fef6f50e23 fic docker file to run in non root model 2024-08-13 19:29:40 -07:00
Krrish Dholakia
66d77f177f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Ishaan Jaff
353b470cbc fix prisma issues 2024-08-13 19:17:01 -07:00
Ishaan Jaff
b8e5b25dcc
Merge pull request #5184 from fozziethebeat/fix-vllm-docs
Improving the proxy docs for configuring with vllm
2024-08-13 18:47:01 -07:00
Ishaan Jaff
c7804e1ea2 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff
2de276cb44 temp set prisma pems 2024-08-13 18:40:00 -07:00
Ishaan Jaff
ab7758840b skip prisma gen step 2024-08-13 18:38:10 -07:00
Ishaan Jaff
4159897570
Merge pull request #5187 from BerriAI/litellm_handle_session_expired_ui
[Feat-UI] - Handle session expired on UI
2024-08-13 17:15:23 -07:00
Ishaan Jaff
d85762b32f ui - handle session expired on ui 2024-08-13 17:09:56 -07:00
Ishaan Jaff
2c0f4c9865 fix make prisma readable 2024-08-13 16:57:19 -07:00
Krrish Dholakia
cdce13434e fix(teams.tsx): add team_id to team table on ui 2024-08-13 16:08:49 -07:00
Keith Stevens
17c6a4e532 Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
Ishaan Jaff
063fb380e1
Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00
Ishaan Jaff
d0e6ca659f add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Ishaan Jaff
b94c982ec9 use _check_valid_ip 2024-08-13 15:41:01 -07:00
Ishaan Jaff
0c6c350c23 feat log use_x_forwarded_for 2024-08-13 15:22:54 -07:00
Krrish Dholakia
a9a3282031 fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
ab208eb546 check use_x_forwarded_for 2024-08-13 15:18:24 -07:00
Krrish Dholakia
3a1b3227d8 fix(utils.py): ignore none chunk in stream infinite loop check
Fixes https://github.com/BerriAI/litellm/issues/5158#issuecomment-2287156946
2024-08-13 15:06:44 -07:00
Ishaan Jaff
b24da18d2d
Merge pull request #5180 from BerriAI/litellm_allow_controlling_logged_tags_langfuse
[Feat-Proxy+langfuse] LiteLLM-specific Tags on Langfuse - `cache_hit`, `cache_key`
2024-08-13 13:50:01 -07:00
Krrish Dholakia
7e99cfe938 docs(user_keys.md): cleanup instructor docs 2024-08-13 13:15:46 -07:00
Krrish Dholakia
ac8c0ecd85 docs(user_keys.md): cleanup docs 2024-08-13 13:14:27 -07:00
Ishaan Jaff
81680d6b1a docs control langfuse specific tags 2024-08-13 12:48:42 -07:00
Ishaan Jaff
82dd3fcc73 add langfuse_default_tags 2024-08-13 12:28:28 -07:00
Ishaan Jaff
f1df555c79 allow using langfuse_default_tags 2024-08-13 12:26:37 -07:00
Ishaan Jaff
42bd5de7c0 feat allow controlling logged tags on langfuse 2024-08-13 12:24:01 -07:00
Krrish Dholakia
526b196f83 fix(bedrock_httpx.py): handle empty stop string 2024-08-13 07:30:30 -07:00
Krrish Dholakia
6e8d2856b0 fix(bedrock_httpx.py): handle bedrock empty system message 2024-08-13 07:17:17 -07:00
Krrish Dholakia
b1cf46faaa fix(langfuse.py'): cleanup 2024-08-12 23:22:29 -07:00
Krish Dholakia
375dbecb86
Merge branch 'main' into litellm_key_logging 2024-08-12 23:17:21 -07:00
Krrish Dholakia
93a1335e46 fix(litellm_pre_call_utils.py): support routing to logging project by api key 2024-08-12 21:21:40 -07:00
Krrish Dholakia
718c2cfa4e docs(team_logging.md): cleanup docs 2024-08-12 19:53:05 -07:00
Krrish Dholakia
f322ffc413 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 19:35:07 -07:00
Ishaan Jaff
049f3e1e0c fix gcs logging test 2024-08-12 19:35:07 -07:00
Ishaan Jaff
86978b7a9b fix gcs test 2024-08-12 19:35:07 -07:00
Ishaan Jaff
3dfe2bfd85 tes logging to gcs buckets 2024-08-12 19:35:07 -07:00
Ishaan Jaff
6ddd86abab feat log responses in folders 2024-08-12 19:35:02 -07:00
Ishaan Jaff
de9bd4abe6 test gcs logging payload 2024-08-12 19:35:02 -07:00
Ishaan Jaff
5569e8790a feat gcs log user api key metadata 2024-08-12 19:34:45 -07:00
Krrish Dholakia
d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Ravi N
97cf32630d remove aws_sagemaker_allow_zero_temp from the parameters passed to inference 2024-08-12 21:09:50 -04:00
Ishaan Jaff
66c0d32b1d fix gcs logging test 2024-08-12 17:42:04 -07:00
Krrish Dholakia
c9ea8cdf41 fix(cost_calculator.py): fix cost calc 2024-08-12 16:49:51 -07:00