phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16339 commits 2490 branches 894 tags 548 MiB
Commit graph

3884 commits

Author SHA1 Message Date
Krrish Dholakia
10f27bb1b5 test(test_pass_through_endpoints.py): fix langfuse base 2024-08-14 14:13:21 -07:00
Krrish Dholakia
5af9794b9d test(test_pass_through_endpoints.py): correctly reset test 2024-08-14 10:48:42 -07:00
Krrish Dholakia
6bcfa90ba8 test(test_pass_through_endpoints.py): fix test 2024-08-14 09:53:19 -07:00
Krrish Dholakia
742e3cbccf feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Krrish Dholakia
66d77f177f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Ishaan Jaff
063fb380e1
Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for 
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
 2024-08-13 16:07:31 -07:00
Ishaan Jaff
d0e6ca659f add test for test_check_valid_ip_sent_with_x_forwarded_for 2024-08-13 15:54:53 -07:00
Krrish Dholakia
3a1b3227d8 fix(utils.py): ignore none chunk in stream infinite loop check 
Fixes https://github.com/BerriAI/litellm/issues/5158#issuecomment-2287156946
 2024-08-13 15:06:44 -07:00
Krrish Dholakia
526b196f83 fix(bedrock_httpx.py): handle empty stop string 2024-08-13 07:30:30 -07:00
Krrish Dholakia
6e8d2856b0 fix(bedrock_httpx.py): handle bedrock empty system message 2024-08-13 07:17:17 -07:00
Krrish Dholakia
d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints 2024-08-12 18:48:43 -07:00
Ishaan Jaff
66c0d32b1d fix gcs logging test 2024-08-12 17:42:04 -07:00
Krrish Dholakia
ef8fb23334 fix(cost_calculator.py): fix cost calc 2024-08-12 16:47:15 -07:00
Ishaan Jaff
89e3141e2d
Merge pull request #5171 from BerriAI/litellm_log_gcs_in_folders 
[Feat] Log GCS logs in folders based on dd-m-yyyy
 2024-08-12 16:37:33 -07:00
Ishaan Jaff
6589666028 fix gcs test 2024-08-12 16:34:27 -07:00
Ishaan Jaff
3d06abb55a tes logging to gcs buckets 2024-08-12 16:33:35 -07:00
Krrish Dholakia
a8644d8a7d fix(utils.py): if openai model, don't check hf tokenizers 2024-08-12 16:28:22 -07:00
Ishaan Jaff
96f3eb99c9 test gcs logging payload 2024-08-12 16:07:08 -07:00
Krrish Dholakia
22e2840daa fix(cost_calculator.py): handle openai usage pydantic object 
Fixes https://github.com/BerriAI/litellm/issues/5165
 2024-08-12 15:45:21 -07:00
Krrish Dholakia
fdd9a07051 fix(utils.py): Break out of infinite streaming loop 
Fixes https://github.com/BerriAI/litellm/issues/5158
 2024-08-12 14:00:43 -07:00
Ishaan Jaff
1c71e4db17 fix internal user tests to pass 2024-08-12 12:11:23 -07:00
Krrish Dholakia
19bb95f781 build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map 
Closes https://github.com/BerriAI/litellm/issues/4881
 2024-08-10 14:15:12 -07:00
Ishaan Jaff
d5abcb0945
Merge pull request #5152 from BerriAI/litellm_track_latency_prometheus 
Feat - track response latency on prometheus
 2024-08-10 13:02:10 -07:00
Krish Dholakia
b7e0620039
Merge pull request #5151 from BerriAI/litellm_streaming_chunks_safe_fail 
fix(main.py): safely fail stream_chunk_builder calls
 2024-08-10 13:02:02 -07:00
Ishaan Jaff
234b4a5fbf
Merge pull request #5149 from BerriAI/litellm_add_testing_for_prometheus_metrics 
[Refactor+Testing] Refactor Prometheus metrics to use CustomLogger class + add testing for prometheus
 2024-08-10 13:01:52 -07:00
Ishaan Jaff
51ce8ba301 test for prom metrics 2024-08-10 12:56:23 -07:00
Krrish Dholakia
068ee12c30 fix(main.py): safely fail stream_chunk_builder calls 2024-08-10 10:22:26 -07:00
Ishaan Jaff
83446926af track llm_deployment_success_responses 2024-08-10 10:05:33 -07:00
Ishaan Jaff
2174801cb0 prometheus add basic testing for success 2024-08-10 09:45:12 -07:00
Krrish Dholakia
1553f7fa48 fix(types/utils.py): handle null completion tokens 
Fixes https://github.com/BerriAI/litellm/issues/5096
 2024-08-10 09:23:03 -07:00
Krish Dholakia
e1a8e6c394
Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging 
fix(litellm_logging.py): fix calling success callback w/ stream_options true
 2024-08-09 20:30:19 -07:00
Krish Dholakia
a42164fa79
Merge pull request #5143 from BerriAI/litellm_use_max_retries 
fix(utils.py): set max_retries = num_retries, if given
 2024-08-09 20:29:49 -07:00
Ishaan Jaff
3320d76dd4 ci/cd run again 2024-08-09 19:13:52 -07:00
Krrish Dholakia
a26b23a3f4 fix(litellm_logging.py): fix calling success callback w/ stream_options true 
Fixes https://github.com/BerriAI/litellm/issues/5118
 2024-08-09 18:20:42 -07:00
Ishaan Jaff
4ec1df799c
Merge pull request #5144 from BerriAI/litellm_bedrock_put_modified_tool_Call_name_in_output 
[Fix] Place bedrock modified tool call name in output
 2024-08-09 18:04:30 -07:00
Ishaan Jaff
42617c207a test bedrock tool call names 2024-08-09 17:14:56 -07:00
Krrish Dholakia
dd3d97ace6 test(test_optional_params.py): use num_retries instead of 'max_retries' if given 2024-08-09 17:02:29 -07:00
Krrish Dholakia
ba7b070883 fix(utils.py): set max_retries = num_retries, if given 2024-08-09 16:54:54 -07:00
Krrish Dholakia
9f0a05d406 fix(utils.py): only return non-null default values 2024-08-09 16:34:59 -07:00
Ishaan Jaff
6dc9b39095 test invalid tool namehandling 2024-08-09 13:26:21 -07:00
Krrish Dholakia
177f670c7d build(test_completion.py): ci/cd run again 2024-08-09 12:28:26 -07:00
Ishaan Jaff
db7897dcc0
Merge pull request #5136 from BerriAI/litellm_add_cohere_embedding_models 
ui allow adding cohere models
 2024-08-09 12:19:19 -07:00
Krrish Dholakia
7b6db63d30 fix(router.py): fallback on 400-status code requests 2024-08-09 12:16:49 -07:00
Ishaan Jaff
df024fbbbc add testing for cohere embeddings 2024-08-09 12:08:25 -07:00
Krrish Dholakia
0cf81eba62 fix(huggingface_restapi.py): support passing 'wait_for_model' param on completion calls 2024-08-09 09:25:19 -07:00
Krrish Dholakia
466dc9f32a fix(huggingface_restapi.py): fix hf embeddings optional param processing 2024-08-09 09:10:56 -07:00
Krrish Dholakia
51ccfa9e77 fix(huggingface_restapi.py): fixes issue where 'wait_for_model' was not being passed as expected 2024-08-09 08:36:35 -07:00
Krrish Dholakia
a4e9512e98 test: skip flaky langsmith tests 2024-08-08 23:25:42 -07:00
Krrish Dholakia
f6097d54ff test(test_langsmith.py): fix test 2024-08-08 23:25:42 -07:00
Ishaan Jaff
bf01d4f092 handle anthropic internal server errors 2024-08-08 23:25:27 -07:00