Commit graph

3884 commits

Author SHA1 Message Date
Ishaan Jaff
fc8a87efec ci/cd run again 2024-08-02 11:46:45 -07:00
Krrish Dholakia
0a30ba9674 fix(types/utils.py): support passing prompt cache usage stats in usage object
Passes deepseek prompt caching values through to end user
2024-08-02 09:30:50 -07:00
Krrish Dholakia
cd073d5ad3 test: handle anthropic rate limit error 2024-08-02 08:57:09 -07:00
Krish Dholakia
25ac9c2d75
Merge branch 'main' into litellm_fix_streaming_usage_calc 2024-08-01 21:29:04 -07:00
Krish Dholakia
d8778380d8
Merge pull request #5004 from BerriAI/litellm_codestral_fim_support
feat(vertex_ai_partner.py): add vertex ai codestral FIM support
2024-08-01 21:24:12 -07:00
Ishaan Jaff
7f93fa01e9 ci/cd run again 2024-08-01 19:55:12 -07:00
Ishaan Jaff
85ced920a0 fix test traceloop.py 2024-08-01 19:49:53 -07:00
Ishaan Jaff
95986b790d ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 18:07:14 -07:00
Ishaan Jaff
c2f25167fe fix test_traceparent_not_added_by_default 2024-08-01 18:07:14 -07:00
Ishaan Jaff
7e79adc614 delete object from gcs 2024-08-01 18:07:14 -07:00
Ishaan Jaff
b0db38ce0a test writing logs to GCS bucket 2024-08-01 18:07:14 -07:00
Ishaan Jaff
f0e23a2f41 basic gcs logging test 2024-08-01 18:07:14 -07:00
Ishaan Jaff
1a598ff075 ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 18:06:40 -07:00
Ishaan Jaff
98c8409e02 fix test_traceparent_not_added_by_default 2024-08-01 18:06:40 -07:00
Ishaan Jaff
21192b7de9 delete object from gcs 2024-08-01 18:06:40 -07:00
Ishaan Jaff
6e9f84f161 test writing logs to GCS bucket 2024-08-01 18:06:40 -07:00
Ishaan Jaff
6b8d3a745e basic gcs logging test 2024-08-01 18:06:40 -07:00
Krrish Dholakia
6e163d3c8a fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 18:06:40 -07:00
Krrish Dholakia
f04160df46 fix(google.py): fix cost tracking for vertex ai mistral models 2024-08-01 18:06:40 -07:00
Ishaan Jaff
80831ce73f ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 17:58:48 -07:00
Krrish Dholakia
0300690bd6 fix: fix linting errors 2024-08-01 17:35:05 -07:00
Ishaan Jaff
da036a049a fix test_traceparent_not_added_by_default 2024-08-01 17:16:06 -07:00
Krrish Dholakia
010d5ed81d feat(vertex_ai_partner.py): add vertex ai codestral FIM support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 17:10:27 -07:00
Ishaan Jaff
cf4e48da5f
Merge pull request #4999 from BerriAI/litellm_add_gcs_bucket_support
[Enterprise Proxy Feature] - Log to GCS Bucket 
2024-08-01 16:22:42 -07:00
Krrish Dholakia
246b3227a9 fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Krrish Dholakia
1ffd96b348 fix(google.py): fix cost tracking for vertex ai mistral models 2024-08-01 15:22:32 -07:00
Krrish Dholakia
28c12e6702 fix(utils.py): fix togetherai streaming cost calculation 2024-08-01 15:03:08 -07:00
Krrish Dholakia
ca0a0bed46 fix(utils.py): fix anthropic streaming usage calculation
Fixes https://github.com/BerriAI/litellm/issues/4965
2024-08-01 14:45:54 -07:00
Ishaan Jaff
5962267bf5 delete object from gcs 2024-08-01 14:25:25 -07:00
Ishaan Jaff
877836afcf test writing logs to GCS bucket 2024-08-01 13:58:42 -07:00
Ishaan Jaff
40e062b13a basic gcs logging test 2024-08-01 13:33:17 -07:00
Ishaan Jaff
dce8e3efb8 testing fix - skip rate limit errors from anthropic api 2024-08-01 12:12:50 -07:00
Ishaan Jaff
c87f97bf6d
Merge pull request #4995 from BerriAI/litellm_otel_fwd_traceparent
[Fix-OTEL Proxy] Only forward traceparent to llm api when `litellm.forward_traceparent_to_llm_provider=True`
2024-08-01 11:57:35 -07:00
Ishaan Jaff
d12578e4ea test_traceparent_not_added_by_default 2024-08-01 09:36:09 -07:00
Krrish Dholakia
b6b86b2df4 fix(anthropic.py): respect timeouts
Fixes https://github.com/BerriAI/litellm/pull/4994
2024-08-01 09:16:19 -07:00
Krrish Dholakia
83f638100e test: handle predibase api failures 2024-07-31 19:39:58 -07:00
Ishaan Jaff
289b468aa1 try / except rate limit errors 2024-07-31 17:42:58 -07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Krrish Dholakia
09ee8c6e2d fix(utils.py): return additional kwargs from openai-like response body
Closes https://github.com/BerriAI/litellm/issues/4981
2024-07-31 15:37:03 -07:00
Krrish Dholakia
bd68714f51 fix(utils.py): map cohere timeout error 2024-07-31 15:15:18 -07:00
Krrish Dholakia
6202f9bbb0 fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Ishaan Jaff
4e7d9d2bb1 fix test_completion_function_plus_pdf 2024-07-31 13:53:06 -07:00
Krrish Dholakia
6974b45c75 test: fix testing 2024-07-31 11:50:03 -07:00
Ishaan Jaff
a5ce084a2c fix test_team_disable_guardrails 2024-07-31 11:49:10 -07:00
Ishaan Jaff
bcc4adff46 fix test_team_disable_guardrails 2024-07-31 11:48:36 -07:00
David Manouchehri
507529e8df
(test_bedrock_completion.py) - Use FIPS endpoints for testing. 2024-07-31 16:51:58 +00:00
David Manouchehri
ffbe1845ef
(bedrock_httpx.py) - Add support for custom STS endpoints, e.g. for FIPS. 2024-07-31 16:51:52 +00:00
Ishaan Jaff
7db85fbdb7 fix predibase mock test 2024-07-31 08:16:24 -07:00
Ishaan Jaff
1b6bf48264 ci/cd run again 2024-07-30 22:55:46 -07:00
Ishaan Jaff
54e1f18832 use timeouts for predibase - never use them in prod ! 2024-07-30 22:54:01 -07:00