Commit graph

3040 commits

Author SHA1 Message Date
Krish Dholakia
b6e0bf27b8
Merge branch 'main' into litellm_aws_kms_support 2024-06-07 07:58:56 -07:00
Krrish Dholakia
ff5136f5ed test(test_completion.py): fix test to use mock response - prevent hang 2024-06-07 07:05:32 -07:00
Krrish Dholakia
ddc82774b0 test(test_completion.py): fix replicate test which was hanging 2024-06-06 22:17:30 -07:00
Krrish Dholakia
51ba5652a0 feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
a995a0b172 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Krrish Dholakia
6e9bca59b0 fix(utils.py): fix exception mapping for azure internal server error 2024-06-06 17:12:30 -07:00
Krrish Dholakia
09a471da10 test(test_assistants.py): add more error logging 2024-06-06 16:43:12 -07:00
Krish Dholakia
1742141fb6
Merge pull request #4046 from BerriAI/litellm_router_order
feat(router.py): enable settting 'order' for a deployment in model list
2024-06-06 16:37:03 -07:00
Raymond Huang
968f54a65c test 2024-06-06 10:11:27 -07:00
Krrish Dholakia
a7dcf25722 feat(router.py): enable settting 'order' for a deployment in model list
Allows user to control which model gets called first in model group
2024-06-06 09:46:51 -07:00
Ishaan Jaff
73d66e94c5 test - enforce params 2024-06-06 09:22:12 -07:00
Ishaan Jaff
2e95758ada ci/cd run again 2024-06-05 21:58:59 -07:00
Ishaan Jaff
27db329621 fix - test lowest cost routing 2024-06-05 21:42:41 -07:00
Krrish Dholakia
a76a9b7d11 feat(bedrock_httpx.py): add support for bedrock converse api
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
Krrish Dholakia
b360ab4c89 fix(azure.py): support dynamic drop params 2024-06-05 09:03:10 -07:00
Krrish Dholakia
162f9400d2 feat(utils.py): support dynamically setting 'drop_params'
Allows user to turn this on/off for individual calls by passing in as a completion arg
2024-06-05 08:44:04 -07:00
Ishaan Jaff
39f4f1728f fix ci/cd OTEL callback test 2024-06-04 21:27:34 -07:00
Krish Dholakia
c544ba3654
Merge pull request #4009 from BerriAI/litellm_fix_streaming_cost_cal
fix(utils.py): fix cost calculation for openai-compatible streaming object
2024-06-04 21:00:22 -07:00
Krish Dholakia
d6f4233441
Merge pull request #4015 from BerriAI/litellm_stream_options_fix_2
feat(utils.py): Support `stream_options` param across all providers
2024-06-04 20:59:39 -07:00
Krish Dholakia
2d9a251147
Merge pull request #4012 from BerriAI/litellm_assistants_streaming
feat(assistants/main.py): add assistants api streaming support
2024-06-04 20:58:02 -07:00
Krrish Dholakia
1a95660495 fix(test_completion.py): fix predibase test to be mock + fix optional param mapping for predibase 2024-06-04 20:06:23 -07:00
Krrish Dholakia
43af5575c8 fix(utils.py): fix 2024-06-04 19:41:20 -07:00
Krrish Dholakia
54dacfdf61 feat(utils.py): support 'stream_options' param across all providers
Closes https://github.com/BerriAI/litellm/issues/3553
2024-06-04 19:03:26 -07:00
Krrish Dholakia
9aa29854de fix(utils.py): fix stream options to return consistent response object 2024-06-04 18:17:45 -07:00
Krrish Dholakia
15b226ca4f test(test_completion_cost.py): cleanup test 2024-06-04 16:57:25 -07:00
Krrish Dholakia
650ea6d0c3 feat(assistants/main.py): support arun_thread_stream 2024-06-04 16:47:51 -07:00
Krrish Dholakia
f3d78532f9 feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Ishaan Jaff
48f399bcc4 fix - otel logging test 2024-06-04 15:01:56 -07:00
Ishaan Jaff
8369988579 ci/cd run again 2024-06-04 14:42:27 -07:00
Ishaan Jaff
c5dd47e71b better debugging on otel callback 2024-06-04 14:41:07 -07:00
Krrish Dholakia
52a2f5150c fix(utils.py): fix cost calculation for openai-compatible streaming object 2024-06-04 10:36:25 -07:00
Ishaan Jaff
009c63f194
Merge pull request #3974 from yujonglee/simple-otel
Add simple OpenTelemetry tracer
2024-06-04 08:30:28 -07:00
Ishaan Jaff
97c82225b1 test fix - test_acompletion_caching_on_router 2024-06-04 07:55:53 -07:00
Krrish Dholakia
8625280c32 test(test_image_generation.py): fix azure dall e test 2024-06-03 23:32:19 -07:00
Krrish Dholakia
8ebae96008 test(test_completion.py): fix test 2024-06-03 23:10:54 -07:00
Krrish Dholakia
a804dfd1b6 test(test_assistants.py): rename test to run earlier in ci pipeline 2024-06-03 22:45:16 -07:00
Krrish Dholakia
90afdd265b test(test_completion.py): fix testing to retry 2024-06-03 22:43:22 -07:00
Ishaan Jaff
fd1a2a90bf ci/cd run again 2024-06-03 22:03:39 -07:00
yujonglee
2f81f8f2df simple test 2024-06-04 13:56:28 +09:00
Krrish Dholakia
7c1e2bf01c test(test_completion.py): fix test 2024-06-03 21:40:32 -07:00
Krrish Dholakia
3d39d23f24 test(test_clarifai_completion.py): skip clarifai tests - account rate limited 2024-06-03 21:07:57 -07:00
Krish Dholakia
5ee3b0f30f
Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support
feat(assistants/main.py): Azure Assistants API support
2024-06-03 21:05:03 -07:00
Krrish Dholakia
7163bce37b feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
yujonglee
0d8a7d5cf0 use inmemory exporter for testing 2024-06-04 09:04:19 +09:00
Krrish Dholakia
5f99938cb8 test(test_amazing_vertex_completion.py): add retries for 'Content has no parts.' error in vertex test 2024-06-03 14:06:36 -07:00
Krrish Dholakia
a019fd05e3 fix(router.py): fix should_retry logic for authentication errors 2024-06-03 13:12:00 -07:00
yujonglee
c5e9e89288 remove mocks 2024-06-02 19:49:34 +09:00
Ishaan Jaff
a01746c19e fix test_daily_reports_redis_cache_scheduler 2024-06-01 21:00:24 -07:00
Ishaan Jaff
2f9dac6238 test - test gpt-3.5-turbo on test_parallel_streaming_requests 2024-06-01 20:56:33 -07:00
Krrish Dholakia
9ef83126d7 fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00