Commit graph

2596 commits

Author SHA1 Message Date
Mehmet Bektas
64a64c68c5 update ollama test file 2024-05-05 20:25:43 -07:00
Alex Epstein
b82162832a Update support for langfuse metadata
- Added ability to set trace release, version, metadata
- Added ability to update fields during a trace continuation
- Added ability to update input and output during a trace continuation
- Wrote new test for verifying metadata is set correctly
- Small improvement to setting secret boolean, prevent unnecessary literal_eval
- Small improvements to langfuse tests
2024-05-05 14:56:36 -04:00
Krrish Dholakia
e95be13f10 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Krish Dholakia
6be20f5fc6
Merge pull request #3455 from BerriAI/litellm_assistants_support
feat(openai.py): add support for openai assistants
2024-05-04 22:21:44 -07:00
Ishaan Jaff
d4c2eb1797 fix post call rule test 2024-05-04 22:04:53 -07:00
Ishaan Jaff
4d1806bc95 fix - vertex ai exceptions 2024-05-04 21:32:10 -07:00
Krrish Dholakia
5406205e4b test(test_assistants.py): cleanup tests 2024-05-04 21:31:07 -07:00
Krrish Dholakia
8fe6c9b401 feat(assistants/main.py): support litellm.get_assistants() and litellm.get_messages() 2024-05-04 21:30:28 -07:00
Krrish Dholakia
cad01fb586 feat(assistants/main.py): support 'litellm.get_threads' 2024-05-04 21:14:03 -07:00
Ishaan Jaff
713e04848d
Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg
[Feat] Set a Retry Policy per model group
2024-05-04 20:42:40 -07:00
Ishaan Jaff
f09da3f14c test - test setting retry policies per model groups 2024-05-04 20:40:56 -07:00
Ishaan Jaff
95864a1d37 fix router debug logs 2024-05-04 20:24:15 -07:00
Krrish Dholakia
b7796c7487 feat(assistants/main.py): add 'add_message' endpoint 2024-05-04 19:56:11 -07:00
Krrish Dholakia
681a95e37b fix(assistants/main.py): support litellm.create_thread() call 2024-05-04 19:35:37 -07:00
Ishaan Jaff
87e165e413
Merge pull request #3456 from BerriAI/litellm_router_set_retry_policy_errors
[FEAT] router set custom num retries for ContentPolicyViolationErrorRetries, RateLimitErrorRetries, BadRequestErrorRetries etc
2024-05-04 18:26:03 -07:00
Ishaan Jaff
495d3a9646 router set dynamic retry policies 2024-05-04 18:13:43 -07:00
Ishaan Jaff
8d128a4b91 test - router retry policy 2024-05-04 17:30:30 -07:00
Krrish Dholakia
84c31a5528 feat(openai.py): add support for openai assistants
v0 commit. Closes https://github.com/BerriAI/litellm/issues/2842
2024-05-04 17:27:48 -07:00
Ishaan Jaff
b83901a861
Merge pull request #3451 from BerriAI/litellm_return_model_api_base
[Feat] Return model, api_base and first 100 chars of messages in Azure Exceptions
2024-05-04 17:07:09 -07:00
Ishaan Jaff
9e4e467039 test router - retry policy 2024-05-04 17:06:34 -07:00
Krish Dholakia
601e8a1172
Merge pull request #3448 from BerriAI/litellm_anthropic_fix
fix(factory.py): support 'function' openai message role for anthropic
2024-05-04 16:36:05 -07:00
Ishaan Jaff
85b2137f9c fix - test exceptions vertex ai 2024-05-04 16:09:20 -07:00
Ishaan Jaff
7150df653f test azure exceptions are more decriptive 2024-05-04 13:02:29 -07:00
Ishaan Jaff
df8e33739d
Revert "Add return_exceptions to litellm.batch_completion" 2024-05-04 13:01:17 -07:00
Krrish Dholakia
09d7121af2 fix(bedrock.py): map finish reason for bedrock 2024-05-04 12:45:40 -07:00
Ishaan Jaff
7094ac9557
Merge pull request #3397 from ffreemt/main
Add return_exceptions to litellm.batch_completion
2024-05-04 12:41:21 -07:00
Krrish Dholakia
8d49b3a84c fix(factory.py): support openai 'functions' messages 2024-05-04 12:33:39 -07:00
Ishaan Jaff
76825e1d2c test - mapping content policy violation errors 2024-05-04 11:15:34 -07:00
Krrish Dholakia
d9d5149aa1 fix(factory.py): support mapping openai 'tool' message to anthropic format 2024-05-04 10:14:52 -07:00
Krrish Dholakia
33472bfd2b fix(factory.py): support 'function' openai message role for anthropic
Fixes https://github.com/BerriAI/litellm/issues/3446
2024-05-04 10:03:30 -07:00
Ishaan Jaff
0bc6969e4d
Merge pull request #3408 from msabramo/test_proxy_exception_mapping_mock_improvements
Improve mocking in `test_proxy_exception_mapping.py`
2024-05-04 09:29:41 -07:00
Krrish Dholakia
8249c986bf fix(main.py): support new 'supports_system_message=False' param
Fixes https://github.com/BerriAI/litellm/issues/3325
2024-05-03 21:31:45 -07:00
Krrish Dholakia
a35ac050d2 test(test_router_fallbacks.py): bump test limits 2024-05-03 20:42:29 -07:00
Krish Dholakia
7d2aa2f645
Merge pull request #3433 from BerriAI/litellm_timeout_fix
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
Marc Abramowitz
4ce4927c0c Add test_engines_model_chat_completions 2024-05-03 17:56:39 -07:00
Krrish Dholakia
097714e02f fix(anthropic.py): handle whitespace characters for anthropic calls 2024-05-03 17:31:34 -07:00
Krrish Dholakia
0450abfdc1 fix(bedrock.py): fix boto3 config init 2024-05-03 17:22:06 -07:00
Ishaan Jaff
5e6b6c41c4
Merge pull request #3432 from BerriAI/litellm_add_bedrock_titan_embed
Feat - add bedrock titan embed-v2
2024-05-03 16:28:12 -07:00
Ishaan Jaff
926670bfb7
Merge pull request #3429 from BerriAI/litellm_add_unit_tests_slack_alerts
[Test] Add Slack Alerting unit tests
2024-05-03 16:27:40 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Ishaan Jaff
401bf8d67e test - bedrock v2 supports dimension 2024-05-03 16:23:37 -07:00
Krrish Dholakia
5b39f8e282 feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Ishaan Jaff
bae5d3601d feat - add unit tests for slack alerting 2024-05-03 15:08:55 -07:00
Krrish Dholakia
defc205348 test(test_alangfuse.py): fix test 2024-05-03 12:39:38 -07:00
Krrish Dholakia
2dd9d2f704 test(test_amazing_vertex_completion.py): try-except api errors 2024-05-03 10:09:57 -07:00
Krrish Dholakia
0b72904608 fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified) 2024-05-03 09:00:32 -07:00
mikey
de7fe98556
Merge branch 'BerriAI:main' into main 2024-05-03 11:30:03 +08:00
ffreemt
a7ec1772b1 Add litellm\tests\test_batch_completion_return_exceptions.py 2024-05-03 11:28:38 +08:00
Krrish Dholakia
fdc4fdb91a fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00