Commit graph

8190 commits

Author SHA1 Message Date
Krish Dholakia
3a31e8011a Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
2024-06-10 20:21:16 -07:00
Krrish Dholakia
b3d53787da test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Krrish Dholakia
8b97167961 feat(proxy/_logging.py): support controlling log level when json logs=True
allow user to control log level when json_logs=True
2024-06-10 17:33:43 -07:00
Ishaan Jaff
94210a86b4 test - client side fallbacks 2024-06-10 15:00:36 -07:00
Krrish Dholakia
5056fd5778 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Ishaan Jaff
878fa676d7 fix - support fallbacks as list 2024-06-10 14:32:28 -07:00
Krrish Dholakia
2d95eaa5bc fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
Ishaan Jaff
24a5731b52 Merge pull request #4103 from BerriAI/litellm_log_auth_exceptions_to_otel
feat - log Proxy Server auth errors on OTEL
2024-06-10 14:10:02 -07:00
Ishaan Jaff
04e77ca823 feat - viewing spend report per customer / team 2024-06-10 12:58:24 -07:00
Ishaan Jaff
185da8fd61 feat - log exceptions to OTEL 2024-06-10 12:34:18 -07:00
Ishaan Jaff
e6cde00aa8 test fix - cohere API Made a breaking change 2024-06-10 09:36:46 -07:00
Ishaan Jaff
07436b0540 Merge pull request #4088 from BerriAI/litellm_support_-support_api_key_header
[Feature]: Proxy: Support API-Key header in addition to Authorization header
2024-06-10 09:03:19 -07:00
Krrish Dholakia
b0d5b94040 fix(proxy/_types.py): fix validation check 2024-06-08 22:56:56 -07:00
Krish Dholakia
9e1c9ecc86 Merge pull request #4087 from BerriAI/litellm_update_together_ai_pricing
Update together ai pricing
2024-06-08 22:07:12 -07:00
Ishaan Jaff
0535c0099e ci/cd run again 2024-06-08 21:05:35 -07:00
Ishaan Jaff
90f5a801e4 [Feature]: Proxy: Support API-Key 2024-06-08 21:02:47 -07:00
Ishaan Jaff
ef9349e6a2 Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
3be558c4bb Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Krish Dholakia
50ba874a13 Merge pull request #4085 from BerriAI/litellm_fix_tgai_unmapped_model
fix(cost_calculator.py): fixes tgai unmapped model pricing
2024-06-08 20:27:26 -07:00
Krrish Dholakia
58cce8a922 fix(types/router.py): modelgroupinfo to handle mode being None and supported_openai_params not being a list 2024-06-08 20:13:45 -07:00
Krrish Dholakia
2af3c43360 build(model_prices_and_context_window.json): update together ai model pricing - account for new categories 2024-06-08 19:56:35 -07:00
Ishaan Jaff
8c5802d506 Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
af61eff8e3 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Krrish Dholakia
0a886eed6a fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
2024-06-08 19:43:57 -07:00
Ishaan Jaff
6f40fc6a81 fix OTEL test 2024-06-08 19:43:03 -07:00
Ishaan Jaff
21ac0efaae fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
638c4acbb2 fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Krrish Dholakia
cdf693a9bf fix(proxy_server.py): allow passing in a list of team members
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
2024-06-08 19:03:45 -07:00
Ishaan Jaff
bcfe62b801 fix test otel logger 2024-06-08 18:24:00 -07:00
Ishaan Jaff
0d83ffb4e2 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
76488c57fc Merge pull request #4083 from BerriAI/litellm_act_on_behalf
[Feat] Enterprise - Attribute Management changes to Users in Audit Logs
2024-06-08 17:39:16 -07:00
Ishaan Jaff
e81511a960 fix schema.prisma 2024-06-08 17:39:04 -07:00
Krrish Dholakia
b26de9b79f fix(proxy_server.py): return updated member list in /team/member_delete 2024-06-08 16:33:07 -07:00
Krrish Dholakia
493f573fc7 fix(proxy_server.py): fix team member delete endpoint
fixes issue in for loop, removing member from team
2024-06-08 16:27:33 -07:00
Ishaan Jaff
4252f2368b feat - support litellm_changed_by 2024-06-08 16:02:18 -07:00
Ishaan Jaff
62d3141103 test_otel_callback 2024-06-08 15:24:14 -07:00
Ishaan Jaff
e7f6c5d651 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
39ee6be477 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
22fa537d98 otel - use correct raw request name 2024-06-08 14:22:44 -07:00
Ishaan Jaff
29fed0e198 otel test - callbacks 2024-06-08 14:16:51 -07:00
Ishaan Jaff
4d7ff7c79b fix otel - handle vision images content 2024-06-08 14:12:00 -07:00
Ishaan Jaff
7f86dc859e feat - set span attributes OTEL with raw request / response 2024-06-08 14:01:59 -07:00
Ishaan Jaff
9da1b27793 feat - low raw request on OTEL 2024-06-08 11:35:17 -07:00
Ishaan Jaff
3dde580cb5 Merge pull request #4076 from BerriAI/litellm_log_litellm_response_request_OTEL
[FEAT]- OTEL log litellm request / response
2024-06-08 10:01:10 -07:00
Ishaan Jaff
33e72939d4 feat - OTEL log litellm request / response 2024-06-08 09:58:52 -07:00
Krrish Dholakia
192dfbcd63 fix(utils.py): fix helicone success logging integration
Fixes https://github.com/BerriAI/litellm/issues/4062
2024-06-08 08:59:56 -07:00
Krrish Dholakia
22b51c5af4 fix(litellm_pre_call_utils.py): add support for key level caching params 2024-06-07 22:09:14 -07:00
Ishaan Jaff
b9a1b2db03 (ci/cd) run again 2024-06-07 19:12:04 -07:00
Ishaan Jaff
ee08277678 ui 0 new build 2024-06-07 19:11:40 -07:00
Ishaan Jaff
1cbd36433b fix mock_completion 2024-06-07 19:10:05 -07:00