Commit graph

7981 commits

Author SHA1 Message Date
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
d628bf0bd3 fix azure falbacks test 2024-06-10 21:50:54 -07:00
Krrish Dholakia
2e49614230 fix(utils.py): exception map vertex ai 500 internal server errors 2024-06-10 21:37:54 -07:00
Ishaan Jaff
a7e9e5b3cb ui - new build 2024-06-10 21:11:33 -07:00
Ishaan Jaff
43eef61aa7 fix azure cost tracking 2024-06-10 21:09:55 -07:00
Ishaan Jaff
86971c76a1
Merge pull request #4116 from BerriAI/litellm_show_model_group_in_exceptions
fix - show `model group` in  Azure ContentPolicy exceptions
2024-06-10 20:53:53 -07:00
Ishaan Jaff
b4db464604 fix - show model group in exceptions 2024-06-10 20:30:31 -07:00
Krish Dholakia
55a20c7cce
Merge pull request #4084 from BerriAI/litellm_batch_add_team_members
fix(proxy_server.py): allow passing in a list of team members
2024-06-10 20:26:35 -07:00
Krish Dholakia
8379d58318
Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
2024-06-10 20:21:16 -07:00
Krrish Dholakia
82149b8cf4 test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Krrish Dholakia
b2c9b5bbf4 feat(proxy/_logging.py): support controlling log level when json logs=True
allow user to control log level when json_logs=True
2024-06-10 17:33:43 -07:00
Ishaan Jaff
dfe874c9e5 test - client side fallbacks 2024-06-10 15:00:36 -07:00
Krrish Dholakia
65baa83928 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Ishaan Jaff
a9006b965f fix - support fallbacks as list 2024-06-10 14:32:28 -07:00
Krrish Dholakia
84652dd946 fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/4091
2024-06-10 14:20:25 -07:00
Ishaan Jaff
c98739284d
Merge pull request #4103 from BerriAI/litellm_log_auth_exceptions_to_otel
feat - log Proxy Server auth errors on OTEL
2024-06-10 14:10:02 -07:00
Ishaan Jaff
f00fa12e69 feat - viewing spend report per customer / team 2024-06-10 12:58:24 -07:00
Ishaan Jaff
a27f7e2817 feat - log exceptions to OTEL 2024-06-10 12:34:18 -07:00
Ishaan Jaff
d5a1cc282e test fix - cohere API Made a breaking change 2024-06-10 09:36:46 -07:00
Ishaan Jaff
68c74a1b7f
Merge pull request #4088 from BerriAI/litellm_support_-support_api_key_header
[Feature]: Proxy: Support API-Key header in addition to Authorization header
2024-06-10 09:03:19 -07:00
Krrish Dholakia
d066e0e152 fix(proxy/_types.py): fix validation check 2024-06-08 22:56:56 -07:00
Krish Dholakia
90ae7f040a
Merge pull request #4087 from BerriAI/litellm_update_together_ai_pricing
Update together ai pricing
2024-06-08 22:07:12 -07:00
Ishaan Jaff
78dbb15ccd ci/cd run again 2024-06-08 21:05:35 -07:00
Ishaan Jaff
8de7074614 [Feature]: Proxy: Support API-Key 2024-06-08 21:02:47 -07:00
Ishaan Jaff
39bbc5d8ac
Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Krish Dholakia
e42198f87c
Merge pull request #4085 from BerriAI/litellm_fix_tgai_unmapped_model
fix(cost_calculator.py): fixes tgai unmapped model pricing
2024-06-08 20:27:26 -07:00
Krrish Dholakia
6306914e56 fix(types/router.py): modelgroupinfo to handle mode being None and supported_openai_params not being a list 2024-06-08 20:13:45 -07:00
Krrish Dholakia
f3a845eff9 build(model_prices_and_context_window.json): update together ai model pricing - account for new categories 2024-06-08 19:56:35 -07:00
Ishaan Jaff
0d3add56a6
Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
0253c2b213 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Krrish Dholakia
b26c3c7d22 fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
2024-06-08 19:43:57 -07:00
Ishaan Jaff
b56fa0e5c4 fix OTEL test 2024-06-08 19:43:03 -07:00
Ishaan Jaff
5b73bcfe31 fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
8b187eb66d fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Krrish Dholakia
def648ed3f fix(proxy_server.py): allow passing in a list of team members
allows batch adding members to a team by passing in a list. fixes concurrency issue caused by calling team/member_add in parallel
2024-06-08 19:03:45 -07:00
Ishaan Jaff
03dcf366a1 fix test otel logger 2024-06-08 18:24:00 -07:00
Ishaan Jaff
090f350169 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
95eb762cc7
Merge pull request #4083 from BerriAI/litellm_act_on_behalf
[Feat] Enterprise - Attribute Management changes to Users in Audit Logs
2024-06-08 17:39:16 -07:00
Ishaan Jaff
ae8889f4fa fix schema.prisma 2024-06-08 17:39:04 -07:00
Krrish Dholakia
dddd4a73fe fix(proxy_server.py): return updated member list in /team/member_delete 2024-06-08 16:33:07 -07:00
Krrish Dholakia
5c4abcbdb4 fix(proxy_server.py): fix team member delete endpoint
fixes issue in for loop, removing member from team
2024-06-08 16:27:33 -07:00
Ishaan Jaff
9c3c42fa4b feat - support litellm_changed_by 2024-06-08 16:02:18 -07:00
Ishaan Jaff
2d618087bf test_otel_callback 2024-06-08 15:24:14 -07:00
Ishaan Jaff
dcc63c7d67 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
9478c98fff otel - use correct raw request name 2024-06-08 14:22:44 -07:00
Ishaan Jaff
47f1e16533 otel test - callbacks 2024-06-08 14:16:51 -07:00
Ishaan Jaff
1ff99bf9b5 fix otel - handle vision images content 2024-06-08 14:12:00 -07:00
Ishaan Jaff
259540900b feat - set span attributes OTEL with raw request / response 2024-06-08 14:01:59 -07:00