phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16339 commits 2497 branches 897 tags 550 MiB
Commit graph

10374 commits

Author SHA1 Message Date
Ishaan Jaff
aef13a37f4 feat add cron job for sending stats from prometheus 2024-08-10 16:56:03 -07:00
Ishaan Jaff
017ba7a0fe add slack alerting on proxy_config.yaml 2024-08-10 16:37:59 -07:00
Krrish Dholakia
575afa8029 fix(internal_user_endpoints.py): return all teams if user is admin 2024-08-10 16:36:43 -07:00
Ishaan Jaff
28b930c0b7 feat - use api to get prometheus api metrics 2024-08-10 16:36:06 -07:00
Ishaan Jaff
35de40e6eb add fallback_reports in slack alert types 2024-08-10 16:08:36 -07:00
Ishaan Jaff
4cdc5c2e25 feat add prometheus api to get data from endpoint 2024-08-10 16:07:08 -07:00
Ishaan Jaff
ffb7f9f280 add fallback_reports as slack alert 2024-08-10 15:26:32 -07:00
Krrish Dholakia
19bb95f781 build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map 
Closes https://github.com/BerriAI/litellm/issues/4881
 2024-08-10 14:15:12 -07:00
Ishaan Jaff
3bc39af1b9
Merge pull request #5153 from BerriAI/litellm_track_fallback_prometheus 
Feat - Proxy track fallback metrics on prometheus
 2024-08-10 14:10:42 -07:00
Ishaan Jaff
d1eedb04bd prometheus log_success_fallback_event 2024-08-10 14:05:18 -07:00
Ishaan Jaff
2a54be4a43 feat - log fallbacks events on prometheus 2024-08-10 13:57:25 -07:00
Krrish Dholakia
0ea056971c docs(prefix.md): add prefix support to docs 2024-08-10 13:55:47 -07:00
Ishaan Jaff
0238ab077d v0 track fallback events 2024-08-10 13:31:00 -07:00
Ishaan Jaff
45186718aa v0 add event handlers for logging fallback events 2024-08-10 13:28:08 -07:00
Ishaan Jaff
dc0559226a v0 add helper for loging success/fail fallback events 2024-08-10 13:26:39 -07:00
Ishaan Jaff
d5abcb0945
Merge pull request #5152 from BerriAI/litellm_track_latency_prometheus 
Feat - track response latency on prometheus
 2024-08-10 13:02:10 -07:00
Krish Dholakia
b7e0620039
Merge pull request #5151 from BerriAI/litellm_streaming_chunks_safe_fail 
fix(main.py): safely fail stream_chunk_builder calls
 2024-08-10 13:02:02 -07:00
Ishaan Jaff
234b4a5fbf
Merge pull request #5149 from BerriAI/litellm_add_testing_for_prometheus_metrics 
[Refactor+Testing] Refactor Prometheus metrics to use CustomLogger class + add testing for prometheus
 2024-08-10 13:01:52 -07:00
Ishaan Jaff
51ce8ba301 test for prom metrics 2024-08-10 12:56:23 -07:00
Ishaan Jaff
01f5456e3d feat - track latency per llm deployment 2024-08-10 12:53:56 -07:00
Krrish Dholakia
068ee12c30 fix(main.py): safely fail stream_chunk_builder calls 2024-08-10 10:22:26 -07:00
Ishaan Jaff
83446926af track llm_deployment_success_responses 2024-08-10 10:05:33 -07:00
Krrish Dholakia
dd2ea72cb4 fix(openai.py): fix position of invalid_params param 2024-08-10 09:52:27 -07:00
Ishaan Jaff
2174801cb0 prometheus add basic testing for success 2024-08-10 09:45:12 -07:00
Ishaan Jaff
ce9af1e1df refactor prometheus to be a customLogger class 2024-08-10 09:28:46 -07:00
Krrish Dholakia
1553f7fa48 fix(types/utils.py): handle null completion tokens 
Fixes https://github.com/BerriAI/litellm/issues/5096
 2024-08-10 09:23:03 -07:00
Ishaan Jaff
20ef72194c use customLogger for prometheus logger 2024-08-10 09:15:23 -07:00
Ishaan Jaff
05fba48cec feat - refactor prometheus metrics 2024-08-10 09:14:38 -07:00
Krish Dholakia
e1a8e6c394
Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging 
fix(litellm_logging.py): fix calling success callback w/ stream_options true
 2024-08-09 20:30:19 -07:00
Krish Dholakia
a42164fa79
Merge pull request #5143 from BerriAI/litellm_use_max_retries 
fix(utils.py): set max_retries = num_retries, if given
 2024-08-09 20:29:49 -07:00
Ishaan Jaff
4c4ccaff66 fix _hidden_params is None case 2024-08-09 19:17:11 -07:00
Ishaan Jaff
3320d76dd4 ci/cd run again 2024-08-09 19:13:52 -07:00
Ishaan Jaff
a1fe1d2042 fix linting error 2024-08-09 18:47:23 -07:00
Krrish Dholakia
a26b23a3f4 fix(litellm_logging.py): fix calling success callback w/ stream_options true 
Fixes https://github.com/BerriAI/litellm/issues/5118
 2024-08-09 18:20:42 -07:00
Ishaan Jaff
4ec1df799c
Merge pull request #5144 from BerriAI/litellm_bedrock_put_modified_tool_Call_name_in_output 
[Fix] Place bedrock modified tool call name in output
 2024-08-09 18:04:30 -07:00
Ishaan Jaff
d445f3967d correctly add modified tool names to cache 2024-08-09 17:39:49 -07:00
Ishaan Jaff
42617c207a test bedrock tool call names 2024-08-09 17:14:56 -07:00
Ishaan Jaff
43ff70348d init bedrock_tool_name_mappings 2024-08-09 17:09:19 -07:00
Krrish Dholakia
dd3d97ace6 test(test_optional_params.py): use num_retries instead of 'max_retries' if given 2024-08-09 17:02:29 -07:00
Krrish Dholakia
a858cc4d0c docs(main.py): clarify 'num_retries' usage 2024-08-09 16:57:06 -07:00
Krrish Dholakia
ba7b070883 fix(utils.py): set max_retries = num_retries, if given 2024-08-09 16:54:54 -07:00
Krrish Dholakia
9f0a05d406 fix(utils.py): only return non-null default values 2024-08-09 16:34:59 -07:00
Ishaan Jaff
3548a55277
Merge pull request #5139 from BerriAI/litellm_log_vertex_metadata_as_spans 
[Feat-Langfuse] log VertexAI Grounding Metadata as Spans
 2024-08-09 14:52:59 -07:00
Ishaan Jaff
3e2a1fe0aa log provider specific metadata as a span 2024-08-09 14:32:02 -07:00
Ishaan Jaff
6dc9b39095 test invalid tool namehandling 2024-08-09 13:26:21 -07:00
Ishaan Jaff
8b98193a51 bedrock make_valid_bedrock_tool_name 2024-08-09 13:16:38 -07:00
Krrish Dholakia
177f670c7d build(test_completion.py): ci/cd run again 2024-08-09 12:28:26 -07:00
Ishaan Jaff
2f8db40cab ui new build 2024-08-09 12:26:24 -07:00
Krrish Dholakia
6180c52cfe fix(router.py): fix types 2024-08-09 12:24:48 -07:00
Ishaan Jaff
db7897dcc0
Merge pull request #5136 from BerriAI/litellm_add_cohere_embedding_models 
ui allow adding cohere models
 2024-08-09 12:19:19 -07:00