Commit graph

8190 commits

Author SHA1 Message Date
Krrish Dholakia
778eed3115 fix(bedrock_httpx.py): fix linting errors 2024-06-07 09:01:19 -07:00
Ishaan Jaff
98ed4533f7 fix - otel _get_span_context 2024-06-07 08:55:35 -07:00
Ishaan Jaff
0f99d47d87 use litellm_parent_otel_span as litellm_param 2024-06-07 08:54:28 -07:00
Ishaan Jaff
731f298761 Merge pull request #4048 from BerriAI/litellm_otel_set_svc_name
feat - OTEL set custom service names and custom tracer names
2024-06-07 08:53:07 -07:00
Ishaan Jaff
0e7cda8c73 Merge pull request #4043 from BerriAI/litellm_enforce_params
[Feat] Enterprise - Enforce Params in request to LiteLLM Proxy
2024-06-07 08:52:46 -07:00
Krish Dholakia
7bf5c61007 Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Ishaan Jaff
8370f81aa6 feat - use safe safe_deep_copy 2024-06-07 08:49:47 -07:00
Krish Dholakia
2c70e55f77 Merge pull request #4054 from BerriAI/litellm_aws_kms_support
feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption
2024-06-07 08:49:25 -07:00
Krrish Dholakia
12ed3dc911 refactor(main.py): only route anthropic calls through converse api
v0 scope let's move function calling to converse api
2024-06-07 08:47:51 -07:00
Ishaan Jaff
0ccf1bff52 feat - use async_service_success_hook with litellm proxy 2024-06-07 08:27:47 -07:00
Ishaan Jaff
c461356523 feat - add parent_otel_span to UserAPIKeyAuth 2024-06-07 08:25:26 -07:00
Krrish Dholakia
bad5cde7c5 test(main.py): test cicd 2024-06-07 08:18:37 -07:00
Krrish Dholakia
3f4b617767 style(main.py): trigger new build 2024-06-07 08:10:28 -07:00
Krish Dholakia
9d81f1cc52 Merge pull request #4049 from BerriAI/litellm_cleanup_traceback
refactor: replace 'traceback.print_exc()' with logging library
2024-06-07 08:03:22 -07:00
Krrish Dholakia
dbd442dc48 fix(aws_secret_manager.py): fix boto import 2024-06-07 08:02:58 -07:00
Krish Dholakia
d3d8f97bca Merge branch 'main' into litellm_aws_kms_support 2024-06-07 07:58:56 -07:00
Krrish Dholakia
a4c20294e0 test(test_completion.py): fix test to use mock response - prevent hang 2024-06-07 07:05:32 -07:00
Ishaan Jaff
f48d8fd6ae fix open_telemetry_logger 2024-06-06 22:30:49 -07:00
Ishaan Jaff
193e71642c fix - log_to_opentelemetry 2024-06-06 22:28:01 -07:00
Krrish Dholakia
99cf716527 test(test_completion.py): fix replicate test which was hanging 2024-06-06 22:17:30 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Ishaan Jaff
cd125e6309 fix auth checks 2024-06-06 22:13:13 -07:00
Ishaan Jaff
312521a0b3 fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Ishaan Jaff
c867f88c57 fix - add new types for ServiceLoggerPayload 2024-06-06 22:06:28 -07:00
Ishaan Jaff
87df3a4a04 add _to_ns to utils 2024-06-06 21:30:55 -07:00
Ishaan Jaff
92a3c062a7 fix log_to_opentelemetry 2024-06-06 21:29:40 -07:00
Krrish Dholakia
f8b5aa3df6 fix(bedrock_httpx.py): working claude 3 function calling 2024-06-06 20:12:41 -07:00
Ishaan Jaff
cb5ebba6fa feat -v0 parent_otel_span in basic db reads 2024-06-06 19:49:18 -07:00
Krrish Dholakia
6f3468aee4 fix(utils.py): fix exception mapping for azure internal server error 2024-06-06 17:12:30 -07:00
nick-rackauckas
f8ffaa7fc8 Fix 2024-06-06 16:57:42 -07:00
Krrish Dholakia
35ee506cd6 test(test_assistants.py): add more error logging 2024-06-06 16:43:12 -07:00
Krish Dholakia
0b3165e5ee Merge pull request #4046 from BerriAI/litellm_router_order
feat(router.py): enable settting 'order' for a deployment in model list
2024-06-06 16:37:03 -07:00
Krish Dholakia
ac33c9c79a Merge pull request #4036 from Keywords-AI/main
Fixed openai token counter bug
2024-06-06 16:36:25 -07:00
nick-rackauckas
93bf678026 Comment 2024-06-06 16:35:39 -07:00
Krish Dholakia
ea4334f760 Merge branch 'main' into litellm_cleanup_traceback 2024-06-06 16:32:08 -07:00
nick-rackauckas
e205381ba0 Remove unused function 2024-06-06 16:30:23 -07:00
nick-rackauckas
b4eba4bddd Fix to work with all supported Gemini file types 2024-06-06 16:15:01 -07:00
Krrish Dholakia
a2ca3887d1 feat(aws_secret_manager.py): allows user to keep a hash of the proxy master key in their env 2024-06-06 15:32:51 -07:00
Krrish Dholakia
43991afc34 feat(scheduler.py): support redis caching for req. prioritization
enables req. prioritization to work across multiple instances of litellm
2024-06-06 14:19:21 -07:00
Krrish Dholakia
bb63046d8c fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
7f2346f9a3 feat - custom OTEL service names 2024-06-06 12:45:14 -07:00
Ishaan Jaff
b9bf4bd16e Merge pull request #4039 from themrzmaster/main
fix tool usage null content using vertexai
2024-06-06 12:41:25 -07:00
Ishaan Jaff
9942945797 docs - redacting messages from slack alerting 2024-06-06 12:30:56 -07:00
Ishaan Jaff
383d58a3f8 fix - turn of message logging 2024-06-06 10:48:08 -07:00
Ishaan Jaff
3df177d0d0 feat - redact messages from slack alerting 2024-06-06 10:38:15 -07:00
Raymond1415926
f9368228c0 Merge branch 'BerriAI:main' into main 2024-06-06 10:12:20 -07:00
Raymond Huang
dca10670ad test 2024-06-06 10:11:27 -07:00
Ishaan Jaff
5fc62433c7 fix add_metadata_from_header 2024-06-06 09:53:12 -07:00
Krrish Dholakia
005128addc feat(router.py): enable settting 'order' for a deployment in model list
Allows user to control which model gets called first in model group
2024-06-06 09:46:51 -07:00