phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15087 commits 2497 branches 898 tags 550 MiB
Commit graph

9496 commits

Author SHA1 Message Date
Ishaan Jaff
79f409b21e
Merge pull request #4656 from BerriAI/litellm_otel_fix 
[Proxy - OTEL] Fix logging DB, Redis Cache Reads
 2024-07-11 09:55:51 -07:00
Ishaan Jaff
15d35cd62f test otel 2024-07-11 09:54:23 -07:00
Krrish Dholakia
070ab9f469 docs(model_management.md): update docs to clarify calling /model/info 2024-07-11 09:47:50 -07:00
Krrish Dholakia
8fa2cf15ee fix(watsonx.py): fix watson process response 
Fixes https://github.com/BerriAI/litellm/issues/4654
 2024-07-11 09:34:46 -07:00
Ishaan Jaff
e2c3b2b694 fix add master key in requests 2024-07-11 09:05:08 -07:00
Krrish Dholakia
57607dfc47 test(test_alangfuse.py): fix test to expect correct response object 2024-07-11 09:00:31 -07:00
Ishaan Jaff
02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Ishaan Jaff
cb6ddaf1f9 test - otel spans 2024-07-11 08:01:18 -07:00
Ishaan Jaff
19d993e120 add otel in callbacks 2024-07-11 07:24:48 -07:00
Ishaan Jaff
498d7d4228 fix - otel log db / redis calls 2024-07-11 07:22:45 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter 
Anthropic `/v1/messages` endpoint support
 2024-07-10 22:41:53 -07:00
Krrish Dholakia
22bcbac9ea fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
1019355527 fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Krrish Dholakia
31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Marc Abramowitz
3d86c4f515 Shorter success callbacks from /health/readiness 
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
 2024-07-10 18:45:42 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Ishaan Jaff
f49837df19 ci/cd run again 2024-07-10 18:06:09 -07:00
Ishaan Jaff
ca76d2fd72 fix test_completion_bedrock_httpx_models 2024-07-10 17:42:40 -07:00
Ishaan Jaff
d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
7efe9beac5 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Marc Abramowitz
dd0c07d2a1 Move JSX stuff so first line of file is heading 
This prevents VS Code from displaying a warning about the file not starting with
a heading.
 2024-07-10 17:02:56 -07:00
Ishaan Jaff
de0dacc42d fix test proxy routes 2024-07-10 16:58:53 -07:00
Ishaan Jaff
7b8670f883 add /files/{file_id}/content as openai route 2024-07-10 16:55:09 -07:00
Ishaan Jaff
265ec00d0f fix test routes on litellm proxy 2024-07-10 16:51:47 -07:00
Ishaan Jaff
0cb4dabaf0
Merge pull request #4642 from BerriAI/litellm_safe_access_slack 
[fix] slack alerting reports - add validation for safe access into attributes
 2024-07-10 16:46:08 -07:00
Ishaan Jaff
a313174ecb
Merge pull request #4648 from BerriAI/litellm_add_remaining_file_endpoints 
[Feat] Add LIST, DELETE, GET `/files`
 2024-07-10 16:42:05 -07:00
Ishaan Jaff
a5f12aba81 add file content 2024-07-10 16:15:43 -07:00
Ishaan Jaff
cb300d30a9 add file delete path 2024-07-10 16:08:58 -07:00
Marc Abramowitz
3a2cb151aa Proxy: Add x-litellm-call-id response header 
This gives the value of `logging_obj.litellm_call_id` and one particular use of
this is to correlate the HTTP response from a request with a trace in an LLM
logging tool like Langfuse, Langsmith, etc.

For example, if a user in my environment (w/ Langfuse) gets back this in the
response headers:

```
x-litellm-call-id: ffcb49e7-bd6e-4e56-9c08-a7243802b26e
```

then they know that they can see the trace for this request in Langfuse by
visiting https://langfuse.domain.com/trace/ffcb49e7-bd6e-4e56-9c08-a7243802b26e

They can also use this ID to submit scores for this request to the Langfuse
scoring API.
 2024-07-10 16:05:37 -07:00
Ishaan Jaff
0b39ec6a8e add /v1/files LIST 2024-07-10 16:04:07 -07:00
Ishaan Jaff
a741586519 test openai files endpoints 2024-07-10 15:54:55 -07:00
Ishaan Jaff
ef3bd2df22 support list files on litellm SDK 2024-07-10 15:51:28 -07:00
Ishaan Jaff
f18754b6ed test - delete file 2024-07-10 15:42:15 -07:00
Ishaan Jaff
fc2b2fbe49 test - deleting a file 2024-07-10 15:41:32 -07:00
Ishaan Jaff
a542e7be61 add all openai file endpoints 2024-07-10 15:35:21 -07:00
Marc Abramowitz
2db9c23bce Remove unnecessary imports 
from `litellm/proxy/proxy_server.py`
 2024-07-10 15:06:47 -07:00
Ishaan Jaff
5187569e11 test retrieve file 2024-07-10 15:00:27 -07:00
Ishaan Jaff
efca9daf5d add "/v1/files/{file_id}" as openai route 2024-07-10 14:56:53 -07:00
Ishaan Jaff
393ce7df14 add /files endpoints 2024-07-10 14:55:10 -07:00
Ishaan Jaff
99fd388943 add retrive file to litellm SDK 2024-07-10 14:51:48 -07:00
Krrish Dholakia
aace0b22a3 fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key 2024-07-10 12:25:31 -07:00
Ishaan Jaff
09fe40791e add "/v1/assistants/{assistant_id}", as openai route 2024-07-10 11:42:02 -07:00
Ishaan Jaff
62f475919b feat - add DELETE assistants endpoint 2024-07-10 11:37:37 -07:00
Ishaan Jaff
7e82d98299 test assistants endpoint 2024-07-10 11:15:28 -07:00
Ishaan Jaff
5587dbbd32 add async assistants delete support 2024-07-10 11:14:40 -07:00
Ishaan Jaff
3480382495 test - delete assistants 2024-07-10 10:35:30 -07:00
Ishaan Jaff
5bf430f201 add delete assistant SDK 2024-07-10 10:33:00 -07:00
Ishaan Jaff
e20b540dac add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
5d6e172d5c feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
Krrish Dholakia
d077148135 style(litellm_license.py): add debug statement for litellm license 2024-07-09 22:43:33 -07:00