phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
14814 commits 1603 branches 645 tags 320 MiB
Commit graph

14814 commits

This branch
This branch
All branches
Author SHA1 Message Date
Marc Abramowitz
434953b38c More updates to health.md docs 2024-07-10 19:08:48 -07:00
Marc Abramowitz
6ccd635216 Update doc: health.md 2024-07-10 19:02:48 -07:00
Krrish Dholakia
31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Marc Abramowitz
3d86c4f515 Shorter success callbacks from /health/readiness 
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
 2024-07-10 18:45:42 -07:00
Ishaan Jaff
b2f4cd9b56 bump: version 1.41.15 → 1.41.16 2024-07-10 18:34:30 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Ishaan Jaff
f49837df19 ci/cd run again 2024-07-10 18:06:09 -07:00
Ishaan Jaff
dc5adbb0ca docs - control allowed ip address 2024-07-10 18:03:54 -07:00
Ishaan Jaff
b4a96e81c6 docs gdpr regions cloud 2024-07-10 18:00:16 -07:00
Ishaan Jaff
da73f3abda docs security cloud litellm 2024-07-10 17:54:54 -07:00
Ishaan Jaff
ca76d2fd72 fix test_completion_bedrock_httpx_models 2024-07-10 17:42:40 -07:00
Ishaan Jaff
9590d63a38 docs - Security Measures 2024-07-10 17:40:30 -07:00
Ishaan Jaff
d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Marc Abramowitz
45a9920080 Add/remove blank lines to make MD linter happy 
This removed a lot of yellow squigglies in my VS Code.
 2024-07-10 17:20:23 -07:00
Ishaan Jaff
7efe9beac5 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Marc Abramowitz
9dadbe52f7 Shorten title 
I think it looks better to have a shorter title in the left sidebar
and then describe the longer details in the body of the document.
 2024-07-10 17:07:51 -07:00
Marc Abramowitz
3e49cfa6ff Delete manual table of contents 
It seems redudant since Docusaurus already generates a table of contents in the
right sidebar.

In fact, the `(BETA) Moderation with Azure Content-Safety` link in the manual
TOC was broken, which shows how easy it is to forget to update the manual TOC
when adding new content or to make a mistake while doing it.
 2024-07-10 17:03:47 -07:00
Marc Abramowitz
dd0c07d2a1 Move JSX stuff so first line of file is heading 
This prevents VS Code from displaying a warning about the file not starting with
a heading.
 2024-07-10 17:02:56 -07:00
Ishaan Jaff
de0dacc42d fix test proxy routes 2024-07-10 16:58:53 -07:00
Ishaan Jaff
7b8670f883 add /files/{file_id}/content as openai route 2024-07-10 16:55:09 -07:00
Ishaan Jaff
265ec00d0f fix test routes on litellm proxy 2024-07-10 16:51:47 -07:00
Ishaan Jaff
0cb4dabaf0
Merge pull request #4642 from BerriAI/litellm_safe_access_slack 
[fix] slack alerting reports - add validation for safe access into attributes
 2024-07-10 16:46:08 -07:00
Ishaan Jaff
a313174ecb
Merge pull request #4648 from BerriAI/litellm_add_remaining_file_endpoints 
[Feat] Add LIST, DELETE, GET `/files`
 2024-07-10 16:42:05 -07:00
Ishaan Jaff
f34e45db93 test - /file endpoints 2024-07-10 16:36:27 -07:00
Marc Abramowitz
982603714e Add docs 2024-07-10 16:32:05 -07:00
Ishaan Jaff
a5f12aba81 add file content 2024-07-10 16:15:43 -07:00
Ishaan Jaff
cb300d30a9 add file delete path 2024-07-10 16:08:58 -07:00
Marc Abramowitz
3a2cb151aa Proxy: Add x-litellm-call-id response header 
This gives the value of `logging_obj.litellm_call_id` and one particular use of
this is to correlate the HTTP response from a request with a trace in an LLM
logging tool like Langfuse, Langsmith, etc.

For example, if a user in my environment (w/ Langfuse) gets back this in the
response headers:

```
x-litellm-call-id: ffcb49e7-bd6e-4e56-9c08-a7243802b26e
```

then they know that they can see the trace for this request in Langfuse by
visiting https://langfuse.domain.com/trace/ffcb49e7-bd6e-4e56-9c08-a7243802b26e

They can also use this ID to submit scores for this request to the Langfuse
scoring API.
 2024-07-10 16:05:37 -07:00
Ishaan Jaff
0b39ec6a8e add /v1/files LIST 2024-07-10 16:04:07 -07:00
Ishaan Jaff
a741586519 test openai files endpoints 2024-07-10 15:54:55 -07:00
Ishaan Jaff
ef3bd2df22 support list files on litellm SDK 2024-07-10 15:51:28 -07:00
Ishaan Jaff
f18754b6ed test - delete file 2024-07-10 15:42:15 -07:00
Ishaan Jaff
fc2b2fbe49 test - deleting a file 2024-07-10 15:41:32 -07:00
Ishaan Jaff
a542e7be61 add all openai file endpoints 2024-07-10 15:35:21 -07:00
Marc Abramowitz
2db9c23bce Remove unnecessary imports 
from `litellm/proxy/proxy_server.py`
 2024-07-10 15:06:47 -07:00
Ishaan Jaff
5187569e11 test retrieve file 2024-07-10 15:00:27 -07:00
Ishaan Jaff
efca9daf5d add "/v1/files/{file_id}" as openai route 2024-07-10 14:56:53 -07:00
Ishaan Jaff
393ce7df14 add /files endpoints 2024-07-10 14:55:10 -07:00
Ishaan Jaff
99fd388943 add retrive file to litellm SDK 2024-07-10 14:51:48 -07:00
Krrish Dholakia
aace0b22a3 fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key 2024-07-10 12:25:31 -07:00
Krrish Dholakia
d5d782f844 build(requirements.txt): bump openai version 
Fixes https://github.com/BerriAI/litellm/issues/4639
 2024-07-10 11:52:29 -07:00
Ishaan Jaff
e4dbd5abd4
Merge pull request #4645 from BerriAI/litellm_add_assistants_delete_endpoint 
[Feat-Proxy] Add DELETE /assistants
 2024-07-10 11:45:37 -07:00
Ishaan Jaff
09fe40791e add "/v1/assistants/{assistant_id}", as openai route 2024-07-10 11:42:02 -07:00
Ishaan Jaff
62f475919b feat - add DELETE assistants endpoint 2024-07-10 11:37:37 -07:00
Ishaan Jaff
7e82d98299 test assistants endpoint 2024-07-10 11:15:28 -07:00
Ishaan Jaff
5587dbbd32 add async assistants delete support 2024-07-10 11:14:40 -07:00
Ishaan Jaff
3480382495 test - delete assistants 2024-07-10 10:35:30 -07:00
Ishaan Jaff
5bf430f201 add delete assistant SDK 2024-07-10 10:33:00 -07:00
Ishaan Jaff
e20b540dac add validation on slack 2024-07-10 10:10:32 -07:00
Fabian Reinold
3de1743cd8
Change prisma configuration to capsulate all binaries inside application directory with no connection to active user 2024-07-10 17:27:01 +02:00