phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
18474 commits 1603 branches 645 tags 320 MiB
Commit graph

131 commits

Author SHA1 Message Date
Krish Dholakia
859b47f08b
LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 
* fix(factory.py): ensure tool call converts image url

Fixes https://github.com/BerriAI/litellm/issues/6953

* fix(transformation.py): support mp4 + pdf url's for vertex ai

Fixes https://github.com/BerriAI/litellm/issues/6936

* fix(http_handler.py): mask gemini api key in error logs

Fixes https://github.com/BerriAI/litellm/issues/6963

* docs(prometheus.md): update prometheus FAQs

* feat(auth_checks.py): ensure specific model access > wildcard model access

if wildcard model is in access group, but specific model is not - deny access

* fix(auth_checks.py): handle auth checks for team based model access groups

handles scenario where model access group used for wildcard models

* fix(internal_user_endpoints.py): support adding guardrails on `/user/update`

Fixes https://github.com/BerriAI/litellm/issues/6942

* fix(key_management_endpoints.py): fix prepare_metadata_fields helper

* fix: fix tests

* build(requirements.txt): bump openai dep version

fixes proxies argument

* test: fix tests

* fix(http_handler.py): fix error message masking

* fix(bedrock_guardrails.py): pass in prepped data

* test: fix test

* test: fix nvidia nim test

* fix(http_handler.py): return original response headers

* fix: revert maskedhttpstatuserror

* test: update tests

* test: cleanup test

* fix(key_management_endpoints.py): fix metadata field update logic

* fix(key_management_endpoints.py): maintain initial order of guardrails in key update

* fix(key_management_endpoints.py): handle prepare metadata

* fix: fix linting errors

* fix: fix linting errors

* fix: fix linting errors

* fix: fix key management errors

* fix(key_management_endpoints.py): update metadata

* test: update test

* refactor: add more debug statements

* test: skip flaky test

* test: fix test

* fix: fix test

* fix: fix update metadata logic

* fix: fix test

* ci(config.yml): change db url for e2e ui testing
 2024-12-01 05:24:11 -08:00
Ishaan Jaff
c047d51cc8
(feat) add Predicted Outputs for OpenAI (#6594) 
* bump openai to openai==1.54.0

* add 'prediction' param

* testing fix bedrock deprecated cohere.command-text-v14

* test test_openai_prediction_param.py

* test_openai_prediction_param_with_caching

* doc Predicted Outputs

* doc Predicted Output
 2024-11-04 21:16:57 -08:00
Ishaan Jaff
13e0b3f626
(feat) Support audio, modalities params (#6304) 
* add audio, modalities param

* add test for gpt audio models

* add get_supported_openai_params for GPT audio models

* add supported params for audio

* test_audio_output_from_model

* bump openai to openai==1.52.0

* bump openai on pyproject

* fix audio test

* fix test mock_chat_response

* handle audio for Message

* fix handling audio for OAI compatible API endpoints

* fix linting

* fix mock dbrx test
 2024-10-18 19:14:25 +05:30
Krish Dholakia
f9d0bcc5a1
OpenAI /v1/realtime api support (#6047) 
* feat(azure/realtime): initial working commit for proxy azure openai realtime endpoint support

Adds support for passing /v1/realtime calls via litellm proxy

* feat(realtime_api/main.py): abstraction for handling openai realtime api calls

* feat(router.py): add `arealtime()` endpoint in router for realtime api calls

Allows using `model_list` in proxy for realtime as well

* fix: make realtime api a private function

Structure might change based on feedback. Make that clear to users.

* build(requirements.txt): add websockets to the requirements.txt

* feat(openai/realtime): add openai /v1/realtime api support
 2024-10-03 17:11:22 -04:00
Ishaan Jaff
4e88fd65e1
(feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 
* add prompt_tokens_details in usage response

* use _prompt_tokens_details as a param in Usage

* fix linting errors

* fix type error

* fix ci/cd deps

* bump deps for openai

* bump deps openai

* fix llm translation testing

* fix llm translation embedding
 2024-10-03 23:31:10 +05:30
Ishaan Jaff
e70d1a2808
add sentry sdk to litellm docker (#5965) 2024-09-28 19:33:41 -07:00
Jacob Hagstedt P Suorra
9ec3365ba6
Upgrade dependencies in dockerfile (#5862) 
* Upgrade dependencies in dockerfile

* Change apt-get to apk for alpine image

* Set requirements file to same as dockerfile

---------

Co-authored-by: Jacob Hagstedt <wcgs@novonordisk.com>
 2024-09-27 07:51:20 -07:00
Ishaan Jaff
741c8e8a45
[Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 
* fix refactor dd to be an instance of custom logger

* migrate dd logger to be async

* clean up dd logging

* add datadog sync and async code

* use batching for datadog logger

* add doc string for dd logging

* add clear doc string

* fix doc string

* allow debugging intake url

* clean up requirements.txt

* allow setting custom batch size on logger

* fix dd logging to use compression

* fix linting

* add dd load test

* fix dd load test

* fix dd url

* add test_datadog_logging_http_request

* fix test_datadog_logging_http_request
 2024-09-13 17:39:17 -07:00
Ishaan Jaff
ded40e4d41 bump openai to 1.45.0 2024-09-12 14:18:15 -07:00
Ishaan Jaff
1415bdd6fa fix testing + req.txt 2024-09-11 13:30:42 -07:00
Ishaan Jaff
256ab6d8e8 fix req.txt 2024-09-03 18:13:44 -07:00
Ishaan Jaff
ed951e5e35 bump langfuse sdk version on docker 2024-09-03 18:09:00 -07:00
dependabot[bot]
06dc1e4b2f
build(deps): bump aiohttp from 3.9.4 to 3.10.2 
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.9.4 to 3.10.2.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.4...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-09 18:22:02 +00:00
Krrish Dholakia
1008f24b16 build(requirements.txt): bump openai version 2024-08-07 08:08:37 -07:00
Krrish Dholakia
d5d782f844 build(requirements.txt): bump openai version 
Fixes https://github.com/BerriAI/litellm/issues/4639
 2024-07-10 11:52:29 -07:00
dependabot[bot]
c626823a25
build(deps): bump aiohttp from 3.9.0 to 3.9.4 
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.9.0 to 3.9.4.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.0...v3.9.4)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-07-06 02:14:30 +00:00
dependabot[bot]
61ec8c8d17
build(deps): bump certifi from 2023.7.22 to 2024.7.4 
Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.7.22 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2023.07.22...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-07-06 01:22:27 +00:00
Krrish Dholakia
dc0218d34c build(pyproject.toml): remove ijson dep. add jsonschema dep. 2024-06-29 19:24:00 -07:00
Ishaan Jaff
9942a5cbcf
Merge branch 'main' into litellm_add_secret_detection 2024-06-25 18:08:51 -07:00
Ishaan Jaff
304e84f87c clean up secret detection 2024-06-25 17:25:53 -07:00
Ishaan Jaff
4c99010eee fix - verify license without api request 2024-06-25 13:55:54 -07:00
Krrish Dholakia
a7d39d6bdd build(pyproject.toml): add ijson as a package dep for google ai studio http streaming 2024-06-17 16:04:40 -07:00
Ishaan Jaff
0510a95732
Merge pull request #4130 from BerriAI/dependabot/pip/azure-identity-1.16.1 
build(deps): bump azure-identity from 1.15.0 to 1.16.1
 2024-06-15 09:12:59 -07:00
Krrish Dholakia
ffea0a2aed build(pyproject.toml): require pydantic v2 
https://github.com/BerriAI/litellm/pull/3670 moved to pydantic v2. This created issues for people using sdk with pydantic v1. Move to requiring pydantic v2
 2024-06-12 10:40:31 -07:00
Krrish Dholakia
b0daeba8e7 build(requirements.txt): make sure tiktoken v0.7.0 is provided 2024-06-11 18:11:08 -07:00
dependabot[bot]
8838c8af66
build(deps): bump azure-identity from 1.15.0 to 1.16.1 
Bumps [azure-identity](https://github.com/Azure/azure-sdk-for-python) from 1.15.0 to 1.16.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-python/compare/azure-identity_1.15.0...azure-identity_1.16.1)

---
updated-dependencies:
- dependency-name: azure-identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-11 20:32:08 +00:00
Ishaan Jaff
c53f2aa199 fix requirements.txt 2024-06-04 09:40:19 -07:00
yujonglee
2d2671eea9 deps 2024-06-02 19:54:43 +09:00
Krrish Dholakia
fffb2427f3 fix(types/init.py): don't import openai assistants types by default 2024-05-15 08:50:31 -07:00
Marc Abramowitz
e73e36f210 requirements.txt: Update fastapi to 0.111.0 2024-05-13 09:21:19 -07:00
Krish Dholakia
bbe1300c5b
Merge branch 'main' into feat/add-azure-content-filter 2024-05-11 09:30:38 -07:00
dependabot[bot]
6fc625b54d
build(deps): bump jinja2 from 3.1.3 to 3.1.4 
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/3.1.3...3.1.4)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-06 20:55:32 +00:00
Lunik
406c9820d1
➕ feat: Add python requirements for Azure Content-Safety callback 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-05-02 23:28:21 +02:00
Ishaan Jaff
f3dfe5f2ab
Merge pull request #3262 from Manouchehri/update-langfuse-py-1 
Update langfuse in `requirements.txt`
 2024-05-01 21:03:23 -07:00
David Manouchehri
fbe5ba6213
(requirements.txt) - Update gunicorn to 22.0.0 for CVE-2024-1135 2024-04-24 13:44:54 +00:00
David Manouchehri
d4d3130b38
(requirements.txt) - Update langfuse so that we get the latest features. 2024-04-24 13:31:51 +00:00
Krrish Dholakia
df60e475e8 build(requirements.txt): pin all dependency versions 2024-04-23 19:18:19 -07:00
dependabot[bot]
5c819d6dc0
build(deps): bump pillow from 10.0.1 to 10.3.0 
Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.0.1 to 10.3.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/10.0.1...10.3.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-04-16 01:08:01 +00:00
Ishaan Jaff
4b6e55bcc0
Merge pull request #3053 from BerriAI/litellm_fix_gemini_pillow_bug 
[Fix]- gemini bug `please run pip install Pillow` on LiteLLM Docker
 2024-04-15 18:07:23 -07:00
Ishaan Jaff
9df9c19ab3 fix - gemini bug with pillow 2024-04-15 17:52:50 -07:00
Krish Dholakia
9ab6482466
Merge pull request #2883 from Manouchehri/fix-broke-langfuse-2857 
(fix) Langfuse v2 renamed a few things.
 2024-04-15 16:14:05 -07:00
Krrish Dholakia
b0770cf8e2 build(requirements.txt): bump google genai version 2024-04-12 13:52:47 -07:00
David Manouchehri
9c55be3e82
(feat) - Bump version for Vertex AI SDK. 2024-04-12 00:03:32 +00:00
David Manouchehri
8682573187
(fix) Langfuse v2 renamed a few things. 2024-04-07 04:31:25 +00:00
Krrish Dholakia
f0c4ff6e60 fix(vertex_ai_anthropic.py): support streaming, async completion, async streaming for vertex ai anthropic 2024-04-05 09:27:48 -07:00
Krrish Dholakia
292c96c0b2 build(requirements.txt): update requirements.txt 2024-04-03 23:27:10 -07:00
Ishaan Jaff
da835ad10a (fix) bump uvicorn on proxy docker builds 2024-03-27 14:35:17 -07:00
Roni Gurvich
384882115e cryptography and python-multipart version bump 2024-03-24 08:49:36 +00:00
Krish Dholakia
db7974f9f2
Merge pull request #2617 from RoniGurvich/main 
Bump fastapi version `0.104.1` to `0.109.1`
 2024-03-21 20:56:28 -07:00
roni
76d4871262 fastapi version bump in requirements.txt 2024-03-21 18:32:06 +02:00