Commit graph

69 commits

Author SHA1 Message Date
Ishaan Jaff
c047d51cc8
(feat) add Predicted Outputs for OpenAI (#6594)
* bump openai to openai==1.54.0

* add 'prediction' param

* testing fix bedrock deprecated cohere.command-text-v14

* test test_openai_prediction_param.py

* test_openai_prediction_param_with_caching

* doc Predicted Outputs

* doc Predicted Output
2024-11-04 21:16:57 -08:00
Ishaan Jaff
13e0b3f626
(feat) Support audio, modalities params (#6304)
* add audio, modalities param

* add test for gpt audio models

* add get_supported_openai_params for GPT audio models

* add supported params for audio

* test_audio_output_from_model

* bump openai to openai==1.52.0

* bump openai on pyproject

* fix audio test

* fix test mock_chat_response

* handle audio for Message

* fix handling audio for OAI compatible API endpoints

* fix linting

* fix mock dbrx test
2024-10-18 19:14:25 +05:30
Ishaan Jaff
4e88fd65e1
(feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039)
* add prompt_tokens_details in usage response

* use _prompt_tokens_details as a param in Usage

* fix linting errors

* fix type error

* fix ci/cd deps

* bump deps for openai

* bump deps openai

* fix llm translation testing

* fix llm translation embedding
2024-10-03 23:31:10 +05:30
Ishaan Jaff
ded40e4d41 bump openai to 1.45.0 2024-09-12 14:18:15 -07:00
Ishaan Jaff
ac6f15ae2c fix pynacl error 2024-08-24 09:48:45 -07:00
Krrish Dholakia
1008f24b16 build(requirements.txt): bump openai version 2024-08-07 08:08:37 -07:00
dependabot[bot]
9fe5d9caa6
Bump azure-identity from 1.16.0 to 1.16.1
Bumps [azure-identity](https://github.com/Azure/azure-sdk-for-python) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-python/compare/azure-identity_1.16.0...azure-identity_1.16.1)

---
updated-dependencies:
- dependency-name: azure-identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-12 01:28:58 +00:00
dependabot[bot]
0daa9e94a6
build(deps): bump zipp from 3.18.2 to 3.19.1
Bumps [zipp](https://github.com/jaraco/zipp) from 3.18.2 to 3.19.1.
- [Release notes](https://github.com/jaraco/zipp/releases)
- [Changelog](https://github.com/jaraco/zipp/blob/main/NEWS.rst)
- [Commits](https://github.com/jaraco/zipp/compare/v3.18.2...v3.19.1)

---
updated-dependencies:
- dependency-name: zipp
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-09 19:26:57 +00:00
Ishaan Jaff
f4eb04640c bump: version 1.41.9 → 1.41.10 2024-07-06 15:30:27 -07:00
James Braza
a30157d659 Ran 'poetry lock --no-update' 2024-07-02 13:02:07 -04:00
Ishaan Jaff
6091c7798e use cache tools as dep 2024-06-24 17:31:59 -07:00
Krrish Dholakia
40ca30813e test(test_python_38.py): add coverage for non-gen settings config.yaml flow
Adds testing for this https://github.com/BerriAI/litellm/issues/4324
2024-06-20 20:29:10 -07:00
dependabot[bot]
ee729a5d1d
build(deps): bump urllib3 from 2.2.1 to 2.2.2
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.2.1 to 2.2.2.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.2.1...2.2.2)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 23:06:47 +00:00
Krrish Dholakia
478d8c8200 build(poetry.lock): updating poetry.lock 2024-06-15 11:03:16 -07:00
James Braza
917e8678db Added mypy to the dev Poetry group 2024-06-11 14:43:32 -07:00
sha-ahammed
575d94f5ef fix: poetry lock --no-update 2024-06-06 21:09:13 +05:30
sha-ahammed
76aab91d63 Revert "fix: Authentication Error, No module named 'nacl'."
This reverts commit 499933f943.
2024-06-06 20:56:16 +05:30
sha-ahammed
499933f943 fix: Authentication Error, No module named 'nacl'. 2024-06-05 16:46:27 +05:30
yujonglee
2d2671eea9 deps 2024-06-02 19:54:43 +09:00
yujonglee
d464b97810 init 2024-06-02 13:53:43 +09:00
Ishaan Jaff
25812d3573 bump openai version 2024-05-21 11:33:57 -07:00
Ishaan Jaff
c9fd6dbb22 feat - bump OpenAI version 2024-05-21 11:32:33 -07:00
Marc Abramowitz
82f43f98b3 Update FastAPI to update starlette to fix warnings
The httpx package emits some warnings when we run the tests in
`test_proxy_server.py`:

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py
...
litellm/tests/test_proxy_server.py::test_bedrock_embedding
litellm/tests/test_proxy_server.py::test_chat_completion
litellm/tests/test_proxy_server.py::test_chat_completion_azure
litellm/tests/test_proxy_server.py::test_chat_completion_optional_params
litellm/tests/test_proxy_server.py::test_embedding
litellm/tests/test_proxy_server.py::test_engines_model_chat_completions
litellm/tests/test_proxy_server.py::test_health
litellm/tests/test_proxy_server.py::test_img_gen
litellm/tests/test_proxy_server.py::test_openai_deployments_model_chat_completions_azure
  .../site-packages/httpx/_client.py:680:
  DeprecationWarning: The 'app' shortcut is now deprecated.
  Use the explicit style 'transport=WSGITransport(app=...)' instead.
    warnings.warn(message, DeprecationWarning)
...
```

Fixing this requires updating starlette, but the version of FastAPI in use
prevents that. So I updated FastAPI to update starlette to fix the httpx
warnings.

When run in combination with the changes in GH-3600, the tests pass and only
emit 1 warning!

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py
====================================== test session starts ======================================
platform darwin -- Python 3.12.3, pytest-7.4.4, pluggy-1.5.0
rootdir: /Users/abramowi/Code/OpenSource/litellm
plugins: anyio-4.3.0, mock-3.14.0
collected 12 items

litellm/tests/test_proxy_server.py s..........s                                           [100%]

======================================= warnings summary ========================================
litellm/utils.py:43
  /Users/abramowi/Code/OpenSource/litellm/litellm/utils.py:43: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources  # type: ignore

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== 10 passed, 2 skipped, 1 warning in 8.81s ============================
```
2024-05-12 12:26:23 -07:00
Roni Gurvich
32a085accf
gunicorn update 2024-05-05 13:25:59 +03:00
dependabot[bot]
5fd248274a
build(deps): bump idna from 3.6 to 3.7
Bumps [idna](https://github.com/kjd/idna) from 3.6 to 3.7.
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst)
- [Commits](https://github.com/kjd/idna/compare/v3.6...v3.7)

---
updated-dependencies:
- dependency-name: idna
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-12 00:52:36 +00:00
Dragos Campean
4549a20333 Merge remote-tracking branch 'upstream/main' into fix-pip-install-extra-proxy 2024-03-25 20:22:17 +02:00
Roni Gurvich
384882115e cryptography and python-multipart version bump 2024-03-24 08:49:36 +00:00
Roni Gurvich
644632ba3b cryptography and python-multipart version bump 2024-03-24 08:44:36 +00:00
Dragos Campean
c807a21442 Remove dependency which was removed on main 2024-03-24 08:53:43 +02:00
Dragos Campean
a016a6bfd8 Update poetry.lock after deps update from main merge 2024-03-23 21:40:46 +02:00
Dragos Campean
f38d8cf88e Fix pip install 'litellm[extra_proxy]' 2024-03-23 17:32:57 +02:00
Roni Gurvich
17e705183a
Update poetry.lock
fastapi upgrade from 0.104.1 to 0.109.1
2024-03-21 14:23:35 +02:00
Dmitry Supranovich
57ebb9582e Fixed azure ad token not being processed properly in embedding models 2024-03-12 21:29:24 -04:00
deena
b640ec4dc0 support langfuse tags feature 2024-02-12 19:49:11 +02:00
ishaan-jaff
c8da57710f (chore) bump poetry lock 2024-01-26 10:34:16 -08:00
ishaan-jaff
fcd66eac7d (fix) add app scheduler to poetry.lock 2024-01-23 20:03:28 -08:00
ishaan-jaff
6d99a58c85 (chore) update poetry.lock 2024-01-18 07:19:47 -08:00
David Leen
d14099f9b4 Add explicit dependency on requests library 2024-01-11 16:20:50 +01:00
ishaan-jaff
9bd9ff1038 (fix) add gunicorn to poetry lock 2024-01-10 18:12:54 +05:30
Krrish Dholakia
ebe752fb61 build(pyproject.toml): drop certifi dependency (unused) 2024-01-10 08:09:03 +05:30
ishaan-jaff
6c33fcbf6b (feat) proxy-ui a separate dep 2024-01-01 09:23:35 +05:30
ishaan-jaff
35b29d35b8 (fix) pyproject streamlit errors 2023-12-29 13:36:10 +05:30
ishaan-jaff
a730515096 (fix) pip install litellm[proxy] 2023-12-28 12:59:27 +05:30
ishaan-jaff
7822a8d421 (fix) remove appdirs as a dependency 2023-12-28 11:25:36 +05:30
Roger Meier
ecf017ba13
chore: add pytest as dev dependency 2023-12-23 09:07:58 +01:00
Roger Meier
d98caec626
chore: add black as dev dependency 2023-12-23 09:07:57 +01:00
Roger Meier
4c0e9e752b
chore: add flake8 as dev dependency 2023-12-23 09:07:53 +01:00
Max Deichmann
99034709dc improve integration 2023-12-18 23:32:02 +01:00
Max Deichmann
d1dbfd6ded changes 2023-12-12 12:02:29 +01:00
Max Deichmann
c8585a8983 fix langfuse tests 2023-12-12 12:00:41 +01:00