phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
18458 commits 1603 branches 645 tags 320 MiB
Commit graph

326 commits

Author SHA1 Message Date
Krish Dholakia
3beecfb0d4
LiteLLM Minor Fixes & Improvements (11/13/2024) (#6729) 
* fix(utils.py): add logprobs support for together ai

Fixes

https://github.com/BerriAI/litellm/issues/6724

* feat(pass_through_endpoints/): add anthropic/ pass-through endpoint

adds new `anthropic/` pass-through endpoint + refactors docs

* feat(spend_management_endpoints.py): allow /global/spend/report to query team + customer id

enables seeing spend for a customer in a team

* Add integration with MLflow Tracing (#6147)

* Add MLflow logger

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* Streaming handling

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* lint

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* address comments and fix issues

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* address comments and fix issues

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* Move logger construction code

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* Add docs

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* async handlers

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* new picture

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

---------

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* fix(mlflow.py): fix ruff linting errors

* ci(config.yml): add mlflow to ci testing

* fix: fix test

* test: fix test

* Litellm key update fix (#6710)

* fix(caching): convert arg to equivalent kwargs in llm caching handler

prevent unexpected errors

* fix(caching_handler.py): don't pass args to caching

* fix(caching): remove all *args from caching.py

* fix(caching): consistent function signatures + abc method

* test(caching_unit_tests.py): add unit tests for llm caching

ensures coverage for common caching scenarios across different implementations

* refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one

* fix(router.py): drop redis password requirement

* fix(proxy_server.py): fix faulty slack alerting check

* fix(langfuse.py): avoid copying functions/thread lock objects in metadata

fixes metadata copy error when parent otel span in metadata

* test: update test

* fix(key_management_endpoints.py): fix /key/update with metadata update

* fix(key_management_endpoints.py): fix key_prepare_update helper

* fix(key_management_endpoints.py): reset value to none if set in key update

* fix: update test

'

* Litellm dev 11 11 2024 (#6693)

* fix(__init__.py): add 'watsonx_text' as mapped llm api route

Fixes https://github.com/BerriAI/litellm/issues/6663

* fix(opentelemetry.py): fix passing parallel tool calls to otel

Fixes https://github.com/BerriAI/litellm/issues/6677

* refactor(test_opentelemetry_unit_tests.py): create a base set of unit tests for all logging integrations - test for parallel tool call handling

reduces bugs in repo

* fix(__init__.py): update provider-model mapping to include all known provider-model mappings

Fixes https://github.com/BerriAI/litellm/issues/6669

* feat(anthropic): support passing document in llm api call

* docs(anthropic.md): add pdf anthropic call to docs + expose new 'supports_pdf_input' function

* fix(factory.py): fix linting error

* add clear doc string for GCS bucket logging

* Add docs to export logs to Laminar (#6674)

* Add docs to export logs to Laminar

* minor fix: newline at end of file

* place laminar after http and grpc

* (Feat) Add langsmith key based logging (#6682)

* add langsmith_api_key to StandardCallbackDynamicParams

* create a file for langsmith types

* langsmith add key / team based logging

* add key based logging for langsmith

* fix langsmith key based logging

* fix linting langsmith

* remove NOQA violation

* add unit test coverage for all helpers in test langsmith

* test_langsmith_key_based_logging

* docs langsmith key based logging

* run langsmith tests in logging callback tests

* fix logging testing

* test_langsmith_key_based_logging

* test_add_callback_via_key_litellm_pre_call_utils_langsmith

* add debug statement langsmith key based logging

* test_langsmith_key_based_logging

* (fix) OpenAI's optional messages[].name  does not work with Mistral API  (#6701)

* use helper for _transform_messages mistral

* add test_message_with_name to base LLMChat test

* fix linting

* add xAI on Admin UI (#6680)

* (docs) add benchmarks on 1K RPS  (#6704)

* docs litellm proxy benchmarks

* docs GCS bucket

* doc fix - reduce clutter on logging doc title

* (feat) add cost tracking stable diffusion 3 on Bedrock  (#6676)

* add cost tracking for sd3

* test_image_generation_bedrock

* fix get model info for image cost

* add cost_calculator for stability 1 models

* add unit testing for bedrock image cost calc

* test_cost_calculator_with_no_optional_params

* add test_cost_calculator_basic

* correctly allow size Optional

* fix cost_calculator

* sd3 unit tests cost calc

* fix raise correct error 404 when /key/info is called on non-existent key  (#6653)

* fix raise correct error on /key/info

* add not_found_error error

* fix key not found in DB error

* use 1 helper for checking token hash

* fix error code on key info

* fix test key gen prisma

* test_generate_and_call_key_info

* test fix test_call_with_valid_model_using_all_models

* fix key info tests

* bump: version 1.52.4 → 1.52.5

* add defaults used for GCS logging

* LiteLLM Minor Fixes & Improvements (11/12/2024)  (#6705)

* fix(caching): convert arg to equivalent kwargs in llm caching handler

prevent unexpected errors

* fix(caching_handler.py): don't pass args to caching

* fix(caching): remove all *args from caching.py

* fix(caching): consistent function signatures + abc method

* test(caching_unit_tests.py): add unit tests for llm caching

ensures coverage for common caching scenarios across different implementations

* refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one

* fix(router.py): drop redis password requirement

* fix(proxy_server.py): fix faulty slack alerting check

* fix(langfuse.py): avoid copying functions/thread lock objects in metadata

fixes metadata copy error when parent otel span in metadata

* test: update test

* bump: version 1.52.5 → 1.52.6

* (feat) helm hook to sync db schema  (#6715)

* v0 migration job

* fix job

* fix migrations job.yml

* handle standalone DB on helm hook

* fix argo cd annotations

* fix db migration helm hook

* fix migration job

* doc fix Using Http/2 with Hypercorn

* (fix proxy redis) Add redis sentinel support  (#6154)

* add sentinel_password support

* add doc for setting redis sentinel password

* fix redis sentinel - use sentinel password

* Fix: Update gpt-4o costs to that of gpt-4o-2024-08-06 (#6714)

Fixes #6713

* (fix) using Anthropic `response_format={"type": "json_object"}`  (#6721)

* add support for response_format=json anthropic

* add test_json_response_format to baseLLM ChatTest

* fix test_litellm_anthropic_prompt_caching_tools

* fix test_anthropic_function_call_with_no_schema

* test test_create_json_tool_call_for_response_format

* (feat) Add cost tracking for Azure Dall-e-3 Image Generation  + use base class to ensure basic image generation tests pass  (#6716)

* add BaseImageGenTest

* use 1 class for unit testing

* add debugging to BaseImageGenTest

* TestAzureOpenAIDalle3

* fix response_cost_calculator

* test_basic_image_generation

* fix img gen basic test

* fix _select_model_name_for_cost_calc

* fix test_aimage_generation_bedrock_with_optional_params

* fix undo changes cost tracking

* fix response_cost_calculator

* fix test_cost_azure_gpt_35

* fix remove dup test (#6718)

* (build) update db helm hook

* (build) helm db pre sync hook

* (build) helm db sync hook

* test: run test_team_logging firdst

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Dinmukhamed Mailibay <47117969+dinmukhamedm@users.noreply.github.com>
Co-authored-by: Kilian Lieret <kilian.lieret@posteo.de>

* test: update test

* test: skip anthropic overloaded error

* test: cleanup test

* test: update tests

* test: fix test

* test: handle gemini overloaded model error

* test: handle internal server error

* test: handle anthropic overloaded error

* test: handle claude instability

---------

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Co-authored-by: Yuki Watanabe <31463517+B-Step62@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Dinmukhamed Mailibay <47117969+dinmukhamedm@users.noreply.github.com>
Co-authored-by: Kilian Lieret <kilian.lieret@posteo.de>
 2024-11-15 11:18:31 +05:30
Ishaan Jaff
310669e3bc (docs) add instructions on how to contribute to docker image 2024-11-13 20:52:17 -08:00
Ishaan Jaff
68fdf9de2d docs readme 2024-08-08 17:06:29 -07:00
Ishaan Jaff
5bc8b59b11 docs - use consistent name for LiteLLM proxy server 2024-08-03 12:49:35 -07:00
Ishaan Jaff
4bf9681df4
Update README.md 2024-07-25 20:12:32 -07:00
Ishaan Jaff
50bf488b58 read me link to using litellm 2024-07-25 20:10:02 -07:00
Ishaan Jaff
b93b2636a9
Update README.md 2024-07-24 16:51:40 -07:00
Ishaan Jaff
b38f470135 docs on litellm docker compose 2024-07-18 13:08:06 -07:00
Krish Dholakia
1362a91d66
Merge pull request #4612 from colegottdank/main 
Update Helicone Docs
 2024-07-11 22:00:30 -07:00
Yulong Liu
cb025a7f26 Merge branch 'main' into empower-functions-v1 2024-07-08 17:01:15 -07:00
colegottdank
f414bafd4a Add Helicone 2024-07-08 15:41:35 -07:00
colegottdank
705c498641 revert readme 2024-07-08 15:35:50 -07:00
colegottdank
20561bcaaf Update key name 2024-07-08 14:17:30 -07:00
colegottdank
a3d9e34b26 Fix 2 2024-07-08 13:56:53 -07:00
Krish Dholakia
e2a50b66f2
Update README.md 2024-06-25 09:24:00 -07:00
Krish Dholakia
e354840f90
Update README.md 2024-06-25 09:23:19 -07:00
wslee
9e52fd0ba6 fix provider name 2024-06-11 16:23:08 +09:00
wslee
fe8d59f5eb add friendli_ai provider 2024-06-10 17:27:15 +09:00
Rajan Paneru
2e25416c02 Table format fix and Typo 
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
 2024-06-06 22:29:59 +09:30
Krish Dholakia
edf296fb5b
Update README.md 2024-06-01 16:53:06 -07:00
Yulong Liu
6a004b9211 add document 2024-05-31 18:55:22 -07:00
Krish Dholakia
beb51f5271
Update README.md 2024-05-24 09:19:48 -07:00
Krish Dholakia
41d564857c
Update README.md 2024-05-24 09:19:28 -07:00
Krish Dholakia
16331b438f
Update README.md 2024-05-24 09:07:32 -07:00
Krish Dholakia
35c48c7c24
Update README.md 2024-05-18 19:06:09 -07:00
Krish Dholakia
a43cfa1770
Update README.md 2024-05-18 12:58:22 -07:00
Paul Gauthier
90eb0ea022 Added support for the deepseek api 2024-05-07 11:44:03 -07:00
Ishaan Jaff
ee8d0b6d5f
Merge pull request #3217 from DomMartin27/litellm_readme 
Update contributing instructions in README.md
 2024-05-02 07:42:44 -07:00
Simon S. Viloria
63e8209fe5 (docs) added watsonx to the list of supported providers 2024-04-27 16:43:17 +02:00
Dom
6464a1b067 Update contributing instructions in README.md 2024-04-22 19:35:08 +01:00
Krish Dholakia
e52e4cc1a9
Update README.md 2024-04-20 09:48:49 -07:00
Krish Dholakia
78571babb3
Merge pull request #2830 from onukura/onukura-patch-1 
Update README.md
 2024-04-11 06:47:53 -07:00
Krish Dholakia
5d2734479d
Update README.md 2024-04-09 18:03:09 -07:00
Krish Dholakia
a101591f74
Update README.md 2024-04-06 16:11:33 -07:00
Richard Macarthy
e6263fd31a
Fix link to providers 2024-04-04 15:04:07 +01:00
onukura
f3fdae6e30
Update README.md 2024-04-04 14:30:52 +09:00
Vincelwt
1b84dfac91
Merge branch 'main' into main 2024-03-30 13:21:53 +09:00
Krish Dholakia
f3f56204c5
Update README.md 2024-03-26 10:34:16 -07:00
Krish Dholakia
f702d49e00
Update README.md 2024-03-25 19:03:48 -07:00
Vincelwt
1cbfd312fe
Merge branch 'main' into main 2024-03-19 12:50:04 +09:00
Krish Dholakia
796b912883
Update README.md 2024-03-13 21:32:09 -07:00
Vince Loewe
7c38f992dc
Merge branch 'main' into main 2024-03-11 12:36:41 +09:00
ishaan-jaff
ea6f42216c (docs) use port 4000 2024-03-08 21:59:00 -08:00
ishaan-jaff
c7968aff62 (docs) litellm 2024-03-02 17:20:05 -08:00
ishaan-jaff
9fca5c7415 (docs) litellm 2024-03-02 17:18:48 -08:00
Vince Loewe
a9648613dc feat: LLMonitor is now Lunary 2024-02-27 22:07:13 -08:00
Krish Dholakia
2913c9525b
Update README.md 2024-02-26 15:23:52 -08:00
Krish Dholakia
99b92c4b23
Update README.md 2024-02-26 15:22:50 -08:00
Krish Dholakia
d53fd118f2
Update README.md 2024-02-24 10:05:24 -08:00
Krish Dholakia
a06b509e56
Update README.md 2024-02-24 10:04:47 -08:00