phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
18418 commits 1603 branches 645 tags 320 MiB
Commit graph

2834 commits

Author SHA1 Message Date
dependabot[bot]
e48459389c
Bump send and express in /docs/my-website 
Bumps [send](https://github.com/pillarjs/send) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `send` from 0.18.0 to 0.19.0
- [Release notes](https://github.com/pillarjs/send/releases)
- [Changelog](https://github.com/pillarjs/send/blob/master/HISTORY.md)
- [Commits](https://github.com/pillarjs/send/compare/0.18.0...0.19.0)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: send
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:46 +00:00
Ishaan Jaff
899eaa9566
Merge pull request #5571 from jalammar/cohere-updated-models 
Add Cohere refresh models and update pricing
 2024-09-10 17:22:51 -07:00
Ishaan Jaff
87bac7c026 fix rps / rpm values on load testing 2024-09-10 11:22:19 -07:00
Jay Alammar
795b29dfc4 Updating Cohere models, prices, and documentation 2024-09-10 13:47:05 -04:00
Ishaan Jaff
479b12be09
Merge branch 'main' into litellm_allow_turning_off_message_logging_for_callbacks 2024-09-09 21:59:36 -07:00
Ishaan Jaff
a6d3bd0ab7
Merge branch 'main' into litellm_tag_routing_fixes 2024-09-09 17:45:18 -07:00
Ishaan Jaff
949af7be2e fix team based logging doc 2024-09-09 16:49:26 -07:00
Ishaan Jaff
4592d80f43 add doc on redacting otel message / response 2024-09-09 16:10:13 -07:00
Ishaan Jaff
2fceeedd94 add "default" tag 2024-09-09 14:41:22 -07:00
Ishaan Jaff
3bf6589fab docs architecture 2024-09-07 19:09:33 -07:00
Krrish Dholakia
8294e8793c docs(deploy.md): add published non-root docker image to docs 2024-09-07 18:01:31 -07:00
Ishaan Jaff
ba41a72f92 High Level architecture 2024-09-07 16:29:22 -07:00
Ishaan Jaff
9eb59e3645
Merge pull request #5585 from BerriAI/litellm_docs_arch_diagram 
[Docs] - Add Lifecycle of a request through LiteLLM Gateway
 2024-09-07 16:22:02 -07:00
Ishaan Jaff
c2c63e4dbe docs add arch diagram 2024-09-07 16:21:29 -07:00
Ishaan Jaff
54db564529 add arch diagram 2024-09-07 15:49:51 -07:00
Ishaan Jaff
ecb774c3e8 add doc on spend report frequency 2024-09-07 11:54:33 -07:00
Ishaan Jaff
009a1f7f86
Merge pull request #5579 from BerriAI/litellm_set_redis_cluster_env 
[Feat] Allow setting up Redis Cluster using .env vars
 2024-09-07 11:31:38 -07:00
Ishaan Jaff
05505903b2 docs better sidebar 2024-09-07 11:31:07 -07:00
Ishaan Jaff
3984b9080c docs cleanup 2024-09-07 11:23:44 -07:00
Ishaan Jaff
2cf0714b0d docs organize sidebar 2024-09-07 11:23:06 -07:00
Ishaan Jaff
808ba36b55 ui cleanup 2024-09-07 11:20:07 -07:00
Ishaan Jaff
3bf2c06e06 add config for setting up redis cluster 2024-09-07 09:37:23 -07:00
Pradyumna Singh Rathore
a4f5fb3c30
fix missing class object instantiation in custom_llm_server provider documentation's quick start (#5578) 
Co-authored-by: Pradyumna Singh Rathore <pradyumna.singhrathore@halliburton.com>
 2024-09-07 08:22:18 -07:00
Ishaan Jaff
bf1325e898
Merge pull request #5411 from gary149/huggingface-update 
Update Hugging Face Doc
 2024-09-06 16:18:31 -07:00
Krish Dholakia
7ced9c8c0e
Update lago.py to accomodate API change (#5495) (#5543) 
* Update lago.py to accomodate API change (#5495)

external_customer_id is deprecated. 

external_subscription_id is the replacement.

* fix(lago.py): fixes

\

---------

Co-authored-by: Raymond Weitekamp <19483938+rawwerks@users.noreply.github.com>
 2024-09-05 17:27:40 -07:00
Ishaan Jaff
d8ef8c133e docs add video for key based logging 2024-09-05 17:10:12 -07:00
Krrish Dholakia
08976370a3 docs(configs.md): update to clarify you can use os.environ/ for any config value 2024-09-05 12:40:31 -07:00
Krrish Dholakia
a9be7dd79b docs(pass_through/bedrock.md): add bedrock agents support 2024-09-04 22:30:14 -07:00
Krish Dholakia
1e7e538261
LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 
* Minor IAM AWS OIDC Improvements (#5246)

* AWS IAM: Temporary tokens are valid across all regions after being issued, so it is wasteful to request one for each region.

* AWS IAM: Include an inline policy, to help reduce misuse of overly permissive IAM roles.

* (test_bedrock_completion.py): Ensure we are testing cross AWS region OIDC flow.

* fix(router.py): log rejected requests

Fixes https://github.com/BerriAI/litellm/issues/5498

* refactor: don't use verbose_logger.exception, if exception is raised

User might already have handling for this. But alerting systems in prod will raise this as an unhandled error.

* fix(datadog.py): support setting datadog source as an env var

Fixes https://github.com/BerriAI/litellm/issues/5508

* docs(logging.md): add dd_source to datadog docs

* fix(proxy_server.py): expose `/customer/list` endpoint for showing all customers

* (bedrock): Fix usage with Cloudflare AI Gateway, and proxies in general. (#5509)

* feat(anthropic.py): support 'cache_control' param for content when it is a string

* Revert "(bedrock): Fix usage with Cloudflare AI Gateway, and proxies in gener…" (#5519)

This reverts commit 3fac0349c2.

* refactor: ci/cd run again

---------

Co-authored-by: David Manouchehri <david.manouchehri@ai.moda>
 2024-09-04 22:16:55 -07:00
Ishaan Jaff
4b9163c7dc
Merge pull request #5514 from BerriAI/litellm_add_presidio 
[Fix-Refactor] support presidio on new guardrails config
 2024-09-04 16:09:54 -07:00
Krrish Dholakia
aefca63a8c docs(logging.md): fix name in docs 2024-09-04 14:36:53 -07:00
Ishaan Jaff
528154764b docs update presidio 2024-09-04 13:43:14 -07:00
Ishaan Jaff
36505058e0 doc setting language per request 2024-09-04 13:23:17 -07:00
Ishaan Jaff
6c30f18f8c docs new presidio language controls 2024-09-04 13:04:19 -07:00
Victor Mustar (aider)
f65ceef46a remove conversational-task 
deprecated
 2024-09-04 19:21:10 +02:00
Krish Dholakia
be3c7b401e
LiteLLM Minor fixes + improvements (08/03/2024) (#5488) 
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update

* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json

Fixes https://github.com/BerriAI/litellm/issues/5479

* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None

Fixes https://github.com/BerriAI/litellm/issues/5490

* fix(proxy_server.py): generic state uuid for okta sso

* fix(lago.py): improve debug logs

Debugging for https://github.com/BerriAI/litellm/issues/5477

* docs(bedrock.md): add bedrock cross-region inferencing to docs

* fix(azure.py): return azure response headers on aembedding call

* feat(azure.py): return azure response headers for `/audio/transcription`

* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information

Closes https://github.com/BerriAI/litellm/issues/5285

* docs(usage.md): add docs on litellm usage object

* test(test_completion.py): mark flaky test
 2024-09-03 21:21:34 -07:00
Ishaan Jaff
115de195f1
Merge branch 'main' into litellm_allow_setting_route_controls 2024-09-03 17:00:22 -07:00
Ishaan Jaff
814bc67c84 docs control routes on proxy 2024-09-03 16:58:11 -07:00
Ishaan Jaff
19dbfff620
Merge pull request #5489 from BerriAI/litellm_Add_secret_managers 
[Feat] Add Google Secret Manager Support
 2024-09-03 14:51:32 -07:00
dependabot[bot]
ae37d60ba1
Bump pagefind from 1.1.0 to 1.1.1 in /docs/my-website 
Bumps [pagefind](https://github.com/CloudCannon/pagefind) from 1.1.0 to 1.1.1.
- [Release notes](https://github.com/CloudCannon/pagefind/releases)
- [Changelog](https://github.com/CloudCannon/pagefind/blob/main/CHANGELOG.md)
- [Commits](https://github.com/CloudCannon/pagefind/compare/v1.1.0...v1.1.1)

---
updated-dependencies:
- dependency-name: pagefind
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-03 19:35:54 +00:00
Ishaan Jaff
e2372f7999
Merge pull request #5459 from yujonglee/update-canary 
update canary
 2024-09-03 11:58:43 -07:00
Ishaan Jaff
d9843a59a7 docs secret manager link 2024-09-03 11:41:43 -07:00
Krrish Dholakia
9aa006d353 docs(bedrock.md): add multimodal embedding support to docs 2024-09-03 08:14:10 -07:00
Krrish Dholakia
cdfea7e5ae docs(batches.md): add loadbalancing multiple azure deployments on batches api to docs 2024-09-03 08:01:14 -07:00
Krrish Dholakia
ab6ddd1a49 docs(azure.md): add docs on azure token refresh 2024-09-03 07:47:15 -07:00
Krrish Dholakia
f5905e1000 docs(routing.md): add proxy loadbalancing tutorial 2024-09-03 07:38:19 -07:00
Krrish Dholakia
eadcc09f44 docs(enterprise.md): clarify how enterprise deployments work 2024-09-03 06:55:14 -07:00
Krrish Dholakia
9df0588c2c docs(json_mode.md): update docs 2024-09-02 22:41:17 -07:00
Ishaan Jaff
c1adb0b7f2
Merge branch 'main' into litellm_track_imagen_spend_logs 2024-09-02 21:21:15 -07:00
Ishaan Jaff
b0735c9e9f add doc with support imagen models 2024-09-02 18:17:12 -07:00