Commit graph

2829 commits

Author SHA1 Message Date
Ishaan Jaff
11187920ec
Merge pull request #5352 from BerriAI/litellm_allow_setting_caching_mode
[Feat-Caching] allow setting caching mode to default off
2024-08-24 16:27:45 -07:00
Ishaan Jaff
74f0e60962 fix set Caching Default Off 2024-08-24 09:43:39 -07:00
Krrish Dholakia
0c26b36d9d docs(input.md): update docs on together ai response_format params support 2024-08-23 21:34:18 -07:00
Krrish Dholakia
74a85fac0e docs(aws_sagemaker.md): cleanup sagemaker messages api docs 2024-08-23 21:17:16 -07:00
Ishaan Jaff
a7bcc0e88e docs tts 2024-08-23 18:29:36 -07:00
Ishaan Jaff
8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff
82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff
5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00
Ishaan Jaff
d40695b979 docs custom guardrails 2024-08-23 09:50:19 -07:00
Ishaan Jaff
d10430c881 doc custom guardrail 2024-08-23 09:41:54 -07:00
Krrish Dholakia
52fb1e0c38 docs(caching.md): add redis cluster support to docs 2024-08-22 22:16:07 -07:00
Krrish Dholakia
cee69a92ce docs(bedrock.md): add docs on alternating user/assistant messages 2024-08-22 22:10:10 -07:00
Ishaan Jaff
1765976ce0 use with base64 2024-08-22 20:49:39 -07:00
Krish Dholakia
76b3db334b
Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff
b054dd0e45 docs fix 2024-08-22 19:04:14 -07:00
Ishaan Jaff
25609a94ad docs moderation 2024-08-22 18:57:54 -07:00
Krrish Dholakia
56cb94ac5e docs(batches.md): add more examples to docs 2024-08-22 18:51:44 -07:00
Ishaan Jaff
b865993b34 docs move pass thru endpoints 2024-08-22 18:49:26 -07:00
Krrish Dholakia
11c7e92b58 docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
Ishaan Jaff
228252b92d
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Ishaan Jaff
70f9e41ed9
Merge branch 'main' into litellm_add_bedrock_guardrails 2024-08-22 17:28:49 -07:00
Krrish Dholakia
e445b78490 docs(configs.md): add global_max_parallel_requests to docs 2024-08-22 17:12:52 -07:00
Krrish Dholakia
735fc804ed fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit 2024-08-22 16:49:52 -07:00
Ishaan Jaff
499b6b3368 doc bedrock guardrails 2024-08-22 16:25:22 -07:00
Krrish Dholakia
d7d3eee349 feat(azure.py): support health checking azure deployments
Fixes https://github.com/BerriAI/litellm/issues/5279
2024-08-22 16:11:14 -07:00
Krrish Dholakia
ada426d652 docs(batches.md): add docs on calling azure batches api 2024-08-22 14:51:14 -07:00
Michał Pstrąg
a37f004c1d Merge branch 'main' into docs-dbally 2024-08-22 23:25:57 +02:00
Michał Pstrąg
62df7c755b add dbally project 2024-08-22 23:21:40 +02:00
Ishaan Jaff
57707b04b6 add prom docs for Request Latency Metrics 2024-08-22 14:06:14 -07:00
Ishaan Jaff
38ce14c66b docs use entrata id with litellm proxy 2024-08-22 13:20:05 -07:00
Ishaan Jaff
08fa3f346a add new litellm params for client_id, tenant_id etc 2024-08-22 11:37:30 -07:00
Krrish Dholakia
a63c5c0020 docs(azure_ai.md): add azure ai jamba instruct to docs
Closes https://github.com/BerriAI/litellm/issues/5333
2024-08-22 11:34:52 -07:00
Krrish Dholakia
4ebacbfafe docs(enterprise.md): add key/team level spend tags to docs 2024-08-21 22:10:18 -07:00
Ishaan Jaff
88e1ad6cbc docs vertex 2024-08-21 19:15:23 -07:00
Ishaan Jaff
0ea1f367d7 use litellm proxy with vertex ai sdk 2024-08-21 17:47:01 -07:00
Krrish Dholakia
f310ce541f docs(vertex.md): add vertex global safety settings to doc 2024-08-21 17:41:49 -07:00
Ishaan Jaff
9078f075f9 docs add example using litellm with vertex python sdk 2024-08-21 17:35:34 -07:00
Ishaan Jaff
a174cbdd72
Merge branch 'main' into litellm_pass_through_vtx_multi_modal 2024-08-21 17:23:22 -07:00
Krrish Dholakia
3dc75dabd6 docs(logging.md): add standard logging payload to docs 2024-08-21 17:04:57 -07:00
Ishaan Jaff
55dfb3b181 add docs using litellm multi modal embeddings 2024-08-21 16:58:47 -07:00
Krrish Dholakia
4416ad02b4 docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:22:41 -07:00
Krrish Dholakia
0a42347a8d docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:21:40 -07:00
Krrish Dholakia
50383cfe62 docs(custom_llm_server.md): add streaming example for custom llm call
Reference - https://github.com/BerriAI/litellm/issues/5147
2024-08-21 15:45:54 -07:00
Krish Dholakia
9452b9398d
Merge pull request #5304 from beltranaceves/main
Fixed code snippet import typo in Structured Output docs
2024-08-21 15:40:00 -07:00
Krish Dholakia
e961810139
Merge pull request #5323 from MarkRx/feature/langsmith-ids
Support LangSmith parent_run_id, trace_id, session_id
2024-08-21 15:38:50 -07:00
Krish Dholakia
72169fd5c4
Merge branch 'main' into litellm_disable_storing_master_key_hash_in_db 2024-08-21 15:37:25 -07:00
MarkRx
19e5299a6d Support LangSmith parent_run_id, trace_id, session_id 2024-08-21 16:09:30 -04:00
Ishaan Jaff
d6493b0e7f docs semantic caching qdrant 2024-08-21 13:03:41 -07:00
Ishaan Jaff
e7ecb2fe3a fix qdrant litellm on proxy 2024-08-21 12:52:29 -07:00
Ishaan Jaff
c6dfd2d276 fixes for using qdrant with litellm proxy 2024-08-21 12:36:41 -07:00