Commit graph

2505 commits

Author SHA1 Message Date
Ishaan Jaff
c23cf18a70 Merge branch 'main' into litellm_add_bedrock_guardrails 2024-08-22 17:28:49 -07:00
Krrish Dholakia
849cfa9bde docs(configs.md): add global_max_parallel_requests to docs 2024-08-22 17:12:52 -07:00
Krrish Dholakia
b0706a6f8f fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit 2024-08-22 16:49:52 -07:00
Ishaan Jaff
37142373ff doc bedrock guardrails 2024-08-22 16:25:22 -07:00
Michał Pstrąg
02bd326109 Merge branch 'main' into docs-dbally 2024-08-22 23:25:57 +02:00
Michał Pstrąg
2568b5536d add dbally project 2024-08-22 23:21:40 +02:00
Ishaan Jaff
55d35c2ea1 add prom docs for Request Latency Metrics 2024-08-22 14:06:14 -07:00
Krrish Dholakia
2f9f01e72c docs(azure_ai.md): add azure ai jamba instruct to docs
Closes https://github.com/BerriAI/litellm/issues/5333
2024-08-22 11:34:52 -07:00
Krrish Dholakia
f4e14ece50 docs(enterprise.md): add key/team level spend tags to docs 2024-08-21 22:10:18 -07:00
Ishaan Jaff
7236c3defb docs vertex 2024-08-21 19:15:23 -07:00
Ishaan Jaff
2baa6eb5e1 use litellm proxy with vertex ai sdk 2024-08-21 17:47:01 -07:00
Krrish Dholakia
22099c255c docs(vertex.md): add vertex global safety settings to doc 2024-08-21 17:41:49 -07:00
Ishaan Jaff
317936660d docs add example using litellm with vertex python sdk 2024-08-21 17:35:34 -07:00
Ishaan Jaff
56057f278a Merge branch 'main' into litellm_pass_through_vtx_multi_modal 2024-08-21 17:23:22 -07:00
Krrish Dholakia
938f891c6e docs(logging.md): add standard logging payload to docs 2024-08-21 17:04:57 -07:00
Ishaan Jaff
cbe0b471fc add docs using litellm multi modal embeddings 2024-08-21 16:58:47 -07:00
Krrish Dholakia
aeeeb10428 docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:22:41 -07:00
Krrish Dholakia
0707d8d815 docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:21:40 -07:00
Krrish Dholakia
8f773f2635 docs(custom_llm_server.md): add streaming example for custom llm call
Reference - https://github.com/BerriAI/litellm/issues/5147
2024-08-21 15:45:54 -07:00
Krish Dholakia
552b8743cf Merge pull request #5304 from beltranaceves/main
Fixed code snippet import typo in Structured Output docs
2024-08-21 15:40:00 -07:00
Krish Dholakia
41835d9397 Merge pull request #5323 from MarkRx/feature/langsmith-ids
Support LangSmith parent_run_id, trace_id, session_id
2024-08-21 15:38:50 -07:00
Krish Dholakia
3971880af4 Merge branch 'main' into litellm_disable_storing_master_key_hash_in_db 2024-08-21 15:37:25 -07:00
MarkRx
58529e2c9c Support LangSmith parent_run_id, trace_id, session_id 2024-08-21 16:09:30 -04:00
Ishaan Jaff
b522ade709 docs semantic caching qdrant 2024-08-21 13:03:41 -07:00
Ishaan Jaff
b196f41d64 fix qdrant litellm on proxy 2024-08-21 12:52:29 -07:00
Ishaan Jaff
8c83fb3f34 fixes for using qdrant with litellm proxy 2024-08-21 12:36:41 -07:00
Krrish Dholakia
9f83724697 feat(proxy_server.py): support disabling storing master key hash in db, for spend tracking 2024-08-21 12:35:37 -07:00
Ishaan Jaff
a34aeafdb5 Merge pull request #5018 from haadirakhangi/main
Qdrant Semantic Caching
2024-08-21 08:50:43 -07:00
Ishaan Jaff
6f16c88260 docs - use litellm on gcp cloud run 2024-08-21 08:39:24 -07:00
Ishaan Jaff
9fc7d93049 fix groq/3.1 reasoning model 2024-08-21 08:22:26 -07:00
Krrish Dholakia
62edd09f20 docs(caching.md): add doc on enabling caching for just rate limiting features 2024-08-20 22:10:42 -07:00
Ishaan Jaff
4cc0f41892 fix doc guardrails 2024-08-20 17:23:00 -07:00
Ishaan Jaff
ea279711ac fix doc lakera ai 2024-08-20 17:20:43 -07:00
Ishaan Jaff
2f0bd38f3a support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Ishaan Jaff
54cf835a51 docs move lakera to free 2024-08-20 16:38:37 -07:00
Beltrán Aceves
8c89a77e50 Fixed code snippet import typo in Structured Output docs 2024-08-20 23:01:22 +02:00
Ishaan Jaff
949646ff49 docs update Aporia Example 2024-08-20 07:56:40 -07:00
Krrish Dholakia
c6c7843b60 docs(langfuse.md): add doc on pass through 2024-08-19 21:28:48 -07:00
Ishaan Jaff
5327cd4831 docs fix aporia 2024-08-19 21:14:56 -07:00
Ishaan Jaff
c82714757a Merge pull request #5288 from BerriAI/litellm_aporia_refactor
[Feat] V2 aporia guardrails litellm
2024-08-19 20:41:45 -07:00
Ishaan Jaff
0920c5ece1 fix aporia typo 2024-08-19 18:34:45 -07:00
Ishaan Jaff
41a1f9e4f3 docs aporia 2024-08-19 18:34:02 -07:00
Ishaan Jaff
319690ab5e feat - guardrails v2 2024-08-19 18:24:20 -07:00
Ishaan Jaff
d521867523 docs fix typo 2024-08-19 15:44:15 -07:00
Ishaan Jaff
ea6fb381bd doc update typo 2024-08-19 15:43:40 -07:00
Ishaan Jaff
2ab402a1e6 docs updates based on feedback 2024-08-19 15:36:10 -07:00
Ishaan Jaff
181be05cb5 doc aporia_w_litellm 2024-08-19 14:36:55 -07:00
Krrish Dholakia
bf27235076 docs: add docs on bedrock + cohere pass through endpoints 2024-08-19 14:21:56 -07:00
Ishaan Jaff
b4bca8db82 feat - allow accessing data post success call 2024-08-19 11:35:33 -07:00
Haadi Rakhangi
ba87dfdb60 added put method in http_handler 2024-08-19 21:10:18 +05:30