Commit graph

1817 commits

Author SHA1 Message Date
Krrish Dholakia
061db3ed28 docs(proxy/caching.md): add configuring user api key cache ttl to docs 2024-05-25 12:14:11 -07:00
Krrish Dholakia
8749ee2c88 docs(users.md): refactoring team member budget placement 2024-05-25 11:41:09 -07:00
Krrish Dholakia
4cafd9c373 docs(alerting.md): add model outage alerting to docs 2024-05-25 09:12:44 -07:00
tjandy98
d375eef972 Add Opus model 2024-05-25 15:48:55 +08:00
Ishaan Jaff
a097688a37 docs - using vllm with litellm proxy server 2024-05-24 09:55:34 -07:00
Krrish Dholakia
f089666754 docs(input.md): add clarifai supported input params to docs 2024-05-24 08:57:50 -07:00
Krrish Dholakia
e9f6313ae0 docs(clarifai.md): add clarifai to docs 2024-05-24 08:55:02 -07:00
Krish Dholakia
edb349a9ab Merge pull request #3808 from BerriAI/litellm_databricks_api
feat(databricks.py): adds databricks support - completion, async, streaming
2024-05-23 19:23:19 -07:00
Krrish Dholakia
ed5a0d7649 docs(databricks.md): add databricks api support to docs 2024-05-23 19:22:09 -07:00
Ishaan Jaff
3e7ec4714d Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
2024-05-23 16:01:24 -07:00
Ishaan Jaff
e6e33f1a2d docs - lakera ai prompt inj detection 2024-05-23 15:59:42 -07:00
Ishaan Jaff
d1aff73a5e docs - Prompt Injection Detection 2024-05-23 15:55:43 -07:00
Ishaan Jaff
9b9f216fa5 docs - update enterprise tier docs 2024-05-23 15:47:20 -07:00
Ishaan Jaff
bd2bdfa01e Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix]  async_post_call_streaming_hook not triggered on proxy server
2024-05-23 15:35:47 -07:00
Ishaan Jaff
8df6de3fdf docs - content mod 2024-05-23 14:33:52 -07:00
Ishaan Jaff
27798b7131 docs - fix litellm call hooks docs 2024-05-23 09:34:38 -07:00
Krrish Dholakia
b20252b171 docs(users.md): add ui infographic to users.md 2024-05-22 21:11:00 -07:00
Ishaan Jaff
f2a6c45261 docs - set budgets for members in a team 2024-05-22 19:43:48 -07:00
Ishaan Jaff
5494445db2 docs - end user rate limiting 2024-05-22 16:20:25 -07:00
Ishaan Jaff
ef9adfced4 Merge pull request #3772 from BerriAI/litellm_create_keys_with_permissions
[Feat] Proxy - Create Keys that can only access `/spend` routes on Admin UI
2024-05-21 18:53:49 -07:00
Ishaan Jaff
408cf79a29 docs - invite team members to access /spend routes 2024-05-21 18:53:26 -07:00
Krrish Dholakia
1e77a70d1a docs(input.md): add anthropic tool choice support to docs 2024-05-21 17:56:21 -07:00
Ishaan Jaff
f7e49d4996 Merge pull request #3763 from BerriAI/docs_add_meta_llama3
docs - add bedrock meta llama3
2024-05-21 10:39:26 -07:00
Ishaan Jaff
96aca2ece8 docs - add bedrock meta llama3 2024-05-21 10:38:50 -07:00
alisalim17
fe0e600062 Revert "Revert "Logfire Integration""
This reverts commit b04a8d878a.
2024-05-21 11:07:40 +04:00
Krish Dholakia
f3a47e4b1a Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Krish Dholakia
db77e41833 Merge pull request #3740 from BerriAI/litellm_return_rejected_response
feat(proxy_server.py): allow admin to return rejected response as string to user
2024-05-20 17:48:21 -07:00
Krrish Dholakia
b80ec2a08b docs(alerting.md): add webhook event spec to docs 2024-05-20 17:26:04 -07:00
Ishaan Jaff
28d1bde250 Merge pull request #3739 from BerriAI/litellm_add_imagen_support
[FEAT] Async VertexAI Image Generation
2024-05-20 14:14:43 -07:00
Ishaan Jaff
883a9eb69a add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Krrish Dholakia
9059d09149 docs(call_hooks.md): update docs 2024-05-20 12:45:03 -07:00
Ishaan Jaff
d2b951a6bc docs - image generation vertex 2024-05-20 12:18:31 -07:00
Krrish Dholakia
2affc7bba5 docs(debugging.md): add json logs to proxy docs 2024-05-20 09:29:30 -07:00
Krrish Dholakia
4664163c12 docs(enterprise.md): cleanup docs 2024-05-17 15:34:50 -07:00
Krrish Dholakia
22b96c53b7 docs(proxy/enterprise.md): update enterprise docs 2024-05-17 15:34:00 -07:00
Krrish Dholakia
e7c6567c19 docs(enterprise.md): add swagger - custom routes + branding to docs 2024-05-17 15:31:02 -07:00
Krrish Dholakia
8405fee205 fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Krish Dholakia
04c7a5eb7b Merge pull request #3703 from msabramo/msabramo/make-langsmith-integration-work-with-custom-langsmith
Work with custom `LANGSMITH_BASE_URL`
2024-05-16 22:23:09 -07:00
Krrish Dholakia
28dd97e8e8 docs(billing.md): update billing tutorial to show how to bill internal teams 2024-05-16 17:49:06 -07:00
Marc Abramowitz
ee98b1b355 Work with custom LANGSMITH_BASE_URL
This allows working with a custom Langsmith base URL. For example,
I can use this to test against a local Langsmith instance, running on
my laptop with Docker by adding this to the proxy config:

```yaml
litellm_settings:
  success_callback: ["langsmith"]

environment_variables:
  LANGSMITH_BASE_URL: "http://localhost:1984"
  LANGSMITH_PROJECT: "litellm-proxy"
```
2024-05-16 17:13:01 -07:00
Ishaan Jaff
60ea7f529a docs - alerting 2024-05-16 16:59:01 -07:00
Ishaan Jaff
730dd1db2c docs - setting alert types 2024-05-16 16:57:54 -07:00
Ishaan Jaff
4be6dd7a73 Merge pull request #3694 from BerriAI/litellm_allow_setting_anthropic_beta
[Feat] Support Anthropic `tools-2024-05-16` - Set Custom Anthropic Custom Headers
2024-05-16 15:48:26 -07:00
Krrish Dholakia
7b7b2d276f docs(billing.md): update lago screenshot 2024-05-16 15:30:33 -07:00
Krrish Dholakia
c579f758fc docs(billing.md): improve proxy billing tutorial 2024-05-16 15:27:23 -07:00
Ishaan Jaff
a8c7a335c2 docs - Setting anthropic-beta Header in Requests 2024-05-16 14:55:29 -07:00
Krrish Dholakia
f52cd2b9ab docs(billing.md): add tutorial on billing with litellm + lago to docs 2024-05-16 14:13:39 -07:00
Krrish Dholakia
840027f001 docs(lago.md): add lago usage-based billing quick-start to docs 2024-05-16 13:24:04 -07:00
Ishaan Jaff
c98cb19ba1 add gpt-4o to openai vision docs 2024-05-16 12:43:40 -07:00
Ishaan Jaff
c6e91daad7 Merge pull request #3543 from kmheckel/main
Updated Ollama cost models to include LLaMa3 and Mistral/Mixtral Instruct series
2024-05-15 20:50:50 -07:00