Commit graph

11876 commits

Author SHA1 Message Date
Krrish Dholakia
4682802444 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Ishaan Jaff
04648ee368 fix - enter base_model on azure 2024-05-17 17:02:01 -07:00
Krrish Dholakia
b486bb1f8b fix(utils.py): exception map bedrock error 2024-05-17 16:18:25 -07:00
Krrish Dholakia
5d24a72b7e fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Ishaan Jaff
be273b3c3b fix - show correct base_model in slack alerts 2024-05-17 16:07:02 -07:00
Krrish Dholakia
afd2d73b33 bump: version 1.37.14 → 1.37.15 2024-05-17 15:49:55 -07:00
Krrish Dholakia
29a26af298 fix(litellm_license.py): fix json handling 2024-05-17 15:48:39 -07:00
Krrish Dholakia
a8d7ce3657 docs(enterprise.md): cleanup docs 2024-05-17 15:34:50 -07:00
Krrish Dholakia
604a867f90 docs(proxy/enterprise.md): update enterprise docs 2024-05-17 15:34:00 -07:00
Krrish Dholakia
b723e608f6 docs(enterprise.md): add swagger - custom routes + branding to docs 2024-05-17 15:31:02 -07:00
Krrish Dholakia
c0d62e94ae feat(proxy_server.py): enable custom branding + routes on openapi docs
Allows user to add their branding + show only openai routes on docs
2024-05-17 15:21:29 -07:00
Ishaan Jaff
f1a482f358
Merge pull request #3710 from BerriAI/litellm_fix_llm_utils_auth
fix - allow non master key to access llm_utils_routes
2024-05-17 13:52:22 -07:00
hugo.lima
32e25cdb11 added decoding of base64 image data in _gemini_vision_convert_messages function 2024-05-17 16:46:56 +01:00
Ishaan Jaff
cae5ecea8e fix llm utils routes 2024-05-17 08:41:46 -07:00
Ishaan Jaff
c1ed863dfa fix - allow non master key to access llm_utils_routes 2024-05-17 08:25:10 -07:00
Krrish Dholakia
26aefc7cd6 fix(utils.py): support openrouter function calling 2024-05-17 08:02:24 -07:00
Krrish Dholakia
186f11612a bump: version 1.37.13 → 1.37.14 2024-05-17 00:41:24 -07:00
Krrish Dholakia
32a04c59cf fix(anthropic.py): bump default anthropic api version for tool use 2024-05-17 00:41:11 -07:00
Krrish Dholakia
9aa05c19d1 fix(bedrock_httpx.py): fix bedrock logging 2024-05-16 23:53:54 -07:00
Krrish Dholakia
0258351c61 fix(main.py): fix async stream handling during bedrock error 2024-05-16 23:37:59 -07:00
Krrish Dholakia
21f2ba6f1f fix(bedrock_httpx.py): logging fixes 2024-05-16 23:20:51 -07:00
Krrish Dholakia
92c2e2af6a fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models 2024-05-16 22:39:25 -07:00
Krish Dholakia
d9ce94ae23
Merge pull request #3703 from msabramo/msabramo/make-langsmith-integration-work-with-custom-langsmith
Work with custom `LANGSMITH_BASE_URL`
2024-05-16 22:23:09 -07:00
Krrish Dholakia
0293f7766a fix(bedrock_httpx.py): move bedrock ai21 calls to being async 2024-05-16 22:21:30 -07:00
Krrish Dholakia
180bc46ca4 fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Ishaan Jaff
12d2dcd48c ci/cd run again 2024-05-16 21:15:06 -07:00
Krrish Dholakia
10a672634d fix(proxy_server.py): fix invalid header string 2024-05-16 21:05:40 -07:00
Ishaan Jaff
ee98074273 ci/cd run again 2024-05-16 18:35:43 -07:00
Ishaan Jaff
729e34ffea (ci/cd) fix - assert len(completed_str) 2024-05-16 18:06:48 -07:00
Krrish Dholakia
c5f0918682 docs(billing.md): update billing tutorial to show how to bill internal teams 2024-05-16 17:49:06 -07:00
Ishaan Jaff
fdc9690537
Merge pull request #3706 from Manouchehri/fix-azure-openai-3695
Fix(router.py): Kill a bug that forced Azure OpenAI to have an API ke…
2024-05-16 17:44:48 -07:00
Krish Dholakia
7502e15295
Merge pull request #3701 from paneru-rajan/Issue-3675-remove-empty-valued-header
Exclude custom headers from response if the value is None or empty string
2024-05-16 17:42:07 -07:00
David Manouchehri
50accc327c
Fix(router.py): Kill a bug that forced Azure OpenAI to have an API key, even though we can use OIDC instead. 2024-05-17 00:37:56 +00:00
Ishaan Jaff
4952e244d9
Merge pull request #3705 from BerriAI/litellm_add_cost_tracking_for_ft_models
[FEAT] add cost tracking for Fine Tuned OpenAI `ft:davinci-002` and `ft:babbage-002`
2024-05-16 17:37:35 -07:00
Rajan Paneru
e4ce10038a use default empty str if the allowed_model_region attribute is not present 2024-05-17 10:05:18 +09:30
Ishaan Jaff
28ae8284df fix add cost tracking for OpenAI ft models 2024-05-16 17:31:19 -07:00
Krish Dholakia
f68eb6f74e
Merge pull request #3704 from BerriAI/litellm_replicate_async_fxi
fix(replicate.py): move replicate calls to being async
2024-05-16 17:27:12 -07:00
Rajan Paneru
54f8d06057 handle exception and logged it 2024-05-17 09:55:13 +09:30
Ishaan Jaff
7b60fae6f9 feat - add cost tracking for OpenAI Fine tuned models 2024-05-16 17:24:15 -07:00
Krrish Dholakia
709373b15c fix(replicate.py): move replicate calls to being completely async
Closes https://github.com/BerriAI/litellm/issues/3128
2024-05-16 17:24:08 -07:00
Marc Abramowitz
bf4f08ac30 Work with custom LANGSMITH_BASE_URL
This allows working with a custom Langsmith base URL. For example,
I can use this to test against a local Langsmith instance, running on
my laptop with Docker by adding this to the proxy config:

```yaml
litellm_settings:
  success_callback: ["langsmith"]

environment_variables:
  LANGSMITH_BASE_URL: "http://localhost:1984"
  LANGSMITH_PROJECT: "litellm-proxy"
```
2024-05-16 17:13:01 -07:00
Ishaan Jaff
40bb675156 bump: version 1.37.12 → 1.37.13 2024-05-16 17:08:47 -07:00
Ishaan Jaff
bd63af395f ui - new build 2024-05-16 17:08:36 -07:00
Ishaan Jaff
a2ac6a672e
Merge pull request #3702 from BerriAI/litellm_separate_slack_alerts_channel
[Fix] allow users to opt into specific alert types + Introduce `spend_report` alert type
2024-05-16 17:05:36 -07:00
Ishaan Jaff
7d4f2aaca3 docs - alerting 2024-05-16 16:59:01 -07:00
Ishaan Jaff
53ae4654c4 docs - setting alert types 2024-05-16 16:57:54 -07:00
Ishaan Jaff
a292583ff1 fix - allow users to opt into specific alert types 2024-05-16 16:52:44 -07:00
Rajan Paneru
85679470c2 Exclude custom headers from response if the value is None or empty string
This will return clean header, sending a header with empty value is not standard which
is being avoided from this fix.
2024-05-17 09:06:58 +09:30
Ishaan Jaff
f3d340bd3a
Merge pull request #3700 from BerriAI/litellm_ui_round_team_spend
[UI] Fix Round Team Spend, and Show Key Alias on Top API Keys
2024-05-16 16:30:33 -07:00
Ishaan Jaff
20dc9e74af ui - show key alias on Top Keys instead of key_name 2024-05-16 16:27:35 -07:00