Ishaan Jaff
2da89a0c8e
fix vertex test
2024-05-20 10:51:25 -07:00
Ishaan Jaff
2519879e67
add ImageObject
2024-05-20 10:45:37 -07:00
Ishaan Jaff
24951d44a4
feat - working httpx requests vertex ai image gen
2024-05-20 09:51:15 -07:00
Ishaan Jaff
5ba5f15b56
test - test_aimage_generation_vertex_ai
2024-05-20 08:14:43 -07:00
Krish Dholakia
bb85a5e6b2
Merge pull request #3729 from BerriAI/litellm_vertex_history
...
fix(vertex_ai.py): support passing in result of tool call to vertex
2024-05-20 07:33:05 -07:00
Krrish Dholakia
45c46a84d0
fix(vertex_ai.py): support passing system instructions to vertex ai
2024-05-20 06:18:19 -07:00
Krish Dholakia
c94ce069f7
Merge pull request #3724 from BerriAI/litellm_gpt_4_response_format_drop_params
...
fix(utils.py): drop response_format if 'drop_params=True' for gpt-4
2024-05-19 12:35:13 -07:00
Krrish Dholakia
65aacc0c1a
fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls
2024-05-19 12:30:24 -07:00
Krrish Dholakia
f9ab72841a
fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py
2024-05-19 12:22:21 -07:00
Krrish Dholakia
a2c66ed4fb
fix(vertex_ai.py): support passing in result of tool call to vertex
...
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krrish Dholakia
12942c39db
fix(utils.py): drop response_format if 'drop_params=True' for gpt-4
2024-05-18 13:02:48 -07:00
Krish Dholakia
5e5179e476
Merge branch 'main' into litellm_model_id_fix
2024-05-17 22:36:17 -07:00
Krrish Dholakia
5d3fe52a08
test: fix test
2024-05-17 22:35:34 -07:00
Krrish Dholakia
1cecdc4690
fix(utils.py): fix replicate completion cost calculation
2024-05-17 22:18:57 -07:00
Ishaan Jaff
c8a1cf6ce2
(ci/cd) run again
2024-05-17 22:07:21 -07:00
Krrish Dholakia
a75b865ebc
test(test_config.py): fix test
2024-05-17 22:00:44 -07:00
Krish Dholakia
3a06fe2818
Merge branch 'main' into litellm_bedrock_anthropic_fix
2024-05-17 17:47:32 -07:00
Krrish Dholakia
4682802444
fix(bedrock_httpx.py): raise better timeout exception
2024-05-17 17:16:36 -07:00
Krrish Dholakia
5d24a72b7e
fix(bedrock_httpx.py): support mapping for bedrock cohere command r text
2024-05-17 16:13:49 -07:00
Krrish Dholakia
21f2ba6f1f
fix(bedrock_httpx.py): logging fixes
2024-05-16 23:20:51 -07:00
Krrish Dholakia
92c2e2af6a
fix(bedrock_httpx.py): add async support for bedrock amazon, meta, mistral models
2024-05-16 22:39:25 -07:00
Krrish Dholakia
0293f7766a
fix(bedrock_httpx.py): move bedrock ai21 calls to being async
2024-05-16 22:21:30 -07:00
Krrish Dholakia
180bc46ca4
fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
...
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Ishaan Jaff
12d2dcd48c
ci/cd run again
2024-05-16 21:15:06 -07:00
Ishaan Jaff
ee98074273
ci/cd run again
2024-05-16 18:35:43 -07:00
Ishaan Jaff
729e34ffea
(ci/cd) fix - assert len(completed_str)
2024-05-16 18:06:48 -07:00
Krrish Dholakia
709373b15c
fix(replicate.py): move replicate calls to being completely async
...
Closes https://github.com/BerriAI/litellm/issues/3128
2024-05-16 17:24:08 -07:00
Krrish Dholakia
a2a5884df1
fix(utils.py): allow passing in custom pricing to completion_cost as params
2024-05-16 16:24:44 -07:00
Ishaan Jaff
97324800ec
Merge pull request #3694 from BerriAI/litellm_allow_setting_anthropic_beta
...
[Feat] Support Anthropic `tools-2024-05-16` - Set Custom Anthropic Custom Headers
2024-05-16 15:48:26 -07:00
Ishaan Jaff
e19e475c9f
test - setting extra headers for anthropic tool use
2024-05-16 14:41:26 -07:00
Ishaan Jaff
a2ef089667
fix - choices index for gemini/ provider
2024-05-16 13:52:46 -07:00
Ishaan Jaff
0a816b2c45
Merge pull request #3682 from BerriAI/litellm_token_counter_endpoint
...
[Feat] `token_counter` endpoint
2024-05-16 13:39:23 -07:00
Ishaan Jaff
4a5e6aa43c
test - token count response
2024-05-16 13:20:01 -07:00
Krish Dholakia
ea976d8c30
Merge pull request #3663 from msabramo/msabramo/allow-non-admins-to-use-openai-routes
...
Allow non-admins to use `/engines/{model}/chat/completions`
2024-05-16 12:17:50 -07:00
Marc Abramowitz
4194bafae0
Add nicer test ids when using pytest -v
...
Replace:
```
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route0] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route10] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route11] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route12] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route13] PASSED
test_key_generate_prisma.py::test_generate_and_call_with_valid_key[api_route14] PASSED
````
with:
```
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'audio_transcriptions', 'path': '/audio/transcriptions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'audio_transcriptions', 'path': '/v1/audio/transcriptions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/engines/{model}/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/openai/deployments/{model}/chat/completions'}] PASSED
litellm/tests/test_key_generate_prisma.py::test_generate_and_call_with_valid_key[{'route': 'chat_completion', 'path': '/v1/chat/completions'}] PASSED
```
2024-05-16 11:34:22 -07:00
Marc Abramowitz
cf71857354
Add more routes to test_generate_and_call_with_valid_key
2024-05-16 10:44:36 -07:00
Marc Abramowitz
dc52c83b88
Add more routes to test_generate_and_call_with_valid_key
2024-05-16 10:05:35 -07:00
Marc Abramowitz
d5b2e8e7e8
Make test_generate_and_call_with_valid_key parametrized
...
This allows us to test the same code with different routes.
For example, it lets us test the `/engines/{model}/chat/completions`
route, which https://github.com/BerriAI/litellm/pull/3663 fixes.
2024-05-16 09:54:10 -07:00
lj
603705661a
Update model config in test_config.py
2024-05-16 16:51:36 +08:00
Krish Dholakia
57d425aed7
Merge pull request #3666 from BerriAI/litellm_jwt_fix
...
feat(proxy_server.py): JWT-Auth improvements
2024-05-15 22:22:44 -07:00
Krrish Dholakia
600b6f7e1d
feat(proxy_server.py): support 'user_id_upsert' flag for jwt_auth
2024-05-15 22:19:59 -07:00
Krrish Dholakia
99653d2d3e
feat(handle_jwt.py): add support for 'team_id_default
...
allows admin to set a default team id for spend-tracking + permissions
2024-05-15 21:33:35 -07:00
Ishaan Jaff
bb86d2510f
(ci/cd) run again
2024-05-15 21:07:55 -07:00
Krrish Dholakia
f48cd87cf3
feat(proxy_server.py): make team_id optional for jwt token auth (only enforced, if set)
...
Allows users to use jwt auth for internal chat apps
2024-05-15 21:05:14 -07:00
Ishaan Jaff
7aac76b485
Merge pull request #3662 from BerriAI/litellm_feat_predibase_exceptions
...
[Fix] Mask API Keys from Predibase AuthenticationErrors
2024-05-15 20:45:40 -07:00
Krish Dholakia
25e4b34574
Merge pull request #3660 from BerriAI/litellm_proxy_ui_general_settings
...
feat(proxy_server.py): Enabling Admin to control general settings on proxy ui
2024-05-15 20:36:42 -07:00
Ishaan Jaff
e49fa9bd2c
(ci/cd) run again
2024-05-15 20:29:23 -07:00
Krrish Dholakia
594ca947c8
fix(parallel_request_limiter.py): fix max parallel request limiter on retries
2024-05-15 20:16:11 -07:00
Ishaan Jaff
c2a306c4dd
(ci/cd) run again
2024-05-15 20:03:30 -07:00
Ishaan Jaff
136746abc9
fix test config
2024-05-15 19:42:39 -07:00
