Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object
2024-07-25 19:31:52 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b
2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
...
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main
...
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
...
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240
fix(custom_llm.py): pass input params to custom llm
2024-07-25 19:03:52 -07:00
Krrish Dholakia
bd7af04a72
feat(proxy_server.py): support custom llm handler on proxy
2024-07-25 17:56:34 -07:00
Ishaan Jaff
f2443996d8
feat support audio health checks for azure
2024-07-25 17:30:15 -07:00
Ishaan Jaff
2432c90515
feat - support health check audio_speech
2024-07-25 17:26:14 -07:00
Ishaan Jaff
e3142b4294
fix whisper health check with litellm
2024-07-25 17:22:57 -07:00
Krrish Dholakia
060249c7e0
feat(utils.py): support async streaming for custom llm provider
2024-07-25 17:11:57 -07:00
Krrish Dholakia
b4e3a77ad0
feat(utils.py): support sync streaming for custom llm provider
2024-07-25 16:47:32 -07:00
Krrish Dholakia
9f97436308
fix(custom_llm.py): support async completion calls
2024-07-25 15:51:39 -07:00
Krrish Dholakia
6bf1b9353b
feat(custom_llm.py): initial working commit for writing your own custom LLM handler
...
Fixes https://github.com/BerriAI/litellm/issues/4675
Also Addresses https://github.com/BerriAI/litellm/discussions/4677
2024-07-25 15:33:05 -07:00
Krrish Dholakia
711496e260
fix(router.py): add support for diskcache to router
2024-07-25 14:30:46 -07:00
Krrish Dholakia
bfdda089c8
fix(proxy_server.py): check if input list > 0 before indexing into it
...
resolves 'list index out of range' error
2024-07-25 14:23:07 -07:00
David Manouchehri
64adae6e7f
Check for converse support first.
2024-07-25 21:16:23 +00:00
David Manouchehri
22c66991ed
Support tool calling for Llama 3.1 on Amazon bedrock.
2024-07-25 20:36:25 +00:00
David Manouchehri
5c4ee3ef3c
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock.
2024-07-25 20:04:03 +00:00
David Manouchehri
3293ad7458
Add Llama 3.1 405b for Bedrock
2024-07-25 19:30:13 +00:00
fracapuano
5553f84d51
fix: now supports single tokens prediction
2024-07-25 19:06:07 +02:00
Krrish Dholakia
4e51f712f3
fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions
...
Fixes https://github.com/BerriAI/litellm/issues/749
2024-07-25 09:57:19 -07:00
Krrish Dholakia
b376ee71b0
fix(internal_user_endpoints.py): support updating budgets for /user/update
2024-07-24 21:51:46 -07:00
Ishaan Jaff
c77abaa07f
feat - add mistral large 2
2024-07-24 21:31:41 -07:00
Ishaan Jaff
4cd96976b3
feat - add groq/llama-3.1
2024-07-24 20:46:56 -07:00
Krrish Dholakia
3cd3491920
test: cleanup testing
2024-07-24 19:47:50 -07:00
wslee
40bb165108
support dynamic api base
2024-07-25 11:14:38 +09:00
wslee
dd10da4d46
add support for friendli dedicated endpoint
2024-07-25 11:14:35 +09:00
Krrish Dholakia
f35af3bf1c
test(test_completion.py): update azure extra headers
2024-07-24 18:42:50 -07:00
Krrish Dholakia
6ab2527fdc
feat(auth_check.py): support using redis cache for team objects
...
Allows team update / check logic to work across instances instantly
2024-07-24 18:14:49 -07:00
Krrish Dholakia
b5c5ed2209
fix(key_management_endpoints.py): if budget duration set, set budget_reset_at
2024-07-24 15:02:22 -07:00
Ishaan Jaff
53dd47c5cb
Merge pull request #4862 from BerriAI/litellm_fix_unsupported_params_Error
...
[Fix-litellm python] Raise correct error for UnsupportedParams Error
2024-07-24 14:26:25 -07:00
Krrish Dholakia
65705fde25
test(test_embedding.py): add simple azure embedding ad token test
...
Addresses https://github.com/BerriAI/litellm/issues/4859#issuecomment-2248838617
2024-07-24 13:38:03 -07:00
Krrish Dholakia
77ffee4e2e
test(test_completion.py): add basic test to confirm azure ad token flow works as expected
2024-07-24 13:07:25 -07:00
Krrish Dholakia
99d8b0ad68
fix(bedrock_httpx.py): fix async client check
2024-07-24 12:43:52 -07:00
Ishaan Jaff
30c27b3f92
test UnsupportedParamsError
2024-07-24 12:21:22 -07:00
Ishaan Jaff
8ea4b73c27
add UnsupportedParamsError to litellm exceptions
2024-07-24 12:20:14 -07:00
Ishaan Jaff
11512c057d
feat use UnsupportedParamsError as litellm error type
2024-07-24 12:19:10 -07:00
Krrish Dholakia
d9539e518e
build(docker-compose.yml): add prometheus scraper to docker compose
...
persists prometheus data across restarts
2024-07-24 10:09:23 -07:00
Ishaan Jaff
ac7f6598f3
Merge pull request #4853 from BerriAI/litellm_support_tags
...
[Feat] - Support Logging tags on langsmith
2024-07-24 09:51:56 -07:00
Ishaan Jaff
9c2c231c7c
Merge pull request #4857 from Manouchehri/improve-oidc-tests-5
...
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 09:48:01 -07:00
Ishaan Jaff
691c1a5355
Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1
...
Add Llama 3.1 for Bedrock
2024-07-24 09:47:32 -07:00
David Manouchehri
ced03d9d7f
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 16:41:24 +00:00
Krish Dholakia
035d03c7f2
Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning
...
Fix `test_prompt_factory` flake8 warning
2024-07-24 09:38:48 -07:00
Marc Abramowitz
a50fe3e1ca
Fix test_prompt_factory flake8 warning
...
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```
Fixed by making the string a raw string, which is equivalent:
```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```
See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
2024-07-24 09:14:22 -07:00
David Manouchehri
c364a3129e
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 16:05:58 +00:00
David Manouchehri
4b89397136
(tests) - Skip embedding Azure AD test for now.
2024-07-24 15:42:57 +00:00
David Manouchehri
af3a900b4d
(tests) - Try azure AD auth directly.
2024-07-24 15:42:40 +00:00
Krish Dholakia
bd9486501d
Merge pull request #4846 from msabramo/speed-up-check_view_exists
...
Check existence of multiple views in 1 query
2024-07-24 08:06:04 -07:00
Krrish Dholakia
41fda47587
test(test_embedding.py): fix base url
2024-07-24 08:04:27 -07:00
