Commit graph

101 commits

Author SHA1 Message Date
Ishaan Jaff
c867f88c57 fix - add new types for ServiceLoggerPayload 2024-06-06 22:06:28 -07:00
Krrish Dholakia
c1f987e5d3 fix(types/router.py): add 'drop_params' as a litellm param to router types 2024-06-05 09:12:45 -07:00
Krrish Dholakia
20cb525a5c feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Krish Dholakia
127d1457de Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support
feat(assistants/main.py): Azure Assistants API support
2024-06-03 21:05:03 -07:00
Krrish Dholakia
a2ba63955a feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
Ishaan Jaff
fb9a174462 feat - set allowed fails policy 2024-06-01 17:39:44 -07:00
Ishaan Jaff
a11175c05b feat - set custom AllowedFailsPolicy 2024-06-01 17:26:21 -07:00
Krish Dholakia
1529f665cc Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
8ff137bce3 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00
Krish Dholakia
c049b6b4af Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Krrish Dholakia
2fdf4a7bb4 feat(proxy_server.py): add assistants api endpoints to proxy server 2024-05-30 22:44:43 -07:00
lj
f1fe41db74 Merge branch 'main' into fix-pydantic-warnings-again 2024-05-31 11:35:42 +08:00
Krrish Dholakia
eb159b64e1 fix(openai.py): fix openai response for /audio/speech endpoint 2024-05-30 16:41:06 -07:00
Krrish Dholakia
1e89a1f56e feat(main.py): support openai tts endpoint
Closes https://github.com/BerriAI/litellm/issues/3094
2024-05-30 14:28:28 -07:00
Krrish Dholakia
a4dae8e9f1 docs(customers.md): add customer cost tracking to docs 2024-05-29 14:55:33 -07:00
Ishaan Jaff
cd4a3627e8 feat - add afile_content, file_content 2024-05-28 20:58:22 -07:00
Ishaan Jaff
9daf02e977 fix python 3.8 error 2024-05-28 17:21:59 -07:00
Ishaan Jaff
fc4ca265b8 working create_batch 2024-05-28 15:45:23 -07:00
Ishaan Jaff
4dc7bfebd4 feat - import batches in __init__ 2024-05-28 15:35:11 -07:00
Ishaan Jaff
f83c81a2d8 feat - add batches types 2024-05-28 12:53:46 -07:00
Ishaan Jaff
5fed67dcc3 Merge pull request #3868 from BerriAI/litellm_show_updated_created_models
[Feat] Show Created at, Created by on `Models` Page
2024-05-27 16:32:29 -07:00
Ishaan Jaff
d7043baf6d router - include updated at and created at in model info 2024-05-27 15:53:16 -07:00
Krrish Dholakia
23b28601b7 fix(fix-'get_model_group_info'-to-return-a-default-value-if-unmapped-model-group): allows model hub to return all model groupss 2024-05-27 13:53:01 -07:00
Ishaan Jaff
69ea7d57fb feat - show openai params on model hub ui 2024-05-27 08:49:51 -07:00
Krrish Dholakia
8e9a3fef81 feat(proxy_server.py): expose new /model_group/info endpoint
returns model-group level info on supported params, max tokens, pricing, etc.
2024-05-26 14:07:35 -07:00
Krrish Dholakia
c50074a0b7 feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Krrish Dholakia
143a44823a feat(databricks.py): adds databricks support - completion, async, streaming
Closes https://github.com/BerriAI/litellm/issues/2160
2024-05-23 16:29:46 -07:00
Krrish Dholakia
4795c56f84 feat(anthropic.py): support anthropic 'tool_choice' param
Closes https://github.com/BerriAI/litellm/issues/3752
2024-05-21 17:50:44 -07:00
Krrish Dholakia
fa89342ec4 fix(types/vertex_ai.py): fix typing 2024-05-19 12:36:05 -07:00
Krrish Dholakia
86ecb4638c fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Ishaan Jaff
f92dd0ec9b fix - show correct base_model in slack alerts 2024-05-17 16:07:02 -07:00
lj
eee9be353a Removed config dict type definition 2024-05-17 10:39:00 +08:00
Krrish Dholakia
782b44818c fix(utils.py): allow passing in custom pricing to completion_cost as params 2024-05-16 16:24:44 -07:00
lj
6516691512 Update model config in router.py 2024-05-16 16:53:05 +08:00
lj
84e6ebe405 Update model config in embedding.py 2024-05-16 16:52:44 +08:00
lj
f6cda5876f Update model config in completion.py 2024-05-16 16:52:21 +08:00
Ishaan Jaff
27b64ec0a9 fix types/router.py 2024-05-15 19:46:30 -07:00
Ishaan Jaff
59180f3be4 revert changes to types/completion.py 2024-05-15 19:45:16 -07:00
Krrish Dholakia
9613f67f08 fix(types/init.py): don't import openai assistants types by default 2024-05-15 08:50:31 -07:00
Krrish Dholakia
57fb1ec852 fix(types): fix typing 2024-05-14 17:09:36 -07:00
Krrish Dholakia
46d2d6bba9 fix(types/router.py): fix python3.8 typing issue 2024-05-14 16:56:07 -07:00
Krrish Dholakia
56d50695fe fix(types/router.py): fix arbitrary_types_allowed flag 2024-05-14 16:53:02 -07:00
Krrish Dholakia
fdee5b962b fix(types/router.py): fix router pydantic v1 errors 2024-05-14 16:49:55 -07:00
Krrish Dholakia
487567a77f fix(types/completion.py): fix completion configdict pydantic v1 error 2024-05-14 16:39:50 -07:00
Krrish Dholakia
76e19a3695 fix(types/completion.py): linting fixes 2024-05-14 13:19:38 -07:00
Krrish Dholakia
3a55ec6b36 ci: test linting change for pydantic v1 2024-05-14 11:34:16 -07:00
Krish Dholakia
bef8a7f1d9 Merge pull request #3600 from msabramo/msabramo/fix-pydantic-warnings
Update pydantic code to fix warnings
2024-05-13 22:00:39 -07:00
Krrish Dholakia
6f20389bd5 feat(router.py): enable default fallbacks
allow user to define a generic list of fallbacks, in case a new deployment is bad

Closes https://github.com/BerriAI/litellm/issues/3623
2024-05-13 17:49:56 -07:00
Marc Abramowitz
b61cc97771 Merge branch 'msabramo/pydantic_replace_root_validator_with_model_validator' into msabramo/fix-pydantic-warnings 2024-05-13 11:25:55 -07:00
Marc Abramowitz
3048ea5129 Use Config class w/ arbitrary_types_allowed for pydantic v1
pydantic v2 warns about using a Config class.
But without this, pydantic v1 will raise an error:
    RuntimeError: no validator found for <class 'openai.Timeout'>,
    see `arbitrary_types_allowed` in Config
Putting arbitrary_types_allowed = True in the ConfigDict doesn't work in pydantic v1.
So we mostly use model_config = ConfigDict(...) and then only use the Config
class with arbitrary_types_allowed = True for pydantic v1.
2024-05-13 11:22:50 -07:00