Krish Dholakia
70111a7abd
Litellm dev 10 26 2024 ( #6472 )
...
* docs(exception_mapping.md): add missing exception types
Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183
* fix(main.py): register custom model pricing with specific key
Ensure custom model pricing is registered to the specific model+provider key combination
* test: make testing more robust for custom pricing
* fix(redis_cache.py): instrument otel logging for sync redis calls
ensures complete coverage for all redis cache calls
2024-10-28 15:05:43 -07:00
Krish Dholakia
8039b95aaf
LiteLLM Minor Fixes & Improvements (09/21/2024) ( #5819 )
...
* fix(router.py): fix error message
* Litellm disable keys (#5814 )
* build(schema.prisma): allow blocking/unblocking keys
Fixes https://github.com/BerriAI/litellm/issues/5328
* fix(key_management_endpoints.py): fix pop
* feat(auth_checks.py): allow admin to enable/disable virtual keys
Closes https://github.com/BerriAI/litellm/issues/5328
* docs(vertex.md): add auth section for vertex ai
Addresses - https://github.com/BerriAI/litellm/issues/5768#issuecomment-2365284223
* build(model_prices_and_context_window.json): show which models support prompt_caching
Closes https://github.com/BerriAI/litellm/issues/5776
* fix(router.py): allow setting default priority for requests
* fix(router.py): add 'retry-after' header for concurrent request limit errors
Fixes https://github.com/BerriAI/litellm/issues/5783
* fix(router.py): correctly raise and use retry-after header from azure+openai
Fixes https://github.com/BerriAI/litellm/issues/5783
* fix(user_api_key_auth.py): fix valid token being none
* fix(auth_checks.py): fix model dump for cache management object
* fix(user_api_key_auth.py): pass prisma_client to obj
* test(test_otel.py): update test for new key check
* test: fix test
2024-09-21 18:51:53 -07:00
Krrish Dholakia
ff373663a3
fix: fix tests
2024-08-07 15:02:04 -07:00
Krrish Dholakia
1affd4e2ca
fix: add type hints for APIError and AnthropicError status codes
...
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 15:08:54 -07:00
Krrish Dholakia
6202f9bbb0
fix(http_handler.py): correctly re-raise timeout exception
2024-07-31 14:51:28 -07:00
Krrish Dholakia
59384c84a5
fix(utils.py): correctly re-raise azure api connection error
...
'
2024-07-29 12:28:25 -07:00
Krrish Dholakia
66dbd938e8
fix(exceptions.py): use correct status code for content policy exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
2024-07-29 12:01:54 -07:00
Ishaan Jaff
11512c057d
feat use UnsupportedParamsError as litellm error type
2024-07-24 12:19:10 -07:00
Ishaan Jaff
bcc89a2c3a
fix testing exception mapping
2024-07-13 11:10:13 -07:00
Krrish Dholakia
b699d9a8b9
fix(utils.py): support json schema validation
2024-06-29 15:05:52 -07:00
Krrish Dholakia
123477b55a
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Krrish Dholakia
6f715b4782
feat(router.py): support content policy fallbacks
...
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
46d57526c4
fix(http_handler.py): add retry logic on httpx.remoteprotocolerror
2024-06-13 14:05:29 -07:00
Ishaan Jaff
b4db464604
fix - show model group in exceptions
2024-06-10 20:30:31 -07:00
Krrish Dholakia
1dafb1b3b7
fix(utils.py): improved predibase exception mapping
...
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Krrish Dholakia
6e9bca59b0
fix(utils.py): fix exception mapping for azure internal server error
2024-06-06 17:12:30 -07:00
Ishaan Jaff
be06413004
feat add InternalServerError
2024-06-04 08:15:06 -07:00
Ishaan Jaff
286d42a881
feat - add num retries and max retries in exception
2024-06-01 16:53:00 -07:00
Ishaan Jaff
40622f5f27
feat - include LiteLLM Retried and max retries in exception
2024-06-01 16:40:14 -07:00
Krrish Dholakia
cfcf5969c8
fix(proxy_server.py): fix end user object check when master key used
...
check if end user max budget exceeded for master key
2024-05-29 17:20:59 -07:00
Krrish Dholakia
f11f207ae6
feat(proxy_server.py): refactor returning rejected message, to work with error logging
...
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Ishaan Jaff
59e18f23e0
fix - show litellm_debug_info
2024-05-15 13:07:04 -07:00
Ishaan Jaff
91a6a0eef4
(Fix) - linting errors
2024-05-11 15:57:06 -07:00
jinno
ff8d1bc68c
fix(exceptions.py): import openai Exceptions
2024-05-02 21:43:50 +09:00
Ishaan Jaff
7a5c07de22
fix - show api_base, model in exceptions
2024-04-24 14:03:48 -07:00
Krrish Dholakia
944afcb5d1
fix(main.py): map list input to ollama prompt input format
2024-02-16 09:57:51 -08:00
Krrish Dholakia
8e9dc09955
fix(bedrock.py): add support for sts based boto3 initialization
...
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
09874cc83f
(v0) add ContentPolicyViolationError
2024-01-09 16:33:03 +05:30
Krrish Dholakia
4905929de3
refactor: add black formatting
2023-12-25 14:11:20 +05:30
ishaan-jaff
353433e5ce
(feat) add openai.NotFoundError
2023-12-15 10:18:02 +05:30
Krrish Dholakia
e678009695
fix(vertex_ai.py): add exception mapping for acompletion calls
2023-12-13 16:35:50 -08:00
Krrish Dholakia
846a824c47
fix(proxy_server.py): run ollama serve when ollama in config.yaml
2023-11-21 08:35:04 -08:00
Krrish Dholakia
1306addfe8
fix(openai.py-+-azure.py): fix linting issues
2023-11-20 19:29:23 -08:00
Krrish Dholakia
855964ed45
fix(utils.py): adding support for rules + mythomax/alpaca prompt template
2023-11-20 18:58:15 -08:00
Krrish Dholakia
8c104e9c6a
fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy
2023-11-15 13:15:16 -08:00
Krrish Dholakia
a7222f257c
fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors
2023-11-14 16:26:05 -08:00
ishaan-jaff
df156c7392
(fix) linting error
2023-11-14 15:07:43 -08:00
ishaan-jaff
30d52a26db
(fix) APIError set body=None
2023-11-14 14:50:22 -08:00
Jack Collins
f499e8bb1d
Add response and body to APIStatus init call
2023-11-13 21:17:47 -08:00
Krrish Dholakia
4340749ea3
fix(timeout.py): fix timeout issue
2023-11-13 11:07:17 -08:00
Krrish Dholakia
45b6f8b853
refactor: fixing linting issues
2023-11-11 18:52:28 -08:00
Krrish Dholakia
d3323ba637
refactor(openai.py): making it compatible for openai v1
...
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
Krrish Dholakia
bdc6ef1df8
add contributor message to code
2023-09-25 10:00:10 -07:00
Krrish Dholakia
73a084c19c
exposing a litellm.max budget
2023-09-14 14:20:06 -07:00
Krrish Dholakia
d236d68fa4
fix linting issues
2023-09-06 10:41:52 -07:00
Krrish Dholakia
ef43141554
updates to exception mapping
2023-09-06 10:36:22 -07:00
Krrish Dholakia
73bb1b96e9
update exception mapping and get model cost map
2023-09-04 11:53:20 -07:00
Krrish Dholakia
88bd1df3e0
adding exception handling for together ai
2023-08-29 12:29:59 -07:00
ishaan-jaff
1bb2aefea1
all fixes to linting
2023-08-18 11:56:44 -07:00
ishaan-jaff
fbcb6d1c20
mypy linting fixes 2
2023-08-18 11:16:31 -07:00
