Krish Dholakia
c1bfbc882f
Litellm dev 10 26 2024 ( #6472 )
...
* docs(exception_mapping.md): add missing exception types
Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183
* fix(main.py): register custom model pricing with specific key
Ensure custom model pricing is registered to the specific model+provider key combination
* test: make testing more robust for custom pricing
* fix(redis_cache.py): instrument otel logging for sync redis calls
ensures complete coverage for all redis cache calls
2024-10-28 15:05:43 -07:00
Krish Dholakia
f3fa2160a0
LiteLLM Minor Fixes & Improvements (09/21/2024) ( #5819 )
...
* fix(router.py): fix error message
* Litellm disable keys (#5814 )
* build(schema.prisma): allow blocking/unblocking keys
Fixes https://github.com/BerriAI/litellm/issues/5328
* fix(key_management_endpoints.py): fix pop
* feat(auth_checks.py): allow admin to enable/disable virtual keys
Closes https://github.com/BerriAI/litellm/issues/5328
* docs(vertex.md): add auth section for vertex ai
Addresses - https://github.com/BerriAI/litellm/issues/5768#issuecomment-2365284223
* build(model_prices_and_context_window.json): show which models support prompt_caching
Closes https://github.com/BerriAI/litellm/issues/5776
* fix(router.py): allow setting default priority for requests
* fix(router.py): add 'retry-after' header for concurrent request limit errors
Fixes https://github.com/BerriAI/litellm/issues/5783
* fix(router.py): correctly raise and use retry-after header from azure+openai
Fixes https://github.com/BerriAI/litellm/issues/5783
* fix(user_api_key_auth.py): fix valid token being none
* fix(auth_checks.py): fix model dump for cache management object
* fix(user_api_key_auth.py): pass prisma_client to obj
* test(test_otel.py): update test for new key check
* test: fix test
2024-09-21 18:51:53 -07:00
Krrish Dholakia
228da08b81
fix: fix tests
2024-08-07 15:02:04 -07:00
Krrish Dholakia
217f597860
fix: add type hints for APIError and AnthropicError status codes
...
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 15:08:54 -07:00
Krrish Dholakia
368af6975a
fix(http_handler.py): correctly re-raise timeout exception
2024-07-31 14:51:28 -07:00
Krrish Dholakia
708b427a04
fix(utils.py): correctly re-raise azure api connection error
...
'
2024-07-29 12:28:25 -07:00
Krrish Dholakia
7de70a19e4
fix(exceptions.py): use correct status code for content policy exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4941#issuecomment-2256578732
2024-07-29 12:01:54 -07:00
Ishaan Jaff
2dc6367dc9
feat use UnsupportedParamsError as litellm error type
2024-07-24 12:19:10 -07:00
Ishaan Jaff
52370fee12
fix testing exception mapping
2024-07-13 11:10:13 -07:00
Krrish Dholakia
8ba78aae77
fix(utils.py): support json schema validation
2024-06-29 15:05:52 -07:00
Krrish Dholakia
40bd069c39
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Krrish Dholakia
734bd5ef85
feat(router.py): support content policy fallbacks
...
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
e2a3895dfc
fix(http_handler.py): add retry logic on httpx.remoteprotocolerror
2024-06-13 14:05:29 -07:00
Ishaan Jaff
baafe32ba7
fix - show model group in exceptions
2024-06-10 20:30:31 -07:00
Krrish Dholakia
39ee6be477
fix(utils.py): improved predibase exception mapping
...
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Krrish Dholakia
6f3468aee4
fix(utils.py): fix exception mapping for azure internal server error
2024-06-06 17:12:30 -07:00
Ishaan Jaff
24fbad1ed5
feat add InternalServerError
2024-06-04 08:15:06 -07:00
Ishaan Jaff
2341d99bdc
feat - add num retries and max retries in exception
2024-06-01 16:53:00 -07:00
Ishaan Jaff
0c97694833
feat - include LiteLLM Retried and max retries in exception
2024-06-01 16:40:14 -07:00
Krrish Dholakia
bb3c786194
fix(proxy_server.py): fix end user object check when master key used
...
check if end user max budget exceeded for master key
2024-05-29 17:20:59 -07:00
Krrish Dholakia
8fb8d068fb
feat(proxy_server.py): refactor returning rejected message, to work with error logging
...
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Ishaan Jaff
b645d8dcf9
fix - show litellm_debug_info
2024-05-15 13:07:04 -07:00
Ishaan Jaff
9cc30e32b3
(Fix) - linting errors
2024-05-11 15:57:06 -07:00
jinno
21c1fdf152
fix(exceptions.py): import openai Exceptions
2024-05-02 21:43:50 +09:00
Ishaan Jaff
27c79b583f
fix - show api_base, model in exceptions
2024-04-24 14:03:48 -07:00
Krrish Dholakia
a1aeb7b404
fix(main.py): map list input to ollama prompt input format
2024-02-16 09:57:51 -08:00
Krrish Dholakia
cc89aa7456
fix(bedrock.py): add support for sts based boto3 initialization
...
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
66b23ecbb5
(v0) add ContentPolicyViolationError
2024-01-09 16:33:03 +05:30
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
ishaan-jaff
0530d16595
(feat) add openai.NotFoundError
2023-12-15 10:18:02 +05:30
Krrish Dholakia
c673a23769
fix(vertex_ai.py): add exception mapping for acompletion calls
2023-12-13 16:35:50 -08:00
Krrish Dholakia
3e3bb0180d
fix(proxy_server.py): run ollama serve when ollama in config.yaml
2023-11-21 08:35:04 -08:00
Krrish Dholakia
35e5a757b0
fix(openai.py-+-azure.py): fix linting issues
2023-11-20 19:29:23 -08:00
Krrish Dholakia
c7e2cbd995
fix(utils.py): adding support for rules + mythomax/alpaca prompt template
2023-11-20 18:58:15 -08:00
Krrish Dholakia
e5929f2f7e
fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy
2023-11-15 13:15:16 -08:00
Krrish Dholakia
9b582b2c85
fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors
2023-11-14 16:26:05 -08:00
ishaan-jaff
a1a041b305
(fix) linting error
2023-11-14 15:07:43 -08:00
ishaan-jaff
ebdd559175
(fix) APIError set body=None
2023-11-14 14:50:22 -08:00
Jack Collins
bcc1ab6605
Add response and body to APIStatus init call
2023-11-13 21:17:47 -08:00
Krrish Dholakia
b6eea3cf8e
fix(timeout.py): fix timeout issue
2023-11-13 11:07:17 -08:00
Krrish Dholakia
4b74ddcb17
refactor: fixing linting issues
2023-11-11 18:52:28 -08:00
Krrish Dholakia
a5ec85b1f2
refactor(openai.py): making it compatible for openai v1
...
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
Krrish Dholakia
7cf5be98a2
add contributor message to code
2023-09-25 10:00:10 -07:00
Krrish Dholakia
e3293ee264
exposing a litellm.max budget
2023-09-14 14:20:06 -07:00
Krrish Dholakia
fba212d426
fix linting issues
2023-09-06 10:41:52 -07:00
Krrish Dholakia
1d10d3198d
updates to exception mapping
2023-09-06 10:36:22 -07:00
Krrish Dholakia
57dcd1fee9
update exception mapping and get model cost map
2023-09-04 11:53:20 -07:00
Krrish Dholakia
c790dfe323
adding exception handling for together ai
2023-08-29 12:29:59 -07:00
ishaan-jaff
b283005e7b
all fixes to linting
2023-08-18 11:56:44 -07:00
ishaan-jaff
bb70a55c91
mypy linting fixes 2
2023-08-18 11:16:31 -07:00
