Commit graph

833 commits

Author SHA1 Message Date
Krrish Dholakia
29fe97b6a9 fix(router.py): fix order of dereferenced dictionaries 2024-01-22 21:42:25 -08:00
Krish Dholakia
3eaae0e73c Merge pull request #1557 from BerriAI/litellm_emit_spend_logs
feat(utils.py): emit response cost as part of logs
2024-01-22 21:02:40 -08:00
Krrish Dholakia
579dfc3013 test: fix tests 2024-01-22 20:20:17 -08:00
Krrish Dholakia
db2b7bfd4e fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krish Dholakia
8647f2a665 Merge pull request #1556 from BerriAI/litellm_importlib_issue
fix(utils.py): move from pkg_resources to importlib
2024-01-22 15:56:07 -08:00
Krrish Dholakia
2ea18785ca feat(utils.py): emit response cost as part of logs 2024-01-22 15:53:04 -08:00
Krrish Dholakia
737a5a7b38 fix(utils.py): fix debug log 2024-01-22 15:15:34 -08:00
Krrish Dholakia
70b0d0307c refactor(utils.py): fix linting errors 2024-01-22 15:15:34 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Krrish Dholakia
85b9ad7def fix(main.py): support custom pricing for embedding calls 2024-01-22 15:15:34 -08:00
Krrish Dholakia
480c3d3991 feat(utils.py): support custom cost tracking per second
https://github.com/BerriAI/litellm/issues/1374
2024-01-22 15:15:34 -08:00
Krrish Dholakia
78308ddf91 fix(utils.py): move from pkg_resources to importlib 2024-01-22 15:05:09 -08:00
Krrish Dholakia
b55dd5aa57 fix(utils.py): fix async/sync streaming logging 2024-01-22 13:54:51 -08:00
Krrish Dholakia
f7b7dd0b6f fix(utils.py): fix callback logging 2024-01-21 00:56:30 -08:00
Krrish Dholakia
59483da18b fix: fix proxy logging 2024-01-20 18:22:45 -08:00
Krrish Dholakia
2acdcc6671 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
2ecc2f12cd fix(gemini.py): support streaming 2024-01-19 20:21:34 -08:00
Krrish Dholakia
b726b04309 fix(utils.py): revert exception mapping change 2024-01-19 17:39:35 -08:00
Krrish Dholakia
e957f41ab7 fix(utils.py): add metadata to logging obj on setup, if exists 2024-01-19 17:29:47 -08:00
ishaan-jaff
1d60edad57 (fix) async langfuse logger 2024-01-19 10:44:51 -08:00
ishaan-jaff
af808d4927 (fix) use asyncio run_in_executor 2024-01-19 09:52:51 -08:00
ishaan-jaff
8a7b01bfa2 (v0) fix 2024-01-19 08:51:14 -08:00
ishaan-jaff
d8d1cea69f (feat) support user param for all providers 2024-01-18 17:45:59 -08:00
ishaan-jaff
054d3a549e (feat) return Azure enahncements used 2024-01-17 18:46:41 -08:00
Krrish Dholakia
d4404fb61e fix(utils.py): fix if check 2024-01-17 17:17:58 -08:00
Krrish Dholakia
01a5e80df5 fix(utils.py): allow dynamically setting boto3 init and switching between bedrock and openai 2024-01-17 15:56:30 -08:00
Krrish Dholakia
cc89aa7456 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
Krrish Dholakia
2180977acf fix(utils.py): mistral optional param mapping 2024-01-17 09:44:21 -08:00
ishaan-jaff
83861730b5 (feat) improve bedrock, sagemaker exception mapping 2024-01-15 21:22:22 -08:00
ishaan-jaff
874358c398 (fix) post_call rules 2024-01-15 20:56:25 -08:00
ishaan-jaff
b1c93fdc52 (feat) post call rules - fail with error message 2024-01-15 17:13:13 -08:00
ishaan-jaff
823a932377 (feat) support extra body for Azure, OpenAI 2024-01-13 14:32:11 -08:00
ishaan-jaff
e67ac90796 (fix) check if custom_llm_provider is not None 2024-01-13 12:54:03 -08:00
ishaan-jaff
8e6d170da9 (feat) use custom_llm_provider in completion_cost 2024-01-13 12:29:51 -08:00
ishaan-jaff
69552146f9 (feat) return custom_llm_provider in streaming response 2024-01-12 17:14:43 -08:00
David Leen
1660e4ab72 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
Ishaan Jaff
8b0f93dd2d Merge pull request #1422 from dleen/httpx
(fix) create httpx.Request instead of httpx.request
2024-01-11 22:31:55 +05:30
David Leen
3cd5ef9a02 (fix) create httpx.Request instead of httpx.request
fixes #1420
2024-01-11 16:22:26 +01:00
ishaan-jaff
50aeec537c (feat) improve litellm verbose logs 2024-01-11 18:13:08 +05:30
ishaan-jaff
859eb0d98e (feat) show args passed to litellm.completion, acompletion on call 2024-01-11 17:56:27 +05:30
Ishaan Jaff
6e1be43595 Merge pull request #1200 from MateoCamara/explicit-args-acomplete
feat: added explicit args to acomplete
2024-01-11 10:39:05 +05:30
ishaan-jaff
426ce91481 (fix) working s3 logging 2024-01-11 08:57:32 +05:30
Krrish Dholakia
3ed296e2dd fix(utils.py): raise correct error for azure content blocked error 2024-01-10 23:31:51 +05:30
Mateo Cámara
fb37ea291e Merge branch 'main' into explicit-args-acomplete 2024-01-09 13:07:37 +01:00
Ishaan Jaff
b09f38e835 Merge pull request #1381 from BerriAI/litellm_content_policy_violation_exception
[Feat] Add litellm.ContentPolicyViolationError
2024-01-09 17:18:29 +05:30
ishaan-jaff
650a6a8640 (chore) remove deprecated completion_with_config() tests 2024-01-09 17:13:06 +05:30
ishaan-jaff
1a4b522fbb (feat) add ContentPolicyViolationError for azure 2024-01-09 16:58:09 +05:30
ishaan-jaff
a6c45be9f2 (fix) ContentPolicyViolationError 2024-01-09 16:53:15 +05:30
Mateo Cámara
fb4b5eb4c1 Added test to check if acompletion is using the same parameters as CompletionRequest attributes. Added functools to client decorator to expose acompletion parameters from outside. 2024-01-09 12:06:49 +01:00
ishaan-jaff
66b23ecbb5 (v0) add ContentPolicyViolationError 2024-01-09 16:33:03 +05:30