Krish Dholakia
5f993f46a0
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:09:35 -07:00
Ishaan Jaff
87386b5cc3
feat - add fim codestral api
2024-06-17 13:46:03 -07:00
Krrish Dholakia
9d7f5d503c
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
...
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Krrish Dholakia
118fc4ffac
fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
...
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Krrish Dholakia
bd0c3a81cb
fix(bedrock_httpx.py): working async bedrock command r calls
2024-05-11 16:45:20 -07:00
Krrish Dholakia
f32ec52673
build(pyproject.toml): drop certifi dependency (unused)
2024-01-10 08:09:03 +05:30
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
ef4e5b9636
test: set request timeout at request level
2023-11-15 17:42:31 -08:00
Krrish Dholakia
9b582b2c85
fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors
2023-11-14 16:26:05 -08:00
Krrish Dholakia
4b74ddcb17
refactor: fixing linting issues
2023-11-11 18:52:28 -08:00
Krrish Dholakia
a5ec85b1f2
refactor(openai.py): making it compatible for openai v1
...
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
Krrish Dholakia
4206f95256
refactor(azure.py): fix linting errors
2023-11-08 19:24:53 -08:00
Krrish Dholakia
70bfa022a4
fix(init.py): expose complete client session
2023-10-10 15:16:10 -07:00
Krrish Dholakia
67b3e792ff
fix(openai.py): enable custom proxy to pass in ca_bundle_path
2023-10-10 13:23:27 -07:00
ishaan-jaff
b283005e7b
all fixes to linting
2023-08-18 11:56:44 -07:00
ishaan-jaff
bb70a55c91
mypy linting fixes 2
2023-08-18 11:16:31 -07:00
ishaan-jaff
2c7ffb7c75
add linting
2023-08-18 11:05:05 -07:00
Krrish Dholakia
1c909707ad
added exception mapping to anthropic class
2023-08-12 17:39:11 -07:00
