Krish Dholakia
9c8f1d7815
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:09:35 -07:00
Ishaan Jaff
364492297d
feat - add fim codestral api
2024-06-17 13:46:03 -07:00
Krrish Dholakia
4f91205530
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
...
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Krrish Dholakia
180bc46ca4
fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
...
Fixing https://github.com/BerriAI/litellm/issues/2921
2024-05-16 21:51:55 -07:00
Krrish Dholakia
49ab1a1d3f
fix(bedrock_httpx.py): working async bedrock command r calls
2024-05-11 16:45:20 -07:00
Krrish Dholakia
ebe752fb61
build(pyproject.toml): drop certifi dependency (unused)
2024-01-10 08:09:03 +05:30
Krrish Dholakia
4905929de3
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
9fd7c5b343
test: set request timeout at request level
2023-11-15 17:42:31 -08:00
Krrish Dholakia
a7222f257c
fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors
2023-11-14 16:26:05 -08:00
Krrish Dholakia
45b6f8b853
refactor: fixing linting issues
2023-11-11 18:52:28 -08:00
Krrish Dholakia
d3323ba637
refactor(openai.py): making it compatible for openai v1
...
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
Krrish Dholakia
7c5fd5824b
refactor(azure.py): fix linting errors
2023-11-08 19:24:53 -08:00
Krrish Dholakia
0e7b83785b
fix(init.py): expose complete client session
2023-10-10 15:16:10 -07:00
Krrish Dholakia
b50013386f
fix(openai.py): enable custom proxy to pass in ca_bundle_path
2023-10-10 13:23:27 -07:00
ishaan-jaff
1bb2aefea1
all fixes to linting
2023-08-18 11:56:44 -07:00
ishaan-jaff
fbcb6d1c20
mypy linting fixes 2
2023-08-18 11:16:31 -07:00
ishaan-jaff
15b1da9dc8
add linting
2023-08-18 11:05:05 -07:00
Krrish Dholakia
a4cf7e1edd
added exception mapping to anthropic class
2023-08-12 17:39:11 -07:00
