Krish Dholakia
5f993f46a0
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:09:35 -07:00
Paul Lang
3574397576
Fixes the tool_use chunk mapping
2024-08-15 15:44:09 -04:00
Krrish Dholakia
db47b53c35
fix(anthropic.py): fix translation
2024-08-08 17:33:48 -07:00
Krrish Dholakia
1636f61169
fix(anthropic.py): fix translation from /v1/messages format to openai format
2024-08-08 15:55:01 -07:00
Krrish Dholakia
5810708c71
feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
...
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
87042c806c
test_anthropic_completion_input_translation_with_metadata
2024-07-23 15:23:58 -07:00
Krrish Dholakia
48be4ce805
feat(proxy_server.py): working /v1/messages with config.yaml
...
Adds async router support for adapter_completion call
2024-07-10 18:53:54 -07:00
Krrish Dholakia
4ba30abb63
feat(proxy_server.py): working /v1/messages endpoint
...
Works with claude engineer
2024-07-10 18:15:38 -07:00
Krrish Dholakia
01a335b4c3
feat(anthropic_adapter.py): support for translating anthropic params to openai format
2024-07-10 00:32:28 -07:00
Krrish Dholakia
059a161c28
style: initial commit
2024-07-09 13:38:33 -07:00
