phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
18070 commits 2497 branches 897 tags 550 MiB
Commit graph

2 commits

Author SHA1 Message Date
Ishaan Jaff
c25733e28e (fix) prompt caching cost calculation OpenAI, Azure OpenAI (#6231) 
* fix prompt caching cost calculation

* fix testing for prompt cache cost calc
 2024-10-15 18:55:31 +05:30
Ishaan Jaff
dee18cbf31 (feat) add cost tracking for OpenAI prompt caching (#6055) 
* add cache_read_input_token_cost for prompt caching models

* add prompt caching for latest models

* add openai cost calculator

* add openai prompt caching test

* fix lint check

* add not on how usage._cache_read_input_tokens is used

* fix cost calc whisper openai

* use output_cost_per_second

* add input_cost_per_second
 2024-10-05 14:20:15 +05:30