Krrish Dholakia
|
16da21e839
|
feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response
Closes https://github.com/BerriAI/litellm/issues/4165
|
2024-06-19 17:18:42 -07:00 |
|
Krrish Dholakia
|
df753a8ab2
|
fix(cost_calculator.py): fix time import
|
2024-06-17 20:27:18 -07:00 |
|
Krrish Dholakia
|
f597aa432b
|
feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio)
|
2024-06-17 12:38:10 -07:00 |
|
Krrish Dholakia
|
4f91205530
|
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
|
2024-06-15 10:57:20 -07:00 |
|
Ishaan Jaff
|
43eef61aa7
|
fix azure cost tracking
|
2024-06-10 21:09:55 -07:00 |
|
Krrish Dholakia
|
f3a845eff9
|
build(model_prices_and_context_window.json): update together ai model pricing - account for new categories
|
2024-06-08 19:56:35 -07:00 |
|
Krrish Dholakia
|
b26c3c7d22
|
fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
|
2024-06-08 19:43:57 -07:00 |
|
Krrish Dholakia
|
52a2f5150c
|
fix(utils.py): fix cost calculation for openai-compatible streaming object
|
2024-06-04 10:36:25 -07:00 |
|