spdustin@gmail.com
|
16c5ebfe25
|
fix: use per-token costs for claude via vertex_ai
|
2024-06-21 11:21:36 -05:00 |
|
Krish Dholakia
|
63277d4b7a
|
Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2
Vertex AI - character based cost calculation
|
2024-06-19 19:17:09 -07:00 |
|
Krrish Dholakia
|
edfe550165
|
feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response
Closes https://github.com/BerriAI/litellm/issues/4165
|
2024-06-19 17:18:42 -07:00 |
|
Ishaan Jaff
|
e9e0e85e39
|
fix add cost tracking for ft:gpt-4o-2024-05-1
|
2024-06-19 16:59:06 -07:00 |
|
Krrish Dholakia
|
21878d9ee7
|
fix(cost_calculator.py): fix time import
|
2024-06-17 20:27:18 -07:00 |
|
Krrish Dholakia
|
4fd054f188
|
feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio)
|
2024-06-17 12:38:10 -07:00 |
|
Krrish Dholakia
|
9d7f5d503c
|
refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging
Reference: https://github.com/BerriAI/litellm/issues/4206
|
2024-06-15 10:57:20 -07:00 |
|
Ishaan Jaff
|
90e297d745
|
fix azure cost tracking
|
2024-06-10 21:09:55 -07:00 |
|
Krrish Dholakia
|
2af3c43360
|
build(model_prices_and_context_window.json): update together ai model pricing - account for new categories
|
2024-06-08 19:56:35 -07:00 |
|
Krrish Dholakia
|
0a886eed6a
|
fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
|
2024-06-08 19:43:57 -07:00 |
|
Krrish Dholakia
|
7432c6a4d9
|
fix(utils.py): fix cost calculation for openai-compatible streaming object
|
2024-06-04 10:36:25 -07:00 |
|