Krish Dholakia
|
869275585a
|
Merge branch 'main' into litellm_response_cost_headers
|
2024-06-27 21:33:09 -07:00 |
|
Krrish Dholakia
|
94c069e869
|
fix(cost_calculator.py): infer provider name if not given
Fixes https://github.com/BerriAI/litellm/issues/4452
|
2024-06-27 18:41:04 -07:00 |
|
Krrish Dholakia
|
f533e1da09
|
fix(utils.py): return 'response_cost' in completion call
Closes https://github.com/BerriAI/litellm/issues/4335
|
2024-06-26 17:55:57 -07:00 |
|
spdustin@gmail.com
|
4acc2d50ad
|
fix: use per-token costs for claude via vertex_ai
|
2024-06-21 11:21:36 -05:00 |
|
Krrish Dholakia
|
16da21e839
|
feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response
Closes https://github.com/BerriAI/litellm/issues/4165
|
2024-06-19 17:18:42 -07:00 |
|
Krrish Dholakia
|
f597aa432b
|
feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio)
|
2024-06-17 12:38:10 -07:00 |
|
Krrish Dholakia
|
3f9811c6a9
|
test(test_completion_cost.py): fix import
|
2024-06-15 12:08:49 -07:00 |
|
Krrish Dholakia
|
f3a845eff9
|
build(model_prices_and_context_window.json): update together ai model pricing - account for new categories
|
2024-06-08 19:56:35 -07:00 |
|
Krrish Dholakia
|
b26c3c7d22
|
fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
|
2024-06-08 19:43:57 -07:00 |
|
Krrish Dholakia
|
15b226ca4f
|
test(test_completion_cost.py): cleanup test
|
2024-06-04 16:57:25 -07:00 |
|
Krrish Dholakia
|
52a2f5150c
|
fix(utils.py): fix cost calculation for openai-compatible streaming object
|
2024-06-04 10:36:25 -07:00 |
|
Krrish Dholakia
|
a2a5884df1
|
fix(utils.py): allow passing in custom pricing to completion_cost as params
|
2024-05-16 16:24:44 -07:00 |
|
Krrish Dholakia
|
b4a8665d11
|
fix(utils.py): fix custom pricing when litellm model != response obj model name
|
2024-05-13 15:25:35 -07:00 |
|
Ishaan Jaff
|
282b8d0ae4
|
test bedrock pricing
|
2024-05-08 15:26:53 -07:00 |
|
Krrish Dholakia
|
2cfb97141d
|
fix(utils.py): replicate now also has token based pricing for some models
|
2024-04-29 08:06:15 -07:00 |
|
Krrish Dholakia
|
7dd94c802e
|
fix(azure.py): support cost tracking for azure/dall-e-3
|
2024-03-12 10:55:54 -07:00 |
|
Krrish Dholakia
|
fa45c569fd
|
feat: add cost tracking + caching for transcription calls
|
2024-03-09 15:43:38 -08:00 |
|
Krrish Dholakia
|
478307d4cf
|
fix(bedrock.py): support anthropic messages api on bedrock (claude-3)
|
2024-03-04 17:15:47 -08:00 |
|
ishaan-jaff
|
85e9116758
|
(ci/cd) aws disabled our test account :(
|
2024-02-28 17:26:23 -08:00 |
|
Krrish Dholakia
|
4c951d20bc
|
test: removing aws tests - account suspended - pending their approval
|
2024-02-28 13:46:20 -08:00 |
|
Krrish Dholakia
|
49b2dc4180
|
test(test_completion_cost.py): fix test
|
2024-02-03 22:00:49 -08:00 |
|
Krrish Dholakia
|
a32639fa79
|
fix(utils.py): support max token adjustment for sagemaker
|
2024-01-31 19:09:54 -08:00 |
|
Krrish Dholakia
|
f5da95685a
|
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 14:53:58 -08:00 |
|
Krrish Dholakia
|
ac131b3824
|
fix(utils.py): completion_cost support for image gen models
|
2024-01-25 18:08:18 -08:00 |
|
ishaan-jaff
|
6694975ec3
|
(test) azure completion_cost
|
2024-01-05 13:53:08 +05:30 |
|
ishaan-jaff
|
72e7178c9b
|
(test) azure/embedding + completion_cost
|
2024-01-05 13:19:17 +05:30 |
|
ishaan-jaff
|
2880a7b6b4
|
allow users to pass custom timing for replicate
|
2023-09-06 18:32:40 -07:00 |
|
ishaan-jaff
|
fc7ad0c245
|
bump v
|
2023-09-06 18:14:58 -07:00 |
|
ishaan-jaff
|
8b3b682000
|
add replicate pricing
|
2023-09-06 18:14:34 -07:00 |
|
ishaan-jaff
|
bd77d5ac21
|
docs update
|
2023-09-06 17:16:24 -07:00 |
|
ishaan-jaff
|
1ba6b6761b
|
show pricing for tg ai completion
|
2023-09-06 17:10:49 -07:00 |
|
ishaan-jaff
|
bab27634a8
|
rename max_tokens.json
|
2023-09-06 16:28:17 -07:00 |
|
ishaan-jaff
|
fbd67bc24c
|
add experimental together_computer cost calc
|
2023-09-06 16:08:44 -07:00 |
|