Krish Dholakia
7f47c48b35
LiteLLM Minor Fixes and Improvements (09/10/2024) ( #5618 )
...
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error
Fixes https://github.com/BerriAI/litellm/issues/5610
* fix(databricks/cost_calculator.py): Handles model name issues for databricks models
* fix(main.py): fix stream chunk builder for multiple tool calls
Fixes https://github.com/BerriAI/litellm/issues/5591
* fix: correctly set user_alias when passed in
Fixes https://github.com/BerriAI/litellm/issues/5612
* fix(types/utils.py): allow passing role for message object
https://github.com/BerriAI/litellm/issues/5621
* fix(litellm_logging.py): Fix langfuse logging across multiple projects
Fixes issue where langfuse logger was re-using the old logging object
* feat(proxy/_types.py): support adding key-based tags for tag-based routing
Enable tag based routing at key-level
* fix(proxy/_types.py): fix inheritance
* test(test_key_generate_prisma.py): fix test
* test: fix test
* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Krrish Dholakia
3fd02a1587
fix(main.py): safely fail stream_chunk_builder calls
2024-08-10 10:22:26 -07:00
Joe Cheng
608a5775a3
Add unit test
2024-08-02 20:51:08 -07:00
Krrish Dholakia
f89632f5ac
fix(main.py): fix stream_chunk_builder usage calc
...
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
ishaan-jaff
dd03ba84a4
(test) hidden params in stream_chunk builder
2024-01-13 11:10:23 -08:00
Krrish Dholakia
e71154f286
fix(main.py): fix streaming completion token counting error
2024-01-10 23:44:35 +05:30
Krrish Dholakia
3ed296e2dd
fix(utils.py): raise correct error for azure content blocked error
2024-01-10 23:31:51 +05:30
ishaan-jaff
efecc18766
(test) add back test for counting stream completion tokens
2024-01-06 16:08:32 +05:30
Krrish Dholakia
9aa5c7b0ee
test(test_stream_chunk_builder.py): remove completion assert, the test is for prompt tokens
2024-01-06 14:12:44 +05:30
ishaan-jaff
365649baed
(test) completion tokens counting + azure stream
2024-01-03 12:06:39 +05:30
ishaan-jaff
7afc022ad3
(fix) counting streaming prompt tokens - azure
2023-12-29 16:13:52 +05:30
ishaan-jaff
ac19302d0d
(test) stream chunk builder - azure prompt tokens
2023-12-29 15:45:41 +05:30
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
b76e3ff626
fix(utils.py): fix azure streaming bug
2023-12-04 12:38:22 -08:00
Krrish Dholakia
68e0eca6b8
fix(utils.py): include system fingerprint in streaming response object
2023-11-30 08:45:52 -08:00
Krrish Dholakia
5450fb26f4
fix(utils.py): azure tool calling streaming
2023-11-27 19:07:38 -08:00
Krrish Dholakia
01a71cd0dc
fix(stream_chunk_builder): adding support for tool calling in completion counting
2023-11-27 18:39:47 -08:00
Krrish Dholakia
e3766b01a0
test(test_stream_chunk_builder.py): fix setting api key
2023-11-24 11:47:48 -08:00
Krrish Dholakia
5a9a3aa89c
fix(main.py): fix streaming_chunk_builder to return usage
2023-11-24 11:27:04 -08:00
Krrish Dholakia
9b278f567b
refactor(openai.py): support aiohttp streaming
2023-11-09 16:15:30 -08:00
Krrish Dholakia
1d46891ceb
fix(azure.py): adding support for aiohttp calls on azure + openai
2023-11-09 10:40:33 -08:00
Krrish Dholakia
8ee4b1f603
feat(utils.py): enable returning complete response when stream=true
2023-11-09 09:17:51 -08:00
ishaan-jaff
8a7b2ea2b9
(test) test_stream_chunk_builder
2023-11-01 14:54:00 -07:00
ishaan-jaff
d8c5f50faf
(test) stream chunk builder
2023-11-01 08:38:19 -07:00
Krrish Dholakia
cf7e2595b8
fix(utils): adds complete streaming response to success handler
2023-10-07 15:42:00 -07:00
Krrish Dholakia
eb4c7876e2
fix get optional params
2023-10-02 12:02:53 -07:00
WilliamEspegren
ca42b4c942
if "function_call" find name
2023-09-17 19:02:50 +02:00
WilliamEspegren
4bf7272885
rebuild chunks to openAI response
...
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
a5b15a77a9
append chunk to chunks
2023-09-17 10:29:09 +02:00
WilliamEspegren
3fb86f0fc9
add empty chunks list
2023-09-17 10:28:37 +02:00
WilliamEspegren
9b387cffc5
import stream_chunk_builder
2023-09-17 10:28:01 +02:00
WilliamEspegren
40850ecf53
add max_tokens
2023-09-17 10:27:32 +02:00
WilliamEspegren
684b11b456
add stream_chunk_builder function
2023-09-17 10:26:34 +02:00
