ishaan-jaff
|
c73684a5b1
|
(feat) show correct provider in exceptions
|
2024-02-02 08:37:42 -08:00 |
|
Krrish Dholakia
|
16c3ab1da0
|
fix(utils.py): logging fixes
|
2024-02-02 08:31:17 -08:00 |
|
Krrish Dholakia
|
aa40663150
|
fix(utils.py): add track cost callback to callback list for team id callbacks
|
2024-02-02 08:18:06 -08:00 |
|
Krrish Dholakia
|
dbf2b0b2c8
|
fix(utils.py): override default success callbacks with dynamic callbacks if set
|
2024-02-02 06:21:43 -08:00 |
|
Krish Dholakia
|
83a592aa02
|
Merge pull request #1749 from BerriAI/litellm_vertex_ai_model_garden
feat(vertex_ai.py): vertex ai model garden support
|
2024-02-01 21:52:12 -08:00 |
|
Krrish Dholakia
|
35df1413f8
|
test: testing fixes
|
2024-02-01 21:20:46 -08:00 |
|
Krrish Dholakia
|
99678147df
|
feat(utils.py): support dynamic langfuse params and team settings on proxy
|
2024-02-01 21:08:24 -08:00 |
|
Krrish Dholakia
|
e6dc63d348
|
feat(utils.py): support dynamic success callbacks
|
2024-02-01 19:42:01 -08:00 |
|
Krrish Dholakia
|
71ee4524c5
|
fix(utils.py): fix azure exception mapping
|
2024-02-01 19:05:20 -08:00 |
|
Krrish Dholakia
|
0ab8b764cc
|
fix(utils.py): fix deepinfra streaming
|
2024-02-01 18:46:50 -08:00 |
|
Krrish Dholakia
|
635a34b543
|
fix(utils.py): fix streaming chunks to not return role, unless set
|
2024-02-01 09:55:56 -08:00 |
|
Krrish Dholakia
|
c506f374e5
|
test: add more logging
|
2024-01-31 19:31:07 -08:00 |
|
Krrish Dholakia
|
c16dee39d7
|
fix(utils.py): support max token adjustment for sagemaker
|
2024-01-31 19:09:54 -08:00 |
|
Krrish Dholakia
|
3b5ac8e8f1
|
fix(utils.py): set call_type at the top of the function
|
2024-01-31 18:23:44 -08:00 |
|
Krrish Dholakia
|
a61dce8f83
|
fix(utils.py): fix get for dict
|
2024-01-31 18:15:47 -08:00 |
|
Krrish Dholakia
|
f66af6ccb2
|
fix(utils.py): support checking if user defined max tokens exceeds model limit
|
2024-01-31 17:01:46 -08:00 |
|
Krrish Dholakia
|
13110b184d
|
test(test_amazing_vertex_completion.py): fix test to handle api instability
|
2024-01-31 08:34:01 -08:00 |
|
Krish Dholakia
|
a9059eef10
|
Merge branch 'main' into litellm_no_store_cache_control
|
2024-01-30 21:44:57 -08:00 |
|
Krrish Dholakia
|
f5c88018dd
|
feat(proxy_server.py): enable cache controls per key + no-store cache flag
|
2024-01-30 20:46:50 -08:00 |
|
Krrish Dholakia
|
90791e754d
|
fix(utils.py): fix streaming delta content being none edge-case
|
2024-01-30 15:35:23 -08:00 |
|
Krrish Dholakia
|
456ec3add7
|
fix(utils.py): check if delta is none
|
2024-01-30 15:34:38 -08:00 |
|
Krrish Dholakia
|
85cbe5fb4c
|
fix(utils.py): fix custom model with provider to also support time based pricing
|
2024-01-30 13:00:43 -08:00 |
|
Krrish Dholakia
|
e937662e8a
|
build(ui/litellm_dashboard_v_2): allow app owner to create keys and view their keys
|
2024-01-27 13:48:35 -08:00 |
|
Krish Dholakia
|
e73e3be842
|
Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
|
2024-01-26 22:30:14 -08:00 |
|
Krrish Dholakia
|
6b1c1376b9
|
fix(utils.py): fix logging
|
2024-01-26 22:25:20 -08:00 |
|
Krrish Dholakia
|
d9fdddc301
|
fix(utils.py): enable cost tracking for image gen models on proxy
|
2024-01-26 20:51:13 -08:00 |
|
Krish Dholakia
|
a9a9969d6d
|
Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 20:28:16 -08:00 |
|
Krrish Dholakia
|
e1beaf0945
|
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 14:53:58 -08:00 |
|
ishaan-jaff
|
92779f6950
|
(feat) support dimensions param
|
2024-01-26 10:55:38 -08:00 |
|
Krish Dholakia
|
2abb430180
|
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes
fix(utils.py): fix sagemaker cost tracking for streaming
|
2024-01-25 19:01:57 -08:00 |
|
Krrish Dholakia
|
4a34084ee6
|
fix(utils.py): completion_cost support for image gen models
|
2024-01-25 18:08:18 -08:00 |
|
Krrish Dholakia
|
e45ac58a11
|
refactor: trigger new bump
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
7591aba27e
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
bbfed59e9c
|
refactor: trigger new bump
|
2024-01-25 16:06:01 -08:00 |
|
Krrish Dholakia
|
d88e190304
|
fix(main.py): fix logging event loop for async logging but sync streaming
|
2024-01-25 15:59:53 -08:00 |
|
Krrish Dholakia
|
dbc929fddb
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 15:00:51 -08:00 |
|
Krrish Dholakia
|
806eef02dd
|
fix(main.py): fix order of assembly for streaming chunks
|
2024-01-25 14:51:08 -08:00 |
|
Krrish Dholakia
|
402235dc5d
|
fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
|
2024-01-25 12:49:45 -08:00 |
|
Krish Dholakia
|
f1d309d700
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
Krrish Dholakia
|
327ceb33b7
|
fix(ollama_chat.py): fix default token counting for ollama chat
|
2024-01-24 20:09:17 -08:00 |
|
Krrish Dholakia
|
d536374be0
|
fix(proxy_server.py): track cost for global proxy
|
2024-01-24 16:06:10 -08:00 |
|
Krish Dholakia
|
89e420b243
|
Merge branch 'main' into litellm_reset_key_budget
|
2024-01-23 18:10:32 -08:00 |
|
Krrish Dholakia
|
503ce7020b
|
test(test_keys.py): use correct model name for token counting
|
2024-01-23 17:46:14 -08:00 |
|
Krish Dholakia
|
2ba8863f75
|
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking
[WIP] fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 17:07:40 -08:00 |
|
Krrish Dholakia
|
a5e53271d3
|
fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss
ue for spend logs
|
2024-01-23 16:14:01 -08:00 |
|
Krrish Dholakia
|
344e232549
|
fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 15:59:03 -08:00 |
|
Krrish Dholakia
|
88486a3123
|
fix(utils.py): fix streaming cost tracking
|
2024-01-23 14:39:45 -08:00 |
|
ishaan-jaff
|
6e51c213e2
|
(fix) same response_id across chunk
|
2024-01-23 12:56:03 -08:00 |
|
ishaan-jaff
|
28f6a69dbf
|
(fix) sagemaker streaming support
|
2024-01-23 12:31:16 -08:00 |
|
Krrish Dholakia
|
e04a4a7439
|
fix(utils.py): fix content policy violation check for streaming
|
2024-01-23 06:55:04 -08:00 |
|