Krrish Dholakia
|
16a43224ba
|
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here
|
2024-02-03 12:58:16 -08:00 |
|
Krrish Dholakia
|
5994c1e7ef
|
feat(bedrock.py): add stable diffusion image generation support
|
2024-02-03 12:08:38 -08:00 |
|
Krrish Dholakia
|
3f23b18dad
|
feat(vertex_ai.py): vertex ai gecko text embedding support
|
2024-02-03 09:48:29 -08:00 |
|
Krrish Dholakia
|
7699f48930
|
fix(utils.py): fix cost tracking for cache hits (should be 0)
|
2024-02-02 17:33:39 -08:00 |
|
ishaan-jaff
|
2e4b1bcf4d
|
(feat) use same id to log on s3, langfuse
|
2024-02-02 16:26:59 -08:00 |
|
Krrish Dholakia
|
34886b0261
|
fix(helicone.py): fix logging
|
2024-02-02 14:30:01 -08:00 |
|
Krrish Dholakia
|
af1319bd9f
|
fix(utils.py): dynamic switch langfuse client based on keys
|
2024-02-02 14:03:46 -08:00 |
|
Krish Dholakia
|
6824014c5f
|
Merge pull request #1761 from BerriAI/litellm_fix_dynamic_callbacks
fix(utils.py): override default success callbacks with dynamic callbacks if set
|
2024-02-02 13:06:55 -08:00 |
|
ishaan-jaff
|
fdddb69dea
|
(feat) improve exceptions for OpenAI compatible -
|
2024-02-02 10:14:26 -08:00 |
|
Krrish Dholakia
|
e20e8beec3
|
test(test_keys.py): add more logging
|
2024-02-02 10:08:02 -08:00 |
|
ishaan-jaff
|
c73684a5b1
|
(feat) show correct provider in exceptions
|
2024-02-02 08:37:42 -08:00 |
|
Krrish Dholakia
|
16c3ab1da0
|
fix(utils.py): logging fixes
|
2024-02-02 08:31:17 -08:00 |
|
Krrish Dholakia
|
aa40663150
|
fix(utils.py): add track cost callback to callback list for team id callbacks
|
2024-02-02 08:18:06 -08:00 |
|
Krrish Dholakia
|
dbf2b0b2c8
|
fix(utils.py): override default success callbacks with dynamic callbacks if set
|
2024-02-02 06:21:43 -08:00 |
|
Krish Dholakia
|
83a592aa02
|
Merge pull request #1749 from BerriAI/litellm_vertex_ai_model_garden
feat(vertex_ai.py): vertex ai model garden support
|
2024-02-01 21:52:12 -08:00 |
|
Krrish Dholakia
|
35df1413f8
|
test: testing fixes
|
2024-02-01 21:20:46 -08:00 |
|
Krrish Dholakia
|
99678147df
|
feat(utils.py): support dynamic langfuse params and team settings on proxy
|
2024-02-01 21:08:24 -08:00 |
|
Krrish Dholakia
|
e6dc63d348
|
feat(utils.py): support dynamic success callbacks
|
2024-02-01 19:42:01 -08:00 |
|
Krrish Dholakia
|
71ee4524c5
|
fix(utils.py): fix azure exception mapping
|
2024-02-01 19:05:20 -08:00 |
|
Krrish Dholakia
|
0ab8b764cc
|
fix(utils.py): fix deepinfra streaming
|
2024-02-01 18:46:50 -08:00 |
|
Krrish Dholakia
|
635a34b543
|
fix(utils.py): fix streaming chunks to not return role, unless set
|
2024-02-01 09:55:56 -08:00 |
|
Krrish Dholakia
|
c506f374e5
|
test: add more logging
|
2024-01-31 19:31:07 -08:00 |
|
Krrish Dholakia
|
c16dee39d7
|
fix(utils.py): support max token adjustment for sagemaker
|
2024-01-31 19:09:54 -08:00 |
|
Krrish Dholakia
|
3b5ac8e8f1
|
fix(utils.py): set call_type at the top of the function
|
2024-01-31 18:23:44 -08:00 |
|
Krrish Dholakia
|
a61dce8f83
|
fix(utils.py): fix get for dict
|
2024-01-31 18:15:47 -08:00 |
|
Krrish Dholakia
|
f66af6ccb2
|
fix(utils.py): support checking if user defined max tokens exceeds model limit
|
2024-01-31 17:01:46 -08:00 |
|
Krrish Dholakia
|
13110b184d
|
test(test_amazing_vertex_completion.py): fix test to handle api instability
|
2024-01-31 08:34:01 -08:00 |
|
Krish Dholakia
|
a9059eef10
|
Merge branch 'main' into litellm_no_store_cache_control
|
2024-01-30 21:44:57 -08:00 |
|
Krrish Dholakia
|
f5c88018dd
|
feat(proxy_server.py): enable cache controls per key + no-store cache flag
|
2024-01-30 20:46:50 -08:00 |
|
Krrish Dholakia
|
90791e754d
|
fix(utils.py): fix streaming delta content being none edge-case
|
2024-01-30 15:35:23 -08:00 |
|
Krrish Dholakia
|
456ec3add7
|
fix(utils.py): check if delta is none
|
2024-01-30 15:34:38 -08:00 |
|
Krrish Dholakia
|
85cbe5fb4c
|
fix(utils.py): fix custom model with provider to also support time based pricing
|
2024-01-30 13:00:43 -08:00 |
|
Krrish Dholakia
|
e937662e8a
|
build(ui/litellm_dashboard_v_2): allow app owner to create keys and view their keys
|
2024-01-27 13:48:35 -08:00 |
|
Krish Dholakia
|
e73e3be842
|
Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
|
2024-01-26 22:30:14 -08:00 |
|
Krrish Dholakia
|
6b1c1376b9
|
fix(utils.py): fix logging
|
2024-01-26 22:25:20 -08:00 |
|
Krrish Dholakia
|
d9fdddc301
|
fix(utils.py): enable cost tracking for image gen models on proxy
|
2024-01-26 20:51:13 -08:00 |
|
Krish Dholakia
|
a9a9969d6d
|
Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 20:28:16 -08:00 |
|
Krrish Dholakia
|
e1beaf0945
|
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 14:53:58 -08:00 |
|
ishaan-jaff
|
92779f6950
|
(feat) support dimensions param
|
2024-01-26 10:55:38 -08:00 |
|
Krish Dholakia
|
2abb430180
|
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes
fix(utils.py): fix sagemaker cost tracking for streaming
|
2024-01-25 19:01:57 -08:00 |
|
Krrish Dholakia
|
4a34084ee6
|
fix(utils.py): completion_cost support for image gen models
|
2024-01-25 18:08:18 -08:00 |
|
Krrish Dholakia
|
e45ac58a11
|
refactor: trigger new bump
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
7591aba27e
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
bbfed59e9c
|
refactor: trigger new bump
|
2024-01-25 16:06:01 -08:00 |
|
Krrish Dholakia
|
d88e190304
|
fix(main.py): fix logging event loop for async logging but sync streaming
|
2024-01-25 15:59:53 -08:00 |
|
Krrish Dholakia
|
dbc929fddb
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 15:00:51 -08:00 |
|
Krrish Dholakia
|
806eef02dd
|
fix(main.py): fix order of assembly for streaming chunks
|
2024-01-25 14:51:08 -08:00 |
|
Krrish Dholakia
|
402235dc5d
|
fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
|
2024-01-25 12:49:45 -08:00 |
|
Krish Dholakia
|
f1d309d700
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
Krrish Dholakia
|
327ceb33b7
|
fix(ollama_chat.py): fix default token counting for ollama chat
|
2024-01-24 20:09:17 -08:00 |
|