Krrish Dholakia
|
dd47c9d854
|
test(test_amazing_vertex_completion.py): fix test to handle api instability
|
2024-01-31 08:34:01 -08:00 |
|
Krish Dholakia
|
ce415a243d
|
Merge branch 'main' into litellm_no_store_cache_control
|
2024-01-30 21:44:57 -08:00 |
|
Krrish Dholakia
|
f9acad87dc
|
feat(proxy_server.py): enable cache controls per key + no-store cache flag
|
2024-01-30 20:46:50 -08:00 |
|
Krrish Dholakia
|
60cc3d6b30
|
fix(utils.py): fix streaming delta content being none edge-case
|
2024-01-30 15:35:23 -08:00 |
|
Krrish Dholakia
|
b01f31c41f
|
fix(utils.py): check if delta is none
|
2024-01-30 15:34:38 -08:00 |
|
Krrish Dholakia
|
d170e6e83a
|
fix(utils.py): fix custom model with provider to also support time based pricing
|
2024-01-30 13:00:43 -08:00 |
|
Krrish Dholakia
|
dda115fcb7
|
build(ui/litellm_dashboard_v_2): allow app owner to create keys and view their keys
|
2024-01-27 13:48:35 -08:00 |
|
Krish Dholakia
|
ba4089824d
|
Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
|
2024-01-26 22:30:14 -08:00 |
|
Krrish Dholakia
|
43e07503d6
|
fix(utils.py): fix logging
|
2024-01-26 22:25:20 -08:00 |
|
Krrish Dholakia
|
a299ac2328
|
fix(utils.py): enable cost tracking for image gen models on proxy
|
2024-01-26 20:51:13 -08:00 |
|
Krish Dholakia
|
b36f628fc8
|
Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 20:28:16 -08:00 |
|
Krrish Dholakia
|
f5da95685a
|
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
|
2024-01-26 14:53:58 -08:00 |
|
ishaan-jaff
|
0fc8876ea2
|
(feat) support dimensions param
|
2024-01-26 10:55:38 -08:00 |
|
Krish Dholakia
|
612f74a426
|
Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes
fix(utils.py): fix sagemaker cost tracking for streaming
|
2024-01-25 19:01:57 -08:00 |
|
Krrish Dholakia
|
ac131b3824
|
fix(utils.py): completion_cost support for image gen models
|
2024-01-25 18:08:18 -08:00 |
|
Krrish Dholakia
|
1ae22ea16d
|
refactor: trigger new bump
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
014f83c847
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 16:40:23 -08:00 |
|
Krrish Dholakia
|
76468cc351
|
refactor: trigger new bump
|
2024-01-25 16:06:01 -08:00 |
|
Krrish Dholakia
|
72275ad8cb
|
fix(main.py): fix logging event loop for async logging but sync streaming
|
2024-01-25 15:59:53 -08:00 |
|
Krrish Dholakia
|
fbab810189
|
fix(main.py): allow vertex ai project and location to be set in completion() call
|
2024-01-25 15:00:51 -08:00 |
|
Krrish Dholakia
|
bbe6a92eb9
|
fix(main.py): fix order of assembly for streaming chunks
|
2024-01-25 14:51:08 -08:00 |
|
Krrish Dholakia
|
09ec6d6458
|
fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
|
2024-01-25 12:49:45 -08:00 |
|
Krish Dholakia
|
6501fdb76e
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
Krrish Dholakia
|
43f139fafd
|
fix(ollama_chat.py): fix default token counting for ollama chat
|
2024-01-24 20:09:17 -08:00 |
|
Krrish Dholakia
|
574208f005
|
fix(proxy_server.py): track cost for global proxy
|
2024-01-24 16:06:10 -08:00 |
|
Krish Dholakia
|
9784d03d65
|
Merge branch 'main' into litellm_reset_key_budget
|
2024-01-23 18:10:32 -08:00 |
|
Krrish Dholakia
|
d6844f43c8
|
test(test_keys.py): use correct model name for token counting
|
2024-01-23 17:46:14 -08:00 |
|
Krish Dholakia
|
4ca4913468
|
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking
[WIP] fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 17:07:40 -08:00 |
|
Krrish Dholakia
|
d52f5234b4
|
fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss
ue for spend logs
|
2024-01-23 16:14:01 -08:00 |
|
Krrish Dholakia
|
f8870fb48e
|
fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 15:59:03 -08:00 |
|
Krrish Dholakia
|
afada01ffc
|
fix(utils.py): fix streaming cost tracking
|
2024-01-23 14:39:45 -08:00 |
|
ishaan-jaff
|
39b4f19bd8
|
(fix) same response_id across chunk
|
2024-01-23 12:56:03 -08:00 |
|
ishaan-jaff
|
e8cd27f2b7
|
(fix) sagemaker streaming support
|
2024-01-23 12:31:16 -08:00 |
|
Krrish Dholakia
|
23b59ac9b8
|
fix(utils.py): fix content policy violation check for streaming
|
2024-01-23 06:55:04 -08:00 |
|
Ishaan Jaff
|
6d105754d7
|
Merge pull request #1561 from BerriAI/litellm_sagemaker_streaming
[Feat] Add REAL Sagemaker streaming
|
2024-01-22 22:10:20 -08:00 |
|
ishaan-jaff
|
c8084bb9d9
|
v0 sagemaker_stream
|
2024-01-22 21:53:16 -08:00 |
|
Krrish Dholakia
|
5e0d99b2ef
|
fix(router.py): fix order of dereferenced dictionaries
|
2024-01-22 21:42:25 -08:00 |
|
Krish Dholakia
|
bedb08bdef
|
Merge pull request #1557 from BerriAI/litellm_emit_spend_logs
feat(utils.py): emit response cost as part of logs
|
2024-01-22 21:02:40 -08:00 |
|
Krrish Dholakia
|
11e3ee4411
|
test: fix tests
|
2024-01-22 20:20:17 -08:00 |
|
Krrish Dholakia
|
3e8c8ef507
|
fix(openai.py): fix linting issue
|
2024-01-22 18:20:15 -08:00 |
|
Krish Dholakia
|
b1cced16fc
|
Merge pull request #1556 from BerriAI/litellm_importlib_issue
fix(utils.py): move from pkg_resources to importlib
|
2024-01-22 15:56:07 -08:00 |
|
Krrish Dholakia
|
e917d0eee6
|
feat(utils.py): emit response cost as part of logs
|
2024-01-22 15:53:04 -08:00 |
|
Krrish Dholakia
|
36c6d3cd90
|
fix(utils.py): fix debug log
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
a343c4d22f
|
refactor(utils.py): fix linting errors
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
074ea17325
|
fix: support streaming custom cost completion tracking
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
2ce4258cc0
|
fix(main.py): support custom pricing for embedding calls
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
276a685a59
|
feat(utils.py): support custom cost tracking per second
https://github.com/BerriAI/litellm/issues/1374
|
2024-01-22 15:15:34 -08:00 |
|
Krrish Dholakia
|
128cf4a81d
|
fix(utils.py): move from pkg_resources to importlib
|
2024-01-22 15:05:09 -08:00 |
|
Krrish Dholakia
|
6c39b2855f
|
fix(utils.py): fix async/sync streaming logging
|
2024-01-22 13:54:51 -08:00 |
|
Krrish Dholakia
|
2165dcf6fb
|
fix(utils.py): fix callback logging
|
2024-01-21 00:56:30 -08:00 |
|