Ishaan Jaff
a26a1bf799
ci/cd run again
2024-11-14 08:04:49 -08:00
Ishaan Jaff
4e59e09338
fix test_supports_response_schema
2024-11-13 22:00:07 -08:00
Ishaan Jaff
025977ea6d
fix test_read_nonexistent_secret
2024-11-13 21:52:55 -08:00
Ishaan Jaff
6c75e3eaa7
docs AWS secret manager
2024-11-13 21:03:34 -08:00
Ishaan Jaff
36d4943da9
test - handle eol model claude-2, use claude-2.1 instead
2024-11-13 19:39:45 -08:00
Ishaan Jaff
3a4e3e6ac0
test_get_secret_with_access_mode
2024-11-13 14:38:20 -08:00
Ishaan Jaff
3a072cd75a
use helper to check when _should_read_secret_from_secret_manager
2024-11-13 14:31:35 -08:00
Ishaan Jaff
33dc97df93
fix sync_read_secret
2024-11-13 14:21:08 -08:00
Ishaan Jaff
b9b5d60a38
test_aws_secret_manager
2024-11-13 14:19:37 -08:00
Ishaan Jaff
dbea2eef14
sync_read_secret
2024-11-13 13:56:30 -08:00
Ishaan Jaff
8b8746c9a6
fix check for key_management_settings
2024-11-13 13:47:05 -08:00
Ishaan Jaff
90d64c36a3
test_key_generate_with_secret_manager_call
2024-11-13 13:45:52 -08:00
Ishaan Jaff
46e3b13dbb
fix test secret manager
2024-11-13 13:21:20 -08:00
Ishaan Jaff
5d8f7758d1
use _delete_virtual_keys_from_secret_manager
2024-11-13 13:19:34 -08:00
Ishaan Jaff
4dab664cdc
add test for async_delete_secret
2024-11-13 11:54:00 -08:00
Ishaan Jaff
cc392e2792
add async_delete_secret
2024-11-13 11:53:20 -08:00
Ishaan Jaff
7788747bfe
use tasks for key management hooks
2024-11-13 11:38:48 -08:00
Ishaan Jaff
5db942a39e
fix KeyManagementSettings
2024-11-13 11:36:35 -08:00
Ishaan Jaff
42b6b733c5
fix write secret to AWS secret manager on /key/generate
2024-11-13 11:21:46 -08:00
Ishaan Jaff
e807d12d2a
working AWSSecretsManagerV2
2024-11-13 11:17:00 -08:00
Ishaan Jaff
204ddfc785
us event hooks for key management endpoints
2024-11-13 11:02:11 -08:00
Ishaan Jaff
9293789d16
use KeyManagementEventHooks for key/generated events
2024-11-13 10:52:59 -08:00
Ishaan Jaff
7aa74641dc
add unit testing for writing keys to AWS secret manager
2024-11-13 10:34:50 -08:00
Ishaan Jaff
bf9e58f8ef
fix importing AWSSecretsManagerV2
2024-11-13 09:52:26 -08:00
Ishaan Jaff
750439cd46
add SecretManager to httpxSpecialProvider
2024-11-13 09:38:45 -08:00
Ishaan Jaff
70c8be59d7
(build) helm db sync hook
2024-11-12 20:45:53 -08:00
Ishaan Jaff
ebb03098cb
(build) helm db pre sync hook
2024-11-12 20:26:08 -08:00
Ishaan Jaff
ac04e5f1e6
(build) update db helm hook
2024-11-12 20:22:08 -08:00
Ishaan Jaff
aa6fe6e317
fix remove dup test ( #6718 )
2024-11-12 20:16:54 -08:00
Ishaan Jaff
73c7b73aa0
(feat) Add cost tracking for Azure Dall-e-3 Image Generation + use base class to ensure basic image generation tests pass ( #6716 )
...
* add BaseImageGenTest
* use 1 class for unit testing
* add debugging to BaseImageGenTest
* TestAzureOpenAIDalle3
* fix response_cost_calculator
* test_basic_image_generation
* fix img gen basic test
* fix _select_model_name_for_cost_calc
* fix test_aimage_generation_bedrock_with_optional_params
* fix undo changes cost tracking
* fix response_cost_calculator
* fix test_cost_azure_gpt_35
2024-11-12 20:02:16 -08:00
Ishaan Jaff
6d4cf2d908
(fix) using Anthropic response_format={"type": "json_object"} ( #6721 )
...
* add support for response_format=json anthropic
* add test_json_response_format to baseLLM ChatTest
* fix test_litellm_anthropic_prompt_caching_tools
* fix test_anthropic_function_call_with_no_schema
* test test_create_json_tool_call_for_response_format
2024-11-12 19:06:00 -08:00
Kilian Lieret
e7543378b8
Fix: Update gpt-4o costs to that of gpt-4o-2024-08-06 ( #6714 )
...
Fixes #6713
2024-11-12 18:40:52 -08:00
Ishaan Jaff
d136641954
(fix proxy redis) Add redis sentinel support ( #6154 )
...
* add sentinel_password support
* add doc for setting redis sentinel password
* fix redis sentinel - use sentinel password
2024-11-12 18:36:46 -08:00
Ishaan Jaff
86607a2018
doc fix Using Http/2 with Hypercorn
2024-11-12 18:33:07 -08:00
Ishaan Jaff
4192d7ec6f
fix migration job
2024-11-12 12:20:30 -08:00
Ishaan Jaff
07d7ac3ede
fix db migration helm hook
2024-11-12 12:13:42 -08:00
Ishaan Jaff
503e4a4ad5
fix argo cd annotations
2024-11-12 12:07:57 -08:00
Ishaan Jaff
b4f76556b6
handle standalone DB on helm hook
2024-11-12 12:06:13 -08:00
Ishaan Jaff
ccb6c42e86
fix migrations job.yml
2024-11-12 12:01:37 -08:00
Ishaan Jaff
688d513459
(feat) helm hook to sync db schema ( #6715 )
...
* v0 migration job
* fix job
2024-11-12 11:58:35 -08:00
Krrish Dholakia
5081b912eb
bump: version 1.52.5 → 1.52.6
2024-11-12 23:53:07 +05:30
Krish Dholakia
9160d80fa5
LiteLLM Minor Fixes & Improvements (11/12/2024) ( #6705 )
...
* fix(caching): convert arg to equivalent kwargs in llm caching handler
prevent unexpected errors
* fix(caching_handler.py): don't pass args to caching
* fix(caching): remove all *args from caching.py
* fix(caching): consistent function signatures + abc method
* test(caching_unit_tests.py): add unit tests for llm caching
ensures coverage for common caching scenarios across different implementations
* refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one
* fix(router.py): drop redis password requirement
* fix(proxy_server.py): fix faulty slack alerting check
* fix(langfuse.py): avoid copying functions/thread lock objects in metadata
fixes metadata copy error when parent otel span in metadata
* test: update test
2024-11-12 22:50:51 +05:30
Ishaan Jaff
d39fd60801
add defaults used for GCS logging
2024-11-12 07:12:51 -08:00
Ishaan Jaff
33ceb7ca1f
bump: version 1.52.4 → 1.52.5
2024-11-11 21:01:05 -08:00
Ishaan Jaff
de2f9aed3a
fix raise correct error 404 when /key/info is called on non-existent key ( #6653 )
...
* fix raise correct error on /key/info
* add not_found_error error
* fix key not found in DB error
* use 1 helper for checking token hash
* fix error code on key info
* fix test key gen prisma
* test_generate_and_call_key_info
* test fix test_call_with_valid_model_using_all_models
* fix key info tests
2024-11-11 21:00:39 -08:00
Ishaan Jaff
25bae4cc23
(feat) add cost tracking stable diffusion 3 on Bedrock ( #6676 )
...
* add cost tracking for sd3
* test_image_generation_bedrock
* fix get model info for image cost
* add cost_calculator for stability 1 models
* add unit testing for bedrock image cost calc
* test_cost_calculator_with_no_optional_params
* add test_cost_calculator_basic
* correctly allow size Optional
* fix cost_calculator
* sd3 unit tests cost calc
2024-11-11 20:21:44 -08:00
Ishaan Jaff
e5051a93a8
(docs) add benchmarks on 1K RPS ( #6704 )
...
* docs litellm proxy benchmarks
* docs GCS bucket
* doc fix - reduce clutter on logging doc title
2024-11-11 19:25:53 -08:00
Ishaan Jaff
4fd0c6c8f2
add xAI on Admin UI ( #6680 )
2024-11-11 18:05:36 -08:00
Ishaan Jaff
9d20c19e0c
(fix) OpenAI's optional messages[].name does not work with Mistral API ( #6701 )
...
* use helper for _transform_messages mistral
* add test_message_with_name to base LLMChat test
* fix linting
2024-11-11 18:03:41 -08:00
Ishaan Jaff
c3bc9e6b12
(Feat) Add langsmith key based logging ( #6682 )
...
* add langsmith_api_key to StandardCallbackDynamicParams
* create a file for langsmith types
* langsmith add key / team based logging
* add key based logging for langsmith
* fix langsmith key based logging
* fix linting langsmith
* remove NOQA violation
* add unit test coverage for all helpers in test langsmith
* test_langsmith_key_based_logging
* docs langsmith key based logging
* run langsmith tests in logging callback tests
* fix logging testing
* test_langsmith_key_based_logging
* test_add_callback_via_key_litellm_pre_call_utils_langsmith
* add debug statement langsmith key based logging
* test_langsmith_key_based_logging
2024-11-11 13:58:06 -08:00
