.. |
.litellm_cache
|
feat(caching.py): enable caching on provider-specific optional params
|
2024-08-05 11:18:59 -07:00 |
example_config_yaml
|
test(test_proxy_server.py): fix test to use valid redis host
|
2024-04-19 19:22:24 -07:00 |
test_configs
|
test - default on/off guardrails
|
2024-07-03 14:50:13 -07:00 |
test_model_response_typing
|
add linting
|
2023-08-18 11:05:05 -07:00 |
adroit-crow-413218-bc47f303efc9.json
|
test writing logs to GCS bucket
|
2024-08-01 18:07:14 -07:00 |
azure_fine_tune.jsonl
|
add azure ft test file
|
2024-07-30 15:42:14 -07:00 |
batch_job_results_furniture.jsonl
|
feat(batches): add azure openai batches endpoint support
|
2024-08-22 14:46:51 -07:00 |
conftest.py
|
test(test_utils.py): reset env after test complete
|
2024-06-17 20:33:39 -07:00 |
data_map.txt
|
updating budget manager
|
2023-09-11 10:58:09 -07:00 |
eagle.wav
|
test whisper
|
2024-08-02 15:07:38 -07:00 |
gettysburg.wav
|
test groq/whisper-large-v3
|
2024-07-04 16:45:45 -07:00 |
langfuse.log
|
test(test_alangfuse.py): fix test to expect correct response object
|
2024-07-11 09:00:31 -07:00 |
large_text.py
|
feat(router.py): enable pre-call checks
|
2024-03-23 18:03:30 -07:00 |
litellm_uuid.txt
|
adding telemetry to litellm
|
2023-08-02 12:34:49 -07:00 |
messages_with_counts.py
|
New line
|
2024-07-15 11:13:14 -07:00 |
model_cost.json
|
update budget manager
|
2023-09-09 20:06:09 -07:00 |
openai_batch_completions.jsonl
|
test - openai batches file
|
2024-05-28 14:54:58 -07:00 |
openai_batch_completions_router.jsonl
|
feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
|
2024-09-02 21:32:55 -07:00 |
speech_vertex.mp3
|
add test_audio_speech_litellm_vertex
|
2024-08-23 15:36:42 -07:00 |
stream_chunk_testdata.py
|
Add unit test
|
2024-08-02 20:51:08 -07:00 |
test_acompletion.py
|
fix completion vs acompletion params
|
2024-05-09 07:59:37 -07:00 |
test_acooldowns_router.py
|
test test_cooldown_same_model_name
|
2024-08-24 17:16:25 -07:00 |
test_add_function_to_prompt.py
|
test: update tests
|
2024-03-04 18:42:08 -08:00 |
test_add_update_models.py
|
fix migrate to LitellmUserRoles
|
2024-05-30 13:57:50 -07:00 |
test_alangfuse.py
|
test: mark flaky tests
|
2024-08-30 07:53:04 -07:00 |
test_alerting.py
|
refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
|
2024-06-21 16:12:25 -07:00 |
test_amazing_s3_logs.py
|
(ci/cd) aws suspended account
|
2024-04-04 17:43:16 -07:00 |
test_amazing_vertex_completion.py
|
Minor LiteLLM Fixes and Improvements (#5456)
|
2024-08-31 17:58:10 -07:00 |
test_anthropic_completion.py
|
anthropic prompt caching cost tracking (#5453)
|
2024-08-31 14:09:35 -07:00 |
test_anthropic_prompt_caching.py
|
mark test as flaky
|
2024-09-02 19:44:28 -07:00 |
test_aproxy_startup.py
|
(fix) proxy_startup test
|
2024-02-06 13:17:57 -08:00 |
test_arize_ai.py
|
fix using arize as success callback
|
2024-07-22 15:32:49 -07:00 |
test_assistants.py
|
retry flaky tests 3 times
|
2024-08-28 13:10:47 -07:00 |
test_async_fn.py
|
ci/cd - anyscale discontinued their API endoints - skip test
|
2024-08-01 18:07:14 -07:00 |
test_async_opentelemetry.py
|
fix Local only test. WIP
|
2024-07-11 10:30:40 -07:00 |
test_audio_speech.py
|
simpify ssml usage
|
2024-08-28 12:54:23 -07:00 |
test_auth_checks.py
|
test(test_auth_checks.py): add unit tests for customer max budget check
|
2024-05-29 18:03:59 -07:00 |
test_azure_content_safety.py
|
feat - allow accessing data post success call
|
2024-08-19 21:03:37 -07:00 |
test_azure_openai.py
|
add test for test_azure_tenant_id_auth
|
2024-08-22 18:09:00 -07:00 |
test_azure_perf.py
|
fix(router.py): fix typing
|
2024-05-13 18:06:10 -07:00 |
test_bad_params.py
|
test UnsupportedParamsError
|
2024-07-24 12:21:22 -07:00 |
test_banned_keyword_list.py
|
test: refactor testing to handle the hash token fix
|
2024-04-17 17:31:39 -07:00 |
test_batch_completion_return_exceptions.py
|
Make return-exceptions as default behavior in litellm.batch_completion
|
2024-05-24 11:09:11 +08:00 |
test_batch_completions.py
|
test(test_batch_completions.py): handle anthropic overloaded error
|
2024-03-26 13:55:03 -07:00 |
test_bedrock_completion.py
|
Bedrock Embeddings refactor + model support (#5462)
|
2024-09-01 13:29:58 -07:00 |
test_blocked_user_list.py
|
fix testing spend_tracking
|
2024-06-21 16:52:42 -07:00 |
test_braintrust.py
|
test(test_braintrust.py): add testing for braintrust integration
|
2024-07-22 18:05:11 -07:00 |
test_budget_manager.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_caching.py
|
test test_image_generation_azure_dall_e_3
|
2024-08-27 22:52:11 -07:00 |
test_caching_ssl.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_clarifai_completion.py
|
test(test_clarifai_completion.py): skip clarifai tests - account rate limited
|
2024-06-03 21:07:57 -07:00 |
test_class.py
|
fix(utils.py): set max_retries = num_retries, if given
|
2024-08-09 16:54:54 -07:00 |
test_clickhouse_logger.py
|
(test) clickhouse
|
2024-02-26 18:56:43 -08:00 |
test_cohere_completion.py
|
test: cleanup duplicate tests + add error handling for backend api errors
|
2024-07-30 21:47:52 -07:00 |
test_completion.py
|
Merge pull request #5478 from BerriAI/litellm_Add_ai21
|
2024-09-02 16:20:37 -07:00 |
test_completion_cost.py
|
anthropic prompt caching cost tracking (#5453)
|
2024-08-31 14:09:35 -07:00 |
test_completion_with_retries.py
|
test(test_completion_with_retries.py): remove duplicate test
|
2024-01-10 21:17:30 +05:30 |
test_config.py
|
fix linting error
|
2024-07-06 11:27:58 -07:00 |
test_cost_calc.py
|
fix(utils.py): ensure consistent cost calc b/w returned header and logged object
|
2024-08-20 19:01:20 -07:00 |
test_custom_api_logger.py
|
(fix) custom api testing
|
2024-02-15 17:25:30 -08:00 |
test_custom_callback_input.py
|
mark flaky test as flaky
|
2024-08-31 15:02:56 -07:00 |
test_custom_callback_router.py
|
test: fix test
|
2024-09-03 06:40:52 -07:00 |
test_custom_llm.py
|
fix(custom_llm.py): pass input params to custom llm
|
2024-07-25 19:35:52 -07:00 |
test_custom_logger.py
|
mark test_cost_tracking_with_caching as flaky
|
2024-08-29 17:44:21 -07:00 |
test_datadog.py
|
(test) dd test
|
2024-03-18 16:22:59 -07:00 |
test_deployed_proxy_keygen.py
|
refactor: refactor key tests
|
2024-01-10 20:58:29 +05:30 |
test_dynamic_rate_limit_handler.py
|
anthropic prompt caching cost tracking (#5453)
|
2024-08-31 14:09:35 -07:00 |
test_dynamodb_logs.py
|
(test) AWS Suspended Account
|
2024-02-28 18:40:59 -08:00 |
test_embedding.py
|
LiteLLM Minor Fixes + Improvements (#5474)
|
2024-09-02 14:29:57 -07:00 |
test_exceptions.py
|
test: fix test
|
2024-08-27 19:33:14 -07:00 |
test_file_types.py
|
File type unit tests
|
2024-06-17 17:50:05 -07:00 |
test_fine_tuning_api.py
|
fix test fine tuning api azure
|
2024-08-05 15:17:15 -07:00 |
test_fireworks_ai.py
|
test - fireworks ai param mapping
|
2024-06-26 06:58:00 -07:00 |
test_function_call_parsing.py
|
test(test_function_call_parsing.py): fix test
|
2024-08-14 09:59:13 -07:00 |
test_function_calling.py
|
test(test_function_calling.py): fix test
|
2024-08-26 12:18:50 -07:00 |
test_function_setup.py
|
fix(proxy/utils.py): log rejected proxy requests to langfuse
|
2024-04-25 19:26:27 -07:00 |
test_gcs_bucket.py
|
log failure calls on gcs + testing
|
2024-08-14 08:55:51 -07:00 |
test_get_llm_provider.py
|
Merge branch 'main' into litellm_track_imagen_spend_logs
|
2024-09-02 21:21:15 -07:00 |
test_get_model_file.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_get_model_info.py
|
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map
|
2024-08-10 14:15:12 -07:00 |
test_get_model_list.py
|
linting fixes
|
2023-08-22 15:17:38 -07:00 |
test_get_optional_params_embeddings.py
|
test - bedrock v2 supports dimension
|
2024-05-03 16:23:37 -07:00 |
test_get_optional_params_functions_not_supported.py
|
test: fix linting
|
2024-05-10 14:42:06 -07:00 |
test_google_ai_studio_gemini.py
|
(fix) retry gemini-pro-vision 3 times
|
2024-01-11 14:39:08 +05:30 |
test_guardrails_config.py
|
feat(guardrails): Flag for PII Masking on Logging
|
2024-07-11 16:09:34 -07:00 |
test_health_check.py
|
add test for health check
|
2024-08-29 11:16:20 -07:00 |
test_helicone_integration.py
|
test fixes
|
2024-07-08 21:17:35 -07:00 |
test_hf_prompt_templates.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_image_generation.py
|
test test_image_generation_azure_dall_e_3
|
2024-08-27 22:52:11 -07:00 |
test_img_resize.py
|
fix(utils.py): support token counting for gpt-4-vision models
|
2024-01-02 14:41:42 +05:30 |
test_jwt.py
|
build: re-run ci/cd
|
2024-07-13 11:41:35 -07:00 |
test_key_generate_dynamodb.py
|
test: removing aws tests - account suspended - pending their approval
|
2024-02-28 13:46:20 -08:00 |
test_key_generate_prisma.py
|
add test_team_tags to set / update tags
|
2024-08-29 13:02:57 -07:00 |
test_lakera_ai_prompt_injection.py
|
fix lakera ai tests
|
2024-08-20 17:28:18 -07:00 |
test_langchain_ChatLiteLLM.py
|
fix palm api is deactivated by google
|
2024-08-27 21:08:49 -07:00 |
test_langsmith.py
|
test: skip flaky langsmith tests
|
2024-08-08 23:25:42 -07:00 |
test_least_busy_routing.py
|
sleep before checi g
|
2024-08-17 19:50:37 -07:00 |
test_litellm_max_budget.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_llm_guard.py
|
test: refactor testing to handle the hash token fix
|
2024-04-17 17:31:39 -07:00 |
test_load_test_router_s3.py
|
test: reintegrate s3 testing
|
2024-03-07 08:56:59 -08:00 |
test_loadtest_router.py
|
(cookbook) load test litellm router
|
2024-02-08 07:24:28 -08:00 |
test_logfire.py
|
test - logfire
|
2024-06-17 19:47:48 -07:00 |
test_logging.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_longer_context_fallback.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_lowest_cost_routing.py
|
ci/cd run again
|
2024-06-05 21:58:59 -07:00 |
test_lowest_latency_routing.py
|
test: mark flaky tests
|
2024-08-30 07:53:04 -07:00 |
test_lunary.py
|
add tests
|
2024-06-13 15:10:24 -03:00 |
test_max_tpm_rpm_limiter.py
|
fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
|
2024-05-27 08:48:23 -07:00 |
test_mem_usage.py
|
Merge branch 'main' into litellm_imp_mem_use
|
2024-03-11 19:00:56 -07:00 |
test_mock_request.py
|
fix using mock completion
|
2024-06-25 11:14:40 -07:00 |
test_model_alias_map.py
|
ci/cd skip ServiceUnavailableError
|
2024-08-08 23:25:27 -07:00 |
test_model_max_token_adjust.py
|
test: removing aws tests - account suspended - pending their approval
|
2024-02-28 13:46:20 -08:00 |
test_multiple_deployments.py
|
(test) tgai is unstable
|
2024-02-03 20:00:40 -08:00 |
test_ollama.py
|
fix test_ollama_chat_function_calling
|
2024-08-20 07:00:13 -07:00 |
test_ollama_local.py
|
update ollama test file
|
2024-05-05 20:25:43 -07:00 |
test_ollama_local_chat.py
|
(test) local ollama_chat
|
2023-12-26 20:11:14 +05:30 |
test_openai_batches_and_files.py
|
fix batch creation azure
|
2024-08-28 14:57:36 -07:00 |
test_openai_moderations_hook.py
|
test - openai moderation response
|
2024-05-23 13:24:46 -07:00 |
test_optional_params.py
|
LiteLLM Minor Fixes + Improvements (#5474)
|
2024-09-02 14:29:57 -07:00 |
test_parallel_request_limiter.py
|
fix flaky tests
|
2024-08-27 22:47:11 -07:00 |
test_pass_through_endpoints.py
|
fix pass through rerank requests tests
|
2024-08-28 10:08:09 -07:00 |
test_presidio_masking.py
|
feat - allow accessing data post success call
|
2024-08-19 21:03:37 -07:00 |
test_profiling_router.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_prometheus.py
|
use litellm_ prefix for new deployment metrics
|
2024-08-14 09:08:14 -07:00 |
test_prometheus_service.py
|
test(test_prometheus_service.py): remove duplicate test
|
2024-04-19 16:23:47 -07:00 |
test_prompt_factory.py
|
fix(factory.py): fix merging consecutive tool blocks for bedrock converse
|
2024-08-20 08:53:34 -07:00 |
test_prompt_injection_detection.py
|
fix(prompt_injection_detection.py): fix type check
|
2024-03-21 08:56:13 -07:00 |
test_promptlayer_integration.py
|
Merge branch 'main' into litellm_fix_azure_function_calling_streaming
|
2024-02-22 22:36:38 -08:00 |
test_provider_specific_config.py
|
fix palm api is deactivated by google
|
2024-08-27 21:08:49 -07:00 |
test_proxy_custom_auth.py
|
fix custom auth test
|
2024-07-30 16:50:55 -07:00 |
test_proxy_custom_logger.py
|
fix(main.py): ignore model_config param
|
2024-05-14 19:03:17 -07:00 |
test_proxy_encrypt_decrypt.py
|
test test_encrypt_decrypt
|
2024-07-08 07:54:07 -07:00 |
test_proxy_exception_mapping.py
|
test(test_proxy_exception_mapping): loosen assert
|
2024-08-27 16:14:30 -07:00 |
test_proxy_gunicorn.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_proxy_pass_user_config.py
|
test: ensure test calls contain bearer token
|
2024-01-26 20:15:35 -08:00 |
test_proxy_reject_logging.py
|
fix linting
|
2024-08-27 17:53:20 -07:00 |
test_proxy_routes.py
|
allow pass through routes as LLM API routes
|
2024-08-30 16:08:44 -07:00 |
test_proxy_server.py
|
fix: fix tests
|
2024-08-24 19:32:22 -07:00 |
test_proxy_server_caching.py
|
test(test_proxy_server_caching.py): skip aws test - aws account suspended
|
2024-02-28 14:55:57 -08:00 |
test_proxy_server_cost.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_proxy_server_keys.py
|
(fix) test - moved to circe ci dockerfile
|
2024-01-10 21:54:13 +05:30 |
test_proxy_server_langfuse.py
|
test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues.
|
2024-06-22 23:53:18 -07:00 |
test_proxy_server_spend.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_proxy_setting_guardrails.py
|
rename lakera ai
|
2024-08-20 13:44:39 -07:00 |
test_proxy_token_counter.py
|
test - token count response
|
2024-05-16 13:20:01 -07:00 |
test_proxy_utils.py
|
feat(litellm_pre_call_utils.py): support passing tags/spend logs metadata from keys/team metadata to request
|
2024-08-21 08:13:36 -07:00 |
test_pydantic.py
|
feat(proxy_server.py): handle pydantic mockselvar error
|
2024-07-26 08:38:51 -07:00 |
test_pydantic_namespaces.py
|
Added pytest for pydantic protected namespace warning
|
2024-04-27 15:44:40 -07:00 |
test_python_38.py
|
fix test_litellm_proxy_server_config_no_general_settings
|
2024-06-20 21:11:30 -07:00 |
test_register_model.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_rerank.py
|
add test for rerank on custom api base
|
2024-08-27 18:25:51 -07:00 |
test_router.py
|
feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
|
2024-09-02 21:32:55 -07:00 |
test_router_batch_completion.py
|
fix(utils.py): fix dynamic api base
|
2024-08-06 11:27:39 -07:00 |
test_router_caching.py
|
fix flaky tests
|
2024-08-27 22:47:11 -07:00 |
test_router_client_init.py
|
refactor secret managers
|
2024-09-03 10:58:02 -07:00 |
test_router_cooldowns.py
|
fix(router.py): set cooldown_time: per model
|
2024-06-25 16:51:55 -07:00 |
test_router_custom_routing.py
|
router - add doc string
|
2024-06-20 14:36:51 -07:00 |
test_router_debug_logs.py
|
test(test_router_debug_logs.py): simplify test
|
2024-08-27 14:47:43 -07:00 |
test_router_fallbacks.py
|
test: fix assert string on test
|
2024-08-28 12:07:05 -07:00 |
test_router_get_deployments.py
|
fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic
|
2024-04-22 12:58:59 -07:00 |
test_router_init.py
|
fix: fix test
|
2024-08-05 22:20:33 -07:00 |
test_router_max_parallel_requests.py
|
test(test_router_max_parallel_requests.py): more extensive testing for setting max parallel requests
|
2024-04-20 12:56:54 -07:00 |
test_router_policy_violation.py
|
fix(router.py): don't retry malformed / content policy violating errors (400 status code)
|
2024-01-04 22:23:51 +05:30 |
test_router_retries.py
|
fix router retries tests
|
2024-08-20 13:02:24 -07:00 |
test_router_tag_routing.py
|
fix test
|
2024-07-18 22:40:51 -07:00 |
test_router_timeout.py
|
test(test_router_timeout.py): fix test
|
2024-07-19 19:00:55 -07:00 |
test_router_utils.py
|
fix - azure test - don't pop api key
|
2024-04-17 07:54:16 -07:00 |
test_router_with_fallbacks.py
|
fix(router.py): support fallbacks / retries with sync embedding calls
|
2024-03-11 14:51:22 -07:00 |
test_rules.py
|
test: test fixes
|
2024-07-13 15:04:13 -07:00 |
test_sagemaker.py
|
fix(sagemaker.py): support streaming for messages api
|
2024-08-26 15:08:08 -07:00 |
test_scheduler.py
|
fix(test_scheduler.py): simplify scheduler testing. fix race condition
|
2024-06-01 18:57:47 -07:00 |
test_secret_detect_hook.py
|
add stricter secret detection
|
2024-06-27 15:12:13 -07:00 |
test_secret_manager.py
|
refactor secret managers
|
2024-09-03 10:58:02 -07:00 |
test_simple_shuffle.py
|
fix(router.py): add random shuffle and tpm-based shuffle for async shuffle logic
|
2024-04-22 12:58:59 -07:00 |
test_spend_calculate_endpoint.py
|
test - aliases on /spend/calculate
|
2024-06-24 21:13:01 -07:00 |
test_spend_logs.py
|
test - spend logs
|
2024-07-08 12:02:24 -07:00 |
test_stream_chunk_builder.py
|
fix(main.py): safely fail stream_chunk_builder calls
|
2024-08-10 10:22:26 -07:00 |
test_streaming.py
|
add streaming test for ai21
|
2024-09-02 11:58:15 -07:00 |
test_supabase_integration.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_team_config.py
|
fix(proxy_server.py): load default team config straight from config file
|
2024-02-02 19:03:47 -08:00 |
test_text_completion.py
|
fix test_completion_vllm
|
2024-08-27 18:40:39 -07:00 |
test_timeout.py
|
fix(anthropic.py): respect timeouts
|
2024-08-01 09:16:19 -07:00 |
test_together_ai.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_token_counter.py
|
fix(utils.py): fix get_image_dimensions to handle more image types
|
2024-08-16 12:00:04 -07:00 |
test_tpm_rpm_routing_v2.py
|
fix test test_router_completion_streaming
|
2024-06-21 21:02:34 -07:00 |
test_traceloop.py
|
fix test traceloop.py
|
2024-08-01 19:49:53 -07:00 |
test_triton.py
|
feat: enables batch embedding support for triton
|
2024-07-16 21:43:17 -07:00 |
test_update_spend.py
|
fix testing spend_tracking
|
2024-06-21 16:52:42 -07:00 |
test_user_api_key_auth.py
|
add test_user_api_key_auth_fails_with_prohibited_params
|
2024-08-28 14:11:56 -07:00 |
test_utils.py
|
fix(types/utils.py): handle null completion tokens
|
2024-08-10 09:23:03 -07:00 |
test_validate_environment.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_wandb.py
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
test_whisper.py
|
fix test
|
2024-08-02 15:08:44 -07:00 |
user_cost.json
|
updating budget manager
|
2023-09-11 10:58:09 -07:00 |
vertex_ai.jsonl
|
example vertex ai.jsonl
|
2024-08-02 17:25:32 -07:00 |
vertex_key.json
|
ci(vertex_key.json): switch gcloud accounts
|
2024-04-06 12:14:46 -07:00 |