Ishaan Jaff
efce84815a
test_gemini_fine_tuned_model_request_consistency
2025-03-25 23:54:06 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation ( #9516 )
...
Read Version from pyproject.toml / read-version (push) Successful in 19s
Helm unit test / unit-test (push) Successful in 20s
* test(tests): add unit testing for litellm_proxy integration
* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy
* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes
* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion
* feat(vertex_ai/): test
* fix: fix linting error
* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Ishaan Jaff
6e5d2b1ac7
handle failed db connections
2025-03-25 23:14:44 -07:00
Nicholas Grabar
f68cc26f15
8864 Add support for anyOf union type while handling null fields
2025-03-25 22:37:28 -07:00
Ishaan Jaff
9aec7c3878
test_create_delete_assistants
2025-03-25 22:08:06 -07:00
Ishaan Jaff
0a401ee468
test_litellm_proxy_server_config_no_general_settings
2025-03-25 19:27:15 -07:00
Ishaan Jaff
6572ba7a0e
fix startup
2025-03-25 19:25:47 -07:00
Ishaan Jaff
b4e745323a
add test config
2025-03-25 19:21:51 -07:00
Ishaan Jaff
9d10befa09
test_litellm_proxy_server_config_no_general_settings
2025-03-25 19:16:34 -07:00
Ishaan Jaff
53d9e33e78
fix setup toxi proxy
2025-03-25 18:59:26 -07:00
Ishaan Jaff
7b09d88680
fix setup
2025-03-25 17:52:12 -07:00
Ishaan Jaff
c6d5793bf6
add toxi proxy tests to ci/cd
2025-03-25 17:50:27 -07:00
Krish Dholakia
92883560f0
fix vertex ai multimodal embedding translation ( #9471 )
...
Read Version from pyproject.toml / read-version (push) Successful in 20s
Helm unit test / unit-test (push) Successful in 24s
* remove data:image/jpeg;base64, prefix from base64 image input
vertex_ai's multimodal embeddings endpoint expects a raw base64 string without `data:image/jpeg;base64,` prefix.
* Add Vertex Multimodal Embedding Test
* fix(test_vertex.py): add e2e tests on multimodal embeddings
* test: unit testing
* test: remove sklearn dep
* test: update test with fixed route
* test: fix test
---------
Co-authored-by: Jonarod <jonrodd@gmail.com>
Co-authored-by: Emerson Gomes <emerson.gomes@thalesgroup.com>
2025-03-24 23:23:28 -07:00
Krrish Dholakia
75994d0bf0
test: improve flaky test
2025-03-24 23:15:04 -07:00
Krish Dholakia
a619580bf8
Add vertexai topLogprobs support ( #9518 )
...
* Added support for top_logprobs in vertex gemini models
* Testing for top_logprobs feature in vertexai
* Update litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py
Co-authored-by: Tom Matthews <tomukmatthews@gmail.com>
* refactor(tests/): refactor testing to be in correct repo
---------
Co-authored-by: Aditya Thaker <adityathaker28@gmail.com>
Co-authored-by: Tom Matthews <tomukmatthews@gmail.com>
2025-03-24 22:42:38 -07:00
Ishaan Jaff
08a4ba1b7e
Merge branch 'main' into litellm_exp_mcp_server
2025-03-24 19:03:56 -07:00
Ishaan Jaff
d17ab7da2a
Merge pull request #9508 from BerriAI/litellm_fix_gcs_pub_sub
...
[Fix] Use StandardLoggingPayload for GCS Pub Sub Logging Integration
2025-03-24 18:22:43 -07:00
Krish Dholakia
a2ed9e4b80
Merge pull request #9509 from BerriAI/litellm_dev_03_24_2025_p1
...
Log 'api_base' on spend logs
2025-03-24 17:16:02 -07:00
Ishaan Jaff
36d17c23ac
fix flaky test test_openai_responses_api_web_search_cost_tracking
2025-03-24 15:51:33 -07:00
Ishaan Jaff
6a0ff944e4
assert_gcs_pubsub_request_matches_expected_standard_logging_payload
2025-03-24 15:41:05 -07:00
Krrish Dholakia
44e305648d
test(test_spend_management_endpoints.py): add unit testing for router + spend logs
2025-03-24 15:33:02 -07:00
Krrish Dholakia
1dc15ef5bf
test(test_spend_management_endpoints.py): guarantee consistent spend logs
2025-03-24 15:29:47 -07:00
Krrish Dholakia
e1bad1befa
test: add e2e testing
2025-03-24 15:12:18 -07:00
Krrish Dholakia
75722c4b13
test: add unit test
2025-03-24 14:45:20 -07:00
Krrish Dholakia
6a0cf3db50
fix(litellm_logging.py): always log the api base
...
Fixes issue where api base missing from spend logs due to refactor
2025-03-24 13:45:39 -07:00
Tyler Hutcherson
7864cd1f76
update redisvl dependency
2025-03-24 08:42:11 -04:00
Ishaan Jaff
6f7d618918
test tool call cost tracking
2025-03-22 19:47:13 -07:00
Ishaan Jaff
f21a0c2da7
Merge branch 'main' into litellm_exp_mcp_server
2025-03-22 18:51:25 -07:00
Ishaan Jaff
43a6c4c635
test_openai_responses_api_web_search_cost_tracking
2025-03-22 17:29:17 -07:00
Ishaan Jaff
81033dc8c9
test_openai_responses_api_web_search_cost_tracking
2025-03-22 17:21:41 -07:00
Ishaan Jaff
beb68037d0
move web search cost tracking
2025-03-22 17:02:43 -07:00
Ishaan Jaff
475dfaa156
fixes for web search cost tracking
2025-03-22 16:56:32 -07:00
Ishaan Jaff
cf22d31b2b
search_context_cost_per_query
2025-03-22 14:52:58 -07:00
Ishaan Jaff
3a454d00df
Merge branch 'main' into litellm_web_search_2
2025-03-22 14:35:32 -07:00
Ishaan Jaff
bddbeff717
test_openai_web_search_logging_cost_tracking
2025-03-22 14:29:02 -07:00
Krish Dholakia
d3baaf7961
Merge pull request #9467 from BerriAI/litellm_dev_03_22_2025_p1
...
Refactor vertex ai passthrough routes - fixes unpredictable behaviour w/ auto-setting default_vertex_region on router model add
2025-03-22 14:11:57 -07:00
Ishaan Jaff
1d7accce9e
test_supports_web_search
2025-03-22 13:49:35 -07:00
Ishaan Jaff
69c9a782b2
add supports_web_search
2025-03-22 13:32:22 -07:00
Ishaan Jaff
78c371d2e8
search_context_cost_per_query test
2025-03-22 13:08:57 -07:00
Krrish Dholakia
6b2f385ddf
test: update tests
2025-03-22 12:56:42 -07:00
Ishaan Jaff
1bdb94a314
add search_context_cost_per_1k_calls to model cost map spec
2025-03-22 12:56:21 -07:00
Krrish Dholakia
6f719d0461
test: fix test
2025-03-22 12:50:58 -07:00
Krrish Dholakia
3ce3689282
test: migrate testing
2025-03-22 12:48:53 -07:00
Krrish Dholakia
92d4486a2c
fix(llm_passthrough_endpoints.py): raise verbose error if credentials not found on proxy
2025-03-22 11:49:51 -07:00
Ishaan Jaff
792a2d6115
test_is_chunk_non_empty_with_annotations
2025-03-22 11:41:53 -07:00
Ishaan Jaff
5c59a6a58f
test_openai_web_search_streaming
2025-03-22 11:36:34 -07:00
Krrish Dholakia
be72ecc23f
test: add more e2e testing
2025-03-22 11:35:57 -07:00
Krrish Dholakia
06e69a414e
fix(vertex_ai/common_utils.py): fix handling constructed url with default vertex config
2025-03-22 11:32:01 -07:00
Krrish Dholakia
b44b3bd36b
feat(llm_passthrough_endpoints.py): base case passing for refactored vertex passthrough route
2025-03-22 11:06:52 -07:00
Ishaan Jaff
3dbbc89fd2
test_openai_web_search
2025-03-22 10:53:47 -07:00
