Krish Dholakia
e1f7bcb47d
Fix VertexAI Credential Caching issue ( #9756 )
...
* refactor(vertex_llm_base.py): Prevent credential misrouting for projects
Fixes https://github.com/BerriAI/litellm/issues/7904
* fix: passing unit tests
* fix(vertex_llm_base.py): common auth logic across sync + async vertex ai calls
prevents credential caching issue across both flows
* test: fix test
* fix(vertex_llm_base.py): handle project id in default cause
* fix(factory.py): don't pass cache control if not set
bedrock invoke does not support this
* test: fix test
* fix(vertex_llm_base.py): add .exception message in load_auth
* fix: fix ruff error
2025-04-04 16:38:08 -07:00
Krish Dholakia
8ee32291e0
Squashed commit of the following: ( #9709 )
...
commit b12a9892b7294de31803cb6e9fbe40bfc159172d43ffb6a55804dbe4310c3c26284affc11e0de69d7882bdc787
2025-04-02 21:24:54 -07:00
Ishaan Jaff
00c596a852
(Feat) - Allow viewing Request/Response Logs stored in GCS Bucket ( #8449 )
...
* BaseRequestResponseFetchFromCustomLogger
* get_active_base_request_response_fetch_from_custom_logger
* get_request_response_payload
* ui_view_request_response_for_request_id
* fix uiSpendLogDetailsCall
* fix get_request_response_payload
* ui fix RequestViewer
* use 1 class AdditionalLoggingUtils
* ui_view_request_response_for_request_id
* cache the prefetch logs details
* refactor prefetch
* test view request/resp logs
* fix code quality
* fix get_request_response_payload
* uninstall posthog
prevent it from being added in ci/cd
* fix posthog
* fix traceloop test
* fix linting error
2025-02-10 20:38:55 -08:00
Ishaan Jaff
f251e775f6
gcs bucket dont run truncation ( #7964 )
2025-01-23 20:58:31 -08:00
Ishaan Jaff
9fef0a6d16
(fix) GCS bucket logger - apply truncate_standard_logging_payload_content to standard_logging_payload and ensure GCS flushes queue on fails ( #7519 )
...
* fix async_send_batch for gcs
* fix truncate GCS logger
* test_truncate_standard_logging_payload
2025-01-03 08:09:03 -08:00
Ishaan Jaff
4d93fe787b
Revert "(fix) GCS bucket logger - apply `truncate_standard_logging_payload_co…" ( #7515 )
...
This reverts commit 26a37c50c9
2025-01-02 22:01:02 -08:00
Ishaan Jaff
26a37c50c9
(fix) GCS bucket logger - apply truncate_standard_logging_payload_content to standard_logging_payload and ensure GCS flushes queue on fails ( #7500 )
...
* use truncate_standard_logging_payload_content
* update truncate_standard_logging_payload_content
* update dd logger
* update gcs async_send_batch
* fix code check
* test_datadog_payload_content_truncation
* fix code quality
2025-01-01 20:21:01 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
Ishaan Jaff
21003c4337
Code Quality Improvement - use vertex_ai/ as folder name for vertexAI ( #7166 )
...
* fix rename vertex ai
* run ci/cd again
2024-12-11 00:32:41 -08:00
Ishaan Jaff
84db69d4c4
(feat) add Vertex Batches API support in OpenAI format ( #7032 )
...
* working request
* working transform
* working request
* transform vertex batch response
* add _async_create_batch
* move gcs functions to base
* fix _get_content_from_openai_file
* transform_openai_file_content_to_vertex_ai_file_content
* fix transform vertex gcs bucket upload to OAI files format
* working e2e test
* _get_gcs_object_name
* fix linting
* add doc string
* fix transform_gcs_bucket_response_to_openai_file_object
* use vertex for batch endpoints
* add batches support for vertex
* test_vertex_batches_endpoint
* test_vertex_batch_prediction
* fix gcs bucket base auth
* docs clean up batches
* docs Batch API
* docs vertex batches api
* test_get_gcs_logging_config_without_service_account
* undo change
* fix vertex md
* test_get_gcs_logging_config_without_service_account
* ci/cd run again
2024-12-04 19:40:28 -08:00
Ishaan Jaff
d889bce0c4
add clear doc string for GCS bucket logging
2024-11-11 11:49:44 -08:00
Ishaan Jaff
eb92ed4156
(Feat) 273% improvement GCS Bucket Logger - use Batched Logging ( #6679 )
...
* use CustomBatchLogger for GCS
* add GCS bucket logging type
* use batch logging for GCs bucket
* add gcs_bucket
* allow setting flush_interval on CustomBatchLogger
* set GCS_FLUSH_INTERVAL to 1s
* fix test_key_logging
* fix test_key_logging
* add docs on new env vars
2024-11-11 11:35:34 +05:30
Ishaan Jaff
61026e189d
(feat) Add support for logging to GCS Buckets with folder paths ( #6675 )
...
* use helper to log
* gcs _handle_folders_in_bucket_name
* add test_basic_gcs_logger_with_folder_in_bucket_name
* run gcs testing in logging callback tests
* include correct deps
* fix gcs bucket logging test
* fix test_basic_gcs_logger_with_folder_in_bucket_name
* fix test_get_gcs_logging_config_without_service_account
* fix test gcs bucket
* remove unused file
2024-11-08 19:24:18 -08:00
Ishaan Jaff
0ca50d56a8
(feat) GCS Bucket logging. Allow using IAM auth for logging to GCS ( #6628 )
...
* fix gcs bucket auth
* allow iam auth for gcs logging
* test_get_gcs_logging_config_without_service_account
2024-11-06 17:14:56 -08:00
Ishaan Jaff
a69c670baa
(refactor) use helper function _assemble_complete_response_from_streaming_chunks to assemble complete responses in caching and logging callbacks ( #6220 )
...
* (refactor) use _assemble_complete_response_from_streaming_chunks
* add unit test for test_assemble_complete_response_from_streaming_chunks_1
* fix assemble complete_streaming_response
* config add logging_testing
* add logging_coverage in codecov
* test test_assemble_complete_response_from_streaming_chunks_3
* add unit tests for _assemble_complete_response_from_streaming_chunks
* fix remove unused / junk function
* add test for streaming_chunks when error assembling
2024-10-15 12:45:12 +05:30
Ishaan Jaff
3cb04480fb
(code clean up) use a folder for gcs bucket logging + add readme in folder ( #6080 )
...
* refactor gcs bucket
* add readme
2024-10-05 16:58:10 +05:30
