phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(Feat) 273% improvement GCS Bucket Logger - use Batched Logging (#6679)

Browse source 
* use CustomBatchLogger for GCS

* add GCS bucket logging type

* use batch logging for GCs bucket

* add gcs_bucket

* allow setting flush_interval on CustomBatchLogger

* set GCS_FLUSH_INTERVAL to 1s

* fix test_key_logging

* fix test_key_logging

* add docs on new env vars
This commit is contained in:
Ishaan Jaff 2024-11-10 22:05:34 -08:00 • committed by GitHub
parent 27eee65e56
commit 1e89d4a1ba
9 changed files with 128 additions and 72 deletions
Download patch file Download diff file Expand all files Collapse all files

4
litellm/proxy/management_endpoints/key_management_endpoints.py
View file

@ -1599,7 +1599,9 @@ async def test_key_logging(
details=f"Logging test failed: {str(e)}",
)
await asyncio.sleep(1) # wait for callbacks to run
await asyncio.sleep(
2
) # wait for callbacks to run, callbacks use batching so wait for the flush event
# Check if any logger exceptions were triggered
log_contents = log_capture_string.getvalue()