Ishaan Jaff
|
bd88263b29
|
[Feat - Cost Tracking improvement] Track prompt caching metrics in DailyUserSpendTransactions (#10029)
* stash changes
* emit cache read/write tokens to daily spend update
* emit cache read/write tokens on daily activity
* update types.ts
* docs prompt caching
* undo ui change
* fix activity metrics
* fix prompt caching metrics
* fix typed dict fields
* fix get_aggregated_daily_spend_update_transactions
* fix aggregating cache tokens
* test_cache_token_fields_aggregation
* daily_transaction
* add cache_creation_input_tokens and cache_read_input_tokens to LiteLLM_DailyUserSpend
* test_daily_spend_update_queue.py
|
2025-04-15 21:40:57 -07:00 |
|
Ishaan Jaff
|
94a553dbb2
|
[Feat] Emit Key, Team Budget metrics on a cron job schedule (#9528)
* _initialize_remaining_budget_metrics
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* LITELLM_PROXY_ADMIN_NAME
* fix code qa checks
* test_initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* pod lock manager allow dynamic cron job ID
* fix pod lock manager
* require cronjobid for PodLockManager
* fix DB_SPEND_UPDATE_JOB_NAME acquire / release lock
* add comment on prometheus logger
* add debug statements for emitting key, team budget metrics
* test_pod_lock_manager.py
* test_initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_remaining_budget_metrics
* remove outdated test
|
2025-04-10 16:59:14 -07:00 |
|
Ishaan Jaff
|
decb6649ec
|
test_queue_flush_limit
|
2025-04-04 16:29:06 -07:00 |
|
Ishaan Jaff
|
e77a178a37
|
test_queue_size_reduction_with_large_volume
|
2025-04-04 16:21:29 -07:00 |
|
Ishaan Jaff
|
dc063fdfec
|
test_queue_size_reduction_with_large_volume
|
2025-04-04 15:59:35 -07:00 |
|
Ishaan Jaff
|
5bed0b7557
|
aggregated values
|
2025-04-04 15:55:14 -07:00 |
|
Ishaan Jaff
|
8405fcb748
|
test pod lock manager
|
2025-04-02 15:06:31 -07:00 |
|
Ishaan Jaff
|
feba274a89
|
test DailySpendUpdateQueue
|
2025-04-01 18:39:23 -07:00 |
|
Ishaan Jaff
|
4a091a34b0
|
move test loc
|
2025-04-01 18:33:33 -07:00 |
|