Ishaan Jaff
|
4c85e13226
|
[Feat] Emit Key, Team Budget metrics on a cron job schedule (#9528)
* _initialize_remaining_budget_metrics
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* LITELLM_PROXY_ADMIN_NAME
* fix code qa checks
* test_initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* pod lock manager allow dynamic cron job ID
* fix pod lock manager
* require cronjobid for PodLockManager
* fix DB_SPEND_UPDATE_JOB_NAME acquire / release lock
* add comment on prometheus logger
* add debug statements for emitting key, team budget metrics
* test_pod_lock_manager.py
* test_initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_remaining_budget_metrics
* remove outdated test
|
2025-04-10 16:59:14 -07:00 |
|
Ishaan Jaff
|
6e88d1e662
|
Merge branch 'main' into litellm_metrics_pod_lock_manager
|
2025-04-04 21:11:39 -07:00 |
|
Ishaan Jaff
|
4b314a9aa1
|
test_queue_flush_limit
|
2025-04-04 16:29:06 -07:00 |
|
Ishaan Jaff
|
6948b62a3a
|
test_queue_size_reduction_with_large_volume
|
2025-04-04 16:21:29 -07:00 |
|
Ishaan Jaff
|
4198d17544
|
aggregate_queue_updates
|
2025-04-04 15:54:07 -07:00 |
|
Ishaan Jaff
|
462827c9ec
|
flush_all_updates_from_in_memory_queue
|
2025-04-04 15:34:56 -07:00 |
|
Ishaan Jaff
|
87b834585b
|
add _get_aggregated_spend_update_queue_item
|
2025-04-04 15:32:27 -07:00 |
|
Ishaan Jaff
|
b42b3bf6c8
|
add logic for max size in memory queue
|
2025-04-04 15:31:40 -07:00 |
|
Ishaan Jaff
|
8e80928efd
|
add MAX_SIZE_IN_MEMORY_QUEUE
|
2025-04-04 15:31:09 -07:00 |
|
Ishaan Jaff
|
fd4e397da7
|
prom emit size of DB TX queues for observability
|
2025-04-02 18:39:29 -07:00 |
|
Ishaan Jaff
|
6a1552ee03
|
emit lock acquired and released events
|
2025-04-02 17:40:25 -07:00 |
|
Ishaan Jaff
|
4a70e9ad8b
|
test pod lock manager
|
2025-04-02 14:39:40 -07:00 |
|
Ishaan Jaff
|
4e9bdc9e6e
|
BaseUpdateQueue
|
2025-04-01 18:31:54 -07:00 |
|
Ishaan Jaff
|
be9e9e6db5
|
refactor file structure
|
2025-04-01 18:30:48 -07:00 |
|