Ishaan Jaff
|
94a553dbb2
|
[Feat] Emit Key, Team Budget metrics on a cron job schedule (#9528)
* _initialize_remaining_budget_metrics
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* LITELLM_PROXY_ADMIN_NAME
* fix code qa checks
* test_initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* pod lock manager allow dynamic cron job ID
* fix pod lock manager
* require cronjobid for PodLockManager
* fix DB_SPEND_UPDATE_JOB_NAME acquire / release lock
* add comment on prometheus logger
* add debug statements for emitting key, team budget metrics
* test_pod_lock_manager.py
* test_initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_remaining_budget_metrics
* remove outdated test
|
2025-04-10 16:59:14 -07:00 |
|
Ishaan Jaff
|
df51d8bcfa
|
Merge branch 'main' into litellm_metrics_pod_lock_manager
|
2025-04-04 21:11:39 -07:00 |
|
Ishaan Jaff
|
decb6649ec
|
test_queue_flush_limit
|
2025-04-04 16:29:06 -07:00 |
|
Ishaan Jaff
|
e77a178a37
|
test_queue_size_reduction_with_large_volume
|
2025-04-04 16:21:29 -07:00 |
|
Ishaan Jaff
|
eb48cbdec6
|
aggregate_queue_updates
|
2025-04-04 15:54:07 -07:00 |
|
Ishaan Jaff
|
93068cb142
|
flush_all_updates_from_in_memory_queue
|
2025-04-04 15:34:56 -07:00 |
|
Ishaan Jaff
|
065477abb4
|
add _get_aggregated_spend_update_queue_item
|
2025-04-04 15:32:27 -07:00 |
|
Ishaan Jaff
|
9abaefea62
|
add logic for max size in memory queue
|
2025-04-04 15:31:40 -07:00 |
|
Ishaan Jaff
|
363fb0c46f
|
add MAX_SIZE_IN_MEMORY_QUEUE
|
2025-04-04 15:31:09 -07:00 |
|
Ishaan Jaff
|
80fb4ece97
|
prom emit size of DB TX queues for observability
|
2025-04-02 18:39:29 -07:00 |
|
Ishaan Jaff
|
73bbd0a446
|
emit lock acquired and released events
|
2025-04-02 17:40:25 -07:00 |
|
Ishaan Jaff
|
a64631edfb
|
test pod lock manager
|
2025-04-02 14:39:40 -07:00 |
|
Ishaan Jaff
|
44bc8974c8
|
BaseUpdateQueue
|
2025-04-01 18:31:54 -07:00 |
|
Ishaan Jaff
|
8dc792139e
|
refactor file structure
|
2025-04-01 18:30:48 -07:00 |
|