Krish Dholakia
08053e8f12
Add aggregate team based usage logging ( #10039 )
...
* feat(schema.prisma): initial commit adding aggregate table for team spend
allows team spend to be visible at 1m+ logs
* feat(db_spend_update_writer.py): support logging aggregate team spend
allows usage dashboard to work at 1m+ logs
* feat(litellm-proxy-extras/): add new migration file
* fix(db_spend_update_writer.py): fix return type
* build: bump requirements
* fix: fix ruff error
2025-04-15 20:58:48 -07:00
Ishaan Jaff
4c85e13226
[Feat] Emit Key, Team Budget metrics on a cron job schedule ( #9528 )
...
* _initialize_remaining_budget_metrics
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* LITELLM_PROXY_ADMIN_NAME
* fix code qa checks
* test_initialize_budget_metrics_cron_job
* test_initialize_budget_metrics_cron_job
* pod lock manager allow dynamic cron job ID
* fix pod lock manager
* require cronjobid for PodLockManager
* fix DB_SPEND_UPDATE_JOB_NAME acquire / release lock
* add comment on prometheus logger
* add debug statements for emitting key, team budget metrics
* test_pod_lock_manager.py
* test_initialize_budget_metrics_cron_job
* initialize_budget_metrics_cron_job
* initialize_remaining_budget_metrics
* remove outdated test
2025-04-10 16:59:14 -07:00
Ishaan Jaff
6e88d1e662
Merge branch 'main' into litellm_metrics_pod_lock_manager
2025-04-04 21:11:39 -07:00
Ishaan Jaff
4b314a9aa1
test_queue_flush_limit
2025-04-04 16:29:06 -07:00
Ishaan Jaff
6948b62a3a
test_queue_size_reduction_with_large_volume
2025-04-04 16:21:29 -07:00
Ishaan Jaff
4198d17544
aggregate_queue_updates
2025-04-04 15:54:07 -07:00
Ishaan Jaff
462827c9ec
flush_all_updates_from_in_memory_queue
2025-04-04 15:34:56 -07:00
Ishaan Jaff
87b834585b
add _get_aggregated_spend_update_queue_item
2025-04-04 15:32:27 -07:00
Ishaan Jaff
b42b3bf6c8
add logic for max size in memory queue
2025-04-04 15:31:40 -07:00
Ishaan Jaff
8e80928efd
add MAX_SIZE_IN_MEMORY_QUEUE
2025-04-04 15:31:09 -07:00
Ishaan Jaff
fd4e397da7
prom emit size of DB TX queues for observability
2025-04-02 18:39:29 -07:00
Ishaan Jaff
6a1552ee03
emit lock acquired and released events
2025-04-02 17:40:25 -07:00
Ishaan Jaff
4a70e9ad8b
test pod lock manager
2025-04-02 14:39:40 -07:00
Ishaan Jaff
4e9bdc9e6e
BaseUpdateQueue
2025-04-01 18:31:54 -07:00
Ishaan Jaff
be9e9e6db5
refactor file structure
2025-04-01 18:30:48 -07:00
