Commit graph

78 commits

Author SHA1 Message Date
Manuel Cañete
c4ea1ab61b
feat: add extraEnvVars to the helm deployment (#9292)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
Helm unit test / unit-test (push) Successful in 22s
2025-04-11 10:32:16 -07:00
Marcus Hynfield
cc7d59a11e
Add service annotations to litellm-helm chart (#9840)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 15s
Helm unit test / unit-test (push) Successful in 22s
2025-04-08 21:42:09 -07:00
Krish Dholakia
1604f87663
install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637)
* build(README.md): initial commit adding a separate folder for additional proxy files. Meant to reduce size of core package

* build(litellm-proxy-extras/): new pip package for storing migration files

allows litellm proxy to use migration files, without adding them to core repo

* build(litellm-proxy-extras/): cleanup pyproject.toml

* build: move prisma migration files inside new proxy extras package

* build(run_migration.py): update script to write to correct folder

* build(proxy_cli.py): load in migration files from litellm-proxy-extras

Closes https://github.com/BerriAI/litellm/issues/9558

* build: add MIT license to litellm-proxy-extras

* test: update test

* fix: fix schema

* bump: version 0.1.0 → 0.1.1

* build(publish-proxy-extras.sh): add script for publishing new proxy-extras version

* build(liccheck.ini): add litellm-proxy-extras to authorized packages

* fix(litellm-proxy-extras/utils.py): move prisma migrate logic inside extra proxy pkg

easier since migrations folder already there

* build(pre-commit-config.yaml): add litellm_proxy_extras to ci tests

* docs(config_settings.md): document new env var

* build(pyproject.toml): bump relevant files when litellm-proxy-extras version changed

* build(pre-commit-config.yaml): run poetry check on litellm-proxy-extras as well
2025-03-29 15:27:09 -07:00
Krrish Dholakia
95e5dfae5a build(ci_cd/): add migration script 2025-03-29 08:48:48 -07:00
Dbzman
7c85054bad
fix: wrong indentation for ttlSecondsAfterFinished (#9611) 2025-03-28 13:20:12 -07:00
Krish Dholakia
cdcc8ea9b7
Connect UI to "LiteLLM_DailyUserSpend" spend table - enables usage tab to work at 1m+ spend logs (#9603)
* feat(spend_management_endpoints.py): expose new endpoint for querying user's usage at 1m+ spend logs

Allows user to view their spend at 1m+ spend logs

* build(schema.prisma): add api_requests to dailyuserspend table

* build(migration.sql): add migration file for new column to daily user spend table

* build(prisma_client.py): add logic for copying over migration folder, if deploy/migrations present in expected location

enables easier testing of prisma migration flow

* build(ui/): initial commit successfully using the dailyuserspend table on the UI

* refactor(internal_user_endpoints.py): refactor `/user/daily/activity` to give breakdowns by provider/model/key

* feat: feature parity (cost page) with existing 'usage' page

* build(ui/): add activity tab to new_usage.tsx

gets to feature parity on 'All Up' page of 'usage.tsx'

* fix(proxy/utils.py): count number of api requests in daily user spend table

allows us to see activity by model on new usage tab

* style(new_usage.tsx): fix y-axis to be in ascending order of date

* fix: fix linting errors

* fix: fix ruff check errors
2025-03-27 23:29:15 -07:00
Krrish Dholakia
72c0ad419f build(migration.sql): add migration file for new dailyusertable
documents prisma db changes
2025-03-26 17:11:25 -07:00
Krish Dholakia
132d3f7baa
feat(prisma-migrations): add baseline db migration file (#9565)
adds initial baseline db migration file

enables future schema changes to be documented via .sql files
2025-03-26 16:22:56 -07:00
Manuel Cañete
44373baeee feat: make masterkey secret configurable 2025-03-16 12:39:13 +01:00
Manuel Cañete
fb4ebf0fd4 ci: add helm unittest 2025-03-08 01:29:25 +01:00
Manuel Cañete
7b65809139
feat: enhance migrations job with additional configurable properties (#8636) 2025-02-26 16:08:17 -08:00
Ashwin Madavan
40a3af7d61
chore: set ttlSecondsAfterFinished on the migration job in the litellm-helm chart (#8593)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 15s
* chore: add ttlSecondsAfterFinished to values.yaml

* chore: set ttlSecondsAfterFinished on the job

* chore: bump version in Chart.yaml
2025-02-26 14:21:37 -08:00
Ishaan Jaff
4081aeb15e
(helm) - allow specifying envVars on values.yaml + add helm lint test (#7789)
* litellm use envVars values.yaml

* fix values.yaml

* add helm lint to ci/cd pipeline

* working values.yaml

* add helm tests to ci/cd

* fix helm chart testing

* update helm tests

* fix helm test

* fix use test values in ci

* fix busy box testing on helm

* fix test-values.yaml

* update helm tests

* fix test connection
2025-01-15 21:11:17 -08:00
Zackeus Bengtsson
801f450e8c
feat(helm): add securityContext and pull policy values to migration job (#7652)
* fix(helm): corrected indentation in migration-job.yaml

* feat(helm): add securityContext and pull policy values to migration job
2025-01-15 12:51:08 -08:00
Ishaan Jaff
7259452285
(helm) - bug fix - allow using migrationJob.enabled variable within job (#7639)
* wrap migration job in conditional

* use enabled flag in values.yaml

* run migration job

* argo cd fixes

* fix values in image repo
2025-01-08 18:47:33 -08:00
Low Jian Sheng
9cfd7c790a
Prevent istio injection for db migrations cron job (#7513)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 40s
* allow option to prevent istio injection

* make annotations more generic

* make annotations empty

* revert comment deletions
2025-01-04 22:45:19 -08:00
Steven Crake
e74b35fe70
fix: migration job for existing db (#6792) 2024-12-04 08:40:09 -08:00
Ishaan Jaff
f2e6025c65 fix prisma migration 2024-11-13 17:04:58 -08:00
Ishaan Jaff
0e2c16e948 fix migration job 2024-11-13 17:02:06 -08:00
Ishaan Jaff
b56b5dce7f fix migrations-job.yaml 2024-11-13 16:59:34 -08:00
Ishaan Jaff
b5183ce31b fix migration job 2024-11-13 16:56:09 -08:00
Ishaan Jaff
da5da64d27 fix yaml on migrations job 2024-11-13 16:48:22 -08:00
Ishaan Jaff
4dc23cf997 use existing spec for migrations job 2024-11-13 16:43:26 -08:00
Ishaan Jaff
aa82a88c5f fix DATABASE_URL 2024-11-13 16:19:37 -08:00
Ishaan Jaff
db9d9dde0a fix migration job.yaml 2024-11-13 16:18:11 -08:00
Ishaan Jaff
e77ceec949 helm run DISABLE_SCHEMA_UPDATE 2024-11-13 15:28:07 -08:00
Ishaan Jaff
70c8be59d7 (build) helm db sync hook 2024-11-12 20:45:53 -08:00
Ishaan Jaff
ebb03098cb (build) helm db pre sync hook 2024-11-12 20:26:08 -08:00
Ishaan Jaff
ac04e5f1e6 (build) update db helm hook 2024-11-12 20:22:08 -08:00
Ishaan Jaff
4192d7ec6f fix migration job 2024-11-12 12:20:30 -08:00
Ishaan Jaff
07d7ac3ede fix db migration helm hook 2024-11-12 12:13:42 -08:00
Ishaan Jaff
503e4a4ad5 fix argo cd annotations 2024-11-12 12:07:57 -08:00
Ishaan Jaff
b4f76556b6 handle standalone DB on helm hook 2024-11-12 12:06:13 -08:00
Ishaan Jaff
ccb6c42e86 fix migrations job.yml 2024-11-12 12:01:37 -08:00
Ishaan Jaff
688d513459
(feat) helm hook to sync db schema (#6715)
* v0 migration job

* fix job
2024-11-12 11:58:35 -08:00
Krish Dholakia
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler (#6290) (#6415)
* allow configuring httpx hooks for AsyncHTTPHandler (#6290)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* Fixes and minor improvements for Helm Chart (#6402)

* reckoner hack

* fix default

* add extracontainers option

* revert chart

* fix extracontainers

* fix deployment

* remove init container

* update docs

* add helm lint to deploy step

* change name

* (refactor) prometheus async_log_success_event to be under 100 LOC  (#6416)

* unit testig for prometheus

* unit testing for success metrics

* use 1 helper for _increment_token_metrics

* use helper for _increment_remaining_budget_metrics

* use _increment_remaining_budget_metrics

* use _increment_top_level_request_and_spend_metrics

* use helper for _set_latency_metrics

* remove noqa violation

* fix test prometheus

* test prometheus

* unit testing for all prometheus helper functions

* fix prom unit tests

* fix unit tests prometheus

* fix unit test prom

* (refactor) router - use static methods for client init utils  (#6420)

* use InitalizeOpenAISDKClient

* use InitalizeOpenAISDKClient static method

* fix  # noqa: PLR0915

* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend  (#6406)

* code cleanup remove unused and undocumented code files

* fix unused logging integrations cleanup

* update chart version

* add circleci tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>

* fix: fix linting error

* fix(http_handler.py): fix linting error

---------

Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com>
Co-authored-by: Robert Brennan <accounts@rbren.io>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
2024-10-24 22:00:24 -07:00
Zackeus Bengtsson
c7bf693aff
fix(litellm-helm): correctly use dbReadyImage and dbReadyTag values (#6336) 2024-10-21 09:38:36 -07:00
Ishaan Jaff
d1760b1b04
(fix) clean up root repo - move entrypoint.sh and build_admin_ui to /docker (#6110)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy

* fix clean up root

* fix circle ci config
2024-10-08 11:34:43 +05:30
Peter Laß
e8066f13cb
Update litellm helm envconfigmap (#5872)
* Added the possibility to use ConfigMapRef for env values.

* bumped aapVersion to 1.46.6 and chartVersion to 0.3.0

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-25 21:43:08 -07:00
Peter Laß
b1ecfe065c
fix #5614 (#5615)
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-10 09:26:44 -07:00
Krish Dholakia
b374990c79
build(deployment.yaml): Fix port + allow setting database url in helm chart (#5587) 2024-09-09 14:17:44 -07:00
Peter Laß
72ea6f2ea8
litellm-helm: fix missing resource definitions in initContainer and missing DBname value for envVars in deployment.yaml (#5562)
* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-07 08:23:05 -07:00
Ishaan Jaff
60e02ae5d1
Merge pull request #5222 from ArbitraryCritter/listen-on-ipv6-and-ipv4
Make helm chart listen on IPv6 (and IPv4).
2024-08-28 14:54:09 -07:00
Mikio Stewart
9d0103e224 fix configmap name in print 2024-08-21 08:37:21 -07:00
Mikio Stewart
d129b848fe add checksum annotation 2024-08-21 08:30:55 -07:00
lowjiansheng
f1c39510cb add 0.2.3 helm 2024-08-19 23:59:58 +08:00
Rasmus Salling
e95efb9579
Make helm chart listen on IPv6 (and IPv4).
This changes the listen statement from 0.0.0.0 to ::.

On any reasonably modern linux kernel, this will open a dual-stack socket and listen on all IPv4 and IPv6 sockets.
Without this litellm will not run in an IPv6 only environment.
2024-08-15 16:05:19 +02:00
Ishaan Jaff
089a4f279a readme - clarify helm is community maintained 2024-08-06 12:37:13 -07:00
lowjiansheng
d11345e57e update helm chart 2024-08-01 12:27:35 +08:00
lowjiansheng
5b80852b46 move index and helm pacakge location 2024-07-10 00:54:36 +08:00