Commit graph

61 commits

Author SHA1 Message Date
Ishaan Jaff
f2e6025c65 fix prisma migration 2024-11-13 17:04:58 -08:00
Ishaan Jaff
0e2c16e948 fix migration job 2024-11-13 17:02:06 -08:00
Ishaan Jaff
b56b5dce7f fix migrations-job.yaml 2024-11-13 16:59:34 -08:00
Ishaan Jaff
b5183ce31b fix migration job 2024-11-13 16:56:09 -08:00
Ishaan Jaff
da5da64d27 fix yaml on migrations job 2024-11-13 16:48:22 -08:00
Ishaan Jaff
4dc23cf997 use existing spec for migrations job 2024-11-13 16:43:26 -08:00
Ishaan Jaff
aa82a88c5f fix DATABASE_URL 2024-11-13 16:19:37 -08:00
Ishaan Jaff
db9d9dde0a fix migration job.yaml 2024-11-13 16:18:11 -08:00
Ishaan Jaff
e77ceec949 helm run DISABLE_SCHEMA_UPDATE 2024-11-13 15:28:07 -08:00
Ishaan Jaff
70c8be59d7 (build) helm db sync hook 2024-11-12 20:45:53 -08:00
Ishaan Jaff
ebb03098cb (build) helm db pre sync hook 2024-11-12 20:26:08 -08:00
Ishaan Jaff
ac04e5f1e6 (build) update db helm hook 2024-11-12 20:22:08 -08:00
Ishaan Jaff
4192d7ec6f fix migration job 2024-11-12 12:20:30 -08:00
Ishaan Jaff
07d7ac3ede fix db migration helm hook 2024-11-12 12:13:42 -08:00
Ishaan Jaff
503e4a4ad5 fix argo cd annotations 2024-11-12 12:07:57 -08:00
Ishaan Jaff
b4f76556b6 handle standalone DB on helm hook 2024-11-12 12:06:13 -08:00
Ishaan Jaff
ccb6c42e86 fix migrations job.yml 2024-11-12 12:01:37 -08:00
Ishaan Jaff
688d513459
(feat) helm hook to sync db schema (#6715)
* v0 migration job

* fix job
2024-11-12 11:58:35 -08:00
Krish Dholakia
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler (#6290) (#6415)
* allow configuring httpx hooks for AsyncHTTPHandler (#6290)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* Fixes and minor improvements for Helm Chart (#6402)

* reckoner hack

* fix default

* add extracontainers option

* revert chart

* fix extracontainers

* fix deployment

* remove init container

* update docs

* add helm lint to deploy step

* change name

* (refactor) prometheus async_log_success_event to be under 100 LOC  (#6416)

* unit testig for prometheus

* unit testing for success metrics

* use 1 helper for _increment_token_metrics

* use helper for _increment_remaining_budget_metrics

* use _increment_remaining_budget_metrics

* use _increment_top_level_request_and_spend_metrics

* use helper for _set_latency_metrics

* remove noqa violation

* fix test prometheus

* test prometheus

* unit testing for all prometheus helper functions

* fix prom unit tests

* fix unit tests prometheus

* fix unit test prom

* (refactor) router - use static methods for client init utils  (#6420)

* use InitalizeOpenAISDKClient

* use InitalizeOpenAISDKClient static method

* fix  # noqa: PLR0915

* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend  (#6406)

* code cleanup remove unused and undocumented code files

* fix unused logging integrations cleanup

* update chart version

* add circleci tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>

* fix: fix linting error

* fix(http_handler.py): fix linting error

---------

Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com>
Co-authored-by: Robert Brennan <accounts@rbren.io>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
2024-10-24 22:00:24 -07:00
Zackeus Bengtsson
c7bf693aff
fix(litellm-helm): correctly use dbReadyImage and dbReadyTag values (#6336) 2024-10-21 09:38:36 -07:00
Ishaan Jaff
d1760b1b04
(fix) clean up root repo - move entrypoint.sh and build_admin_ui to /docker (#6110)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy

* fix clean up root

* fix circle ci config
2024-10-08 11:34:43 +05:30
Peter Laß
e8066f13cb
Update litellm helm envconfigmap (#5872)
* Added the possibility to use ConfigMapRef for env values.

* bumped aapVersion to 1.46.6 and chartVersion to 0.3.0

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-25 21:43:08 -07:00
Peter Laß
b1ecfe065c
fix #5614 (#5615)
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-10 09:26:44 -07:00
Krish Dholakia
b374990c79
build(deployment.yaml): Fix port + allow setting database url in helm chart (#5587) 2024-09-09 14:17:44 -07:00
Peter Laß
72ea6f2ea8
litellm-helm: fix missing resource definitions in initContainer and missing DBname value for envVars in deployment.yaml (#5562)
* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-07 08:23:05 -07:00
Ishaan Jaff
60e02ae5d1
Merge pull request #5222 from ArbitraryCritter/listen-on-ipv6-and-ipv4
Make helm chart listen on IPv6 (and IPv4).
2024-08-28 14:54:09 -07:00
Mikio Stewart
9d0103e224 fix configmap name in print 2024-08-21 08:37:21 -07:00
Mikio Stewart
d129b848fe add checksum annotation 2024-08-21 08:30:55 -07:00
lowjiansheng
f1c39510cb add 0.2.3 helm 2024-08-19 23:59:58 +08:00
Rasmus Salling
e95efb9579
Make helm chart listen on IPv6 (and IPv4).
This changes the listen statement from 0.0.0.0 to ::.

On any reasonably modern linux kernel, this will open a dual-stack socket and listen on all IPv4 and IPv6 sockets.
Without this litellm will not run in an IPv6 only environment.
2024-08-15 16:05:19 +02:00
Ishaan Jaff
089a4f279a readme - clarify helm is community maintained 2024-08-06 12:37:13 -07:00
lowjiansheng
d11345e57e update helm chart 2024-08-01 12:27:35 +08:00
lowjiansheng
5b80852b46 move index and helm pacakge location 2024-07-10 00:54:36 +08:00
lowjiansheng
cc4d33a28e update the index.yaml file 2024-07-08 11:06:18 +08:00
lowjiansheng
38c92a7cc8 update chart version 2024-07-08 11:03:38 +08:00
Ishaan Jaff
815dcd9187 fix - don't use gunicorn on litellm helm 2024-05-22 07:48:34 -07:00
Krrish Dholakia
80378966a0 build: add azure resource template 2024-05-08 15:24:58 -07:00
Krrish Dholakia
cad049b6a8 build(bump-helm-chart-app-version): bump helm chart app version to latest 2024-05-06 10:26:01 -07:00
Ishaan Jaff
53d7b95364 (fix) load testing key used 2024-04-01 08:28:19 -07:00
Ishaan Jaff
6d6549c6c8 (fix) kub.yaml 2024-03-26 18:05:55 -07:00
Ishaan Jaff
4d22fe0947 bump: version 1.34.4 → 1.34.5 2024-03-26 18:04:05 -07:00
Ishaan Jaff
5b2698a9ed (kub) always pull litellm image 2024-03-25 22:29:23 -07:00
Ishaan Jaff
b0c75d405c (feat) update kub.yaml 2024-03-23 17:58:39 -07:00
Ishaan Jaff
9c483dbae4 (feat) add sample kubernetes for litellm 2024-03-22 19:47:44 -07:00
Ishaan Jaff
fe200cfb07 (fix) re-include deployment.yaml 2024-03-16 10:51:32 -07:00
Shaun Maher
f52f1f40e6 Remove --run_gunicorn from proxy command line arguments 2024-03-16 10:47:25 -07:00
ishaan-jaff
01aa7b3e6e (fix) deploy litellm-helm 2024-03-16 10:10:47 -07:00
ishaan-jaff
54dceea4b0 (fix) releasing litellm helm as "litellm-helm" 2024-03-16 10:06:14 -07:00
ishaan-jaff
974d654189 (fix) clean up litellm helm chart 2024-03-15 16:20:41 -07:00
ishaan-jaff
fb4fa5af72 (docs) using litellm helm 2024-03-15 16:09:27 -07:00