Commit graph

24 commits

Author SHA1 Message Date
Krish Dholakia
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler (#6290) (#6415)
* allow configuring httpx hooks for AsyncHTTPHandler (#6290)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* Fixes and minor improvements for Helm Chart (#6402)

* reckoner hack

* fix default

* add extracontainers option

* revert chart

* fix extracontainers

* fix deployment

* remove init container

* update docs

* add helm lint to deploy step

* change name

* (refactor) prometheus async_log_success_event to be under 100 LOC  (#6416)

* unit testig for prometheus

* unit testing for success metrics

* use 1 helper for _increment_token_metrics

* use helper for _increment_remaining_budget_metrics

* use _increment_remaining_budget_metrics

* use _increment_top_level_request_and_spend_metrics

* use helper for _set_latency_metrics

* remove noqa violation

* fix test prometheus

* test prometheus

* unit testing for all prometheus helper functions

* fix prom unit tests

* fix unit tests prometheus

* fix unit test prom

* (refactor) router - use static methods for client init utils  (#6420)

* use InitalizeOpenAISDKClient

* use InitalizeOpenAISDKClient static method

* fix  # noqa: PLR0915

* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend  (#6406)

* code cleanup remove unused and undocumented code files

* fix unused logging integrations cleanup

* update chart version

* add circleci tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>

* fix: fix linting error

* fix(http_handler.py): fix linting error

---------

Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com>
Co-authored-by: Robert Brennan <accounts@rbren.io>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
2024-10-24 22:00:24 -07:00
Zackeus Bengtsson
c7bf693aff
fix(litellm-helm): correctly use dbReadyImage and dbReadyTag values (#6336) 2024-10-21 09:38:36 -07:00
Peter Laß
e8066f13cb
Update litellm helm envconfigmap (#5872)
* Added the possibility to use ConfigMapRef for env values.

* bumped aapVersion to 1.46.6 and chartVersion to 0.3.0

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-25 21:43:08 -07:00
Peter Laß
b1ecfe065c
fix #5614 (#5615)
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-10 09:26:44 -07:00
Krish Dholakia
b374990c79
build(deployment.yaml): Fix port + allow setting database url in helm chart (#5587) 2024-09-09 14:17:44 -07:00
Peter Laß
72ea6f2ea8
litellm-helm: fix missing resource definitions in initContainer and missing DBname value for envVars in deployment.yaml (#5562)
* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-07 08:23:05 -07:00
Ishaan Jaff
60e02ae5d1
Merge pull request #5222 from ArbitraryCritter/listen-on-ipv6-and-ipv4
Make helm chart listen on IPv6 (and IPv4).
2024-08-28 14:54:09 -07:00
Mikio Stewart
9d0103e224 fix configmap name in print 2024-08-21 08:37:21 -07:00
Mikio Stewart
d129b848fe add checksum annotation 2024-08-21 08:30:55 -07:00
lowjiansheng
f1c39510cb add 0.2.3 helm 2024-08-19 23:59:58 +08:00
Rasmus Salling
e95efb9579
Make helm chart listen on IPv6 (and IPv4).
This changes the listen statement from 0.0.0.0 to ::.

On any reasonably modern linux kernel, this will open a dual-stack socket and listen on all IPv4 and IPv6 sockets.
Without this litellm will not run in an IPv6 only environment.
2024-08-15 16:05:19 +02:00
Ishaan Jaff
089a4f279a readme - clarify helm is community maintained 2024-08-06 12:37:13 -07:00
lowjiansheng
d11345e57e update helm chart 2024-08-01 12:27:35 +08:00
lowjiansheng
5b80852b46 move index and helm pacakge location 2024-07-10 00:54:36 +08:00
lowjiansheng
cc4d33a28e update the index.yaml file 2024-07-08 11:06:18 +08:00
lowjiansheng
38c92a7cc8 update chart version 2024-07-08 11:03:38 +08:00
Ishaan Jaff
815dcd9187 fix - don't use gunicorn on litellm helm 2024-05-22 07:48:34 -07:00
Krrish Dholakia
cad049b6a8 build(bump-helm-chart-app-version): bump helm chart app version to latest 2024-05-06 10:26:01 -07:00
Ishaan Jaff
fe200cfb07 (fix) re-include deployment.yaml 2024-03-16 10:51:32 -07:00
Shaun Maher
f52f1f40e6 Remove --run_gunicorn from proxy command line arguments 2024-03-16 10:47:25 -07:00
ishaan-jaff
01aa7b3e6e (fix) deploy litellm-helm 2024-03-16 10:10:47 -07:00
ishaan-jaff
54dceea4b0 (fix) releasing litellm helm as "litellm-helm" 2024-03-16 10:06:14 -07:00
Lunik
880213d4a6
Refresh Helm chart structure
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 22:59:14 +01:00
Shaun Maher
4d0e369e7a Authored a Helm chart for LiteLLM. Added GitHub workflows/actions to build and push the helm chart to the ghcr.io OCI registry. 2024-01-25 11:53:59 +11:00