Commit graph

280 commits

Author SHA1 Message Date
Krrish Dholakia
611afaf2ab ci(test-linting.yml): update to run black formatting 2025-03-31 17:03:59 -07:00
Krish Dholakia
9b7ebb6a7d
build(pyproject.toml): add new dev dependencies - for type checking (#9631)
* build(pyproject.toml): add new dev dependencies - for type checking

* build: reformat files to fit black

* ci: reformat to fit black

* ci(test-litellm.yml): make tests run clear

* build(pyproject.toml): add ruff

* fix: fix ruff checks

* build(mypy/): fix mypy linting errors

* fix(hashicorp_secret_manager.py): fix passing cert for tls auth

* build(mypy/): resolve all mypy errors

* test: update test

* fix: fix black formatting

* build(pre-commit-config.yaml): use poetry run black

* fix(proxy_server.py): fix linting error

* fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
Krish Dholakia
0865e52db3
fix(proxy_server.py): get master key from environment, if not set in … (#9617)
* fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all

* test: mark flaky test

* test(test_proxy_server.py): mock prisma client

* ci: add new github workflow for testing just the mock tests

* fix: fix linting error

* ci(conftest.py): add conftest.py to isolate proxy tests

* build(pyproject.toml): add respx to dev dependencies

* build(pyproject.toml): add prisma to dev dependencies

* test: fix mock prompt management tests to use a mock anthropic key

* ci(test-litellm.yml): parallelize mock testing

make it run faster

* build(pyproject.toml): add hypercorn as dev dep

* build(pyproject.toml): separate proxy vs. core dev dependencies

make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn

* ci(test-litellm.yml): pin python version

* test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing

* ci: add thank you message to ci

* test: add mock env var to test

* test: add autouse to tests

* test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
Krrish Dholakia
24b3e80eba ci: update github action 2025-03-25 23:11:45 -07:00
Krish Dholakia
6cd6ff801f
ci(publish-migrations.yml): add action for publishing prisma db migrations (#9537)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 18s
Helm unit test / unit-test (push) Successful in 21s
2025-03-25 17:55:59 -07:00
Ishaan Jaff
165b1887bd fix docker img deploy - deploy stable releases from main-stable 2025-03-15 20:34:32 -07:00
Ishaan Jaff
f5e9211c1b fix ghcr build 2025-03-15 20:14:04 -07:00
Ishaan Jaff
4f898c9f48 fix ghcr deploy 2025-03-15 19:37:09 -07:00
Ishaan Jaff
df7efa17f8 fix docker img tag displayed on stable releases 2025-03-15 13:46:30 -07:00
Manuel Cañete
fb4ebf0fd4 ci: add helm unittest 2025-03-08 01:29:25 +01:00
Ishaan Jaff
4032838408 fix load tests on litellm release notes 2025-02-26 19:11:43 -08:00
Ishaan Jaff
bca6e37c24 fix _get_docker_run_command_stable_release 2025-02-25 19:11:30 -08:00
Ishaan Jaff
bfae5c4161 fix naming docker stable release 2025-02-11 20:53:52 -08:00
Ishaan Jaff
022917b7b5 fix stale issue mgmt 2025-01-27 18:56:02 -08:00
Ishaan Jaff
c1a1c052f0 fix stale issue mgmt 2025-01-27 18:53:59 -08:00
Ishaan Jaff
02edf191a3
action for stale (#8045) 2025-01-27 18:50:58 -08:00
Krrish Dholakia
ed1e3e9dc1 ci(reset_stable.yml): fix to run on release created events 2024-12-28 19:53:18 -08:00
Krrish Dholakia
bb9171e037 ci(reset_stable.yml): modify to work with all kinds of releases 2024-12-21 12:13:26 -08:00
Krrish Dholakia
741500e089 build(reset_stable.yml): rename branch to 'litellm_stable_release_branch'
use this branch to trigger load test / other workflows for stable releases
2024-12-19 17:43:37 -08:00
Krrish Dholakia
19e67b8c0e build(reset_stable.yml): add new workflow to reset litellm_stable to latest release 2024-12-19 17:36:58 -08:00
Ishaan Jaff
c7f14e936a
(code quality) run ruff rule to ban unused imports (#7313)
* remove unused imports

* fix AmazonConverseConfig

* fix test

* fix import

* ruff check fixes

* test fixes

* fix testing

* fix imports
2024-12-19 12:33:42 -08:00
Krrish Dholakia
e5e49f5c49 build: fix test 2024-12-03 12:25:36 -08:00
Krrish Dholakia
7ecbc3beec build(label-mlops.yml): fix check 2024-12-03 12:23:31 -08:00
Krrish Dholakia
445ba4de73 build(label-mlops.yml): add tag to mlops user requests 2024-12-03 12:20:48 -08:00
Krish Dholakia
66c1ee09cf
ci: remove redundant lint.yml workflow (#6622) 2024-11-07 01:05:58 +05:30
Ishaan Jaff
45ff74ae81 fix flake8 checks 2024-11-06 10:45:58 -08:00
Krish Dholakia
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler (#6290) (#6415)
* allow configuring httpx hooks for AsyncHTTPHandler (#6290)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* Fixes and minor improvements for Helm Chart (#6402)

* reckoner hack

* fix default

* add extracontainers option

* revert chart

* fix extracontainers

* fix deployment

* remove init container

* update docs

* add helm lint to deploy step

* change name

* (refactor) prometheus async_log_success_event to be under 100 LOC  (#6416)

* unit testig for prometheus

* unit testing for success metrics

* use 1 helper for _increment_token_metrics

* use helper for _increment_remaining_budget_metrics

* use _increment_remaining_budget_metrics

* use _increment_top_level_request_and_spend_metrics

* use helper for _set_latency_metrics

* remove noqa violation

* fix test prometheus

* test prometheus

* unit testing for all prometheus helper functions

* fix prom unit tests

* fix unit tests prometheus

* fix unit test prom

* (refactor) router - use static methods for client init utils  (#6420)

* use InitalizeOpenAISDKClient

* use InitalizeOpenAISDKClient static method

* fix  # noqa: PLR0915

* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend  (#6406)

* code cleanup remove unused and undocumented code files

* fix unused logging integrations cleanup

* update chart version

* add circleci tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>

* fix: fix linting error

* fix(http_handler.py): fix linting error

---------

Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com>
Co-authored-by: Robert Brennan <accounts@rbren.io>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
2024-10-24 22:00:24 -07:00
Ishaan Jaff
5de69cb1b2 fix using Dockerfile 2024-10-08 08:45:40 +05:30
Ishaan Jaff
d742e8cb43
(clean up) move docker files from root to docker folder (#6109)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy
2024-10-08 08:23:52 +05:30
Ishaan Jaff
48eb4d2730 add docker image for non-root 2024-08-20 15:43:29 -07:00
Ishaan Jaff
70df5422ba bring back model_prices_and_context_window update yml job 2024-08-20 12:09:54 -07:00
Mikio Stewart
1724edeed7 fetch-depth=0 2024-08-20 11:55:28 -07:00
Mikio Stewart
d71d19be1e
Merge branch 'BerriAI:main' into main 2024-08-20 11:52:26 -07:00
Ishaan Jaff
e28e1c4cdb
Merge pull request #4649 from mikstew/mikio/helm-app-version
Fix app_version in helm build
2024-08-20 09:08:17 -07:00
Mikio Stewart
1f6b32e3e0
Delete .github/workflows/auto_update_price_and_context_window.yml 2024-08-20 09:00:17 -07:00
Ishaan Jaff
48419ca8bc add step to ghcr deploy 2024-08-02 08:06:09 -07:00
Mikio Stewart
54f02d52db remove unused env var 2024-07-12 15:45:55 -07:00
Mikio Stewart
05831ab6d4 skip helm build for dev builds 2024-07-11 13:21:38 -07:00
Mikio Stewart
fafa5a285a remove fetch-depth 2024-07-11 12:34:11 -07:00
Mikio Stewart
b8a280e3a9 use git describe to find latest tag 2024-07-11 12:33:16 -07:00
Mikio Stewart
9d5b8fa0ca move helm after build and use litellm for chart_name 2024-07-10 15:37:38 -07:00
Krrish Dholakia
3f67821c4c build(ghcr_deploy.yml): fix discord release note push 2024-07-06 19:06:04 -07:00
Krrish Dholakia
d2a8c7fc25 build(ghcr_deploy.yml): fix curl command 2024-07-06 17:54:55 -07:00
Ishaan Jaff
54cf065048
Merge pull request #3116 from bcvanmeurs/patch-2
fix(build): .dockerignore not picked up
2024-06-15 09:15:01 -07:00
Krish Dholakia
1ec2ba186f
Create main.yml
Create a workflow to deploy dev releases
2024-06-01 14:02:35 -07:00
Ishaan Jaff
ec2e846878 fix load test 2024-05-25 17:36:42 -07:00
Ishaan Jaff
fe8b7f6b4a re-deploy proxy 2024-05-25 17:30:37 -07:00
Ishaan Jaff
284f2dc804 fix - locustfile 2024-05-25 17:25:21 -07:00
Ishaan Jaff
0b3c21b114 fix - load test 2024-05-25 17:19:34 -07:00
vietpham1911
f1ae9f0acd Added the requested features of Merlinvt ("1.If the model is not multimodal, there is no info needed for input_cost_per_image. Right now it's 0.0 for a lot of models.
2. Could you add the field max_output_tokens (is it max_completion_tokens in OpenRouter?).")
2024-05-22 16:10:39 +09:30