Commit graph

17755 commits

Author SHA1 Message Date
Ishaan Jaff
b60361fca1 fix otel test 2024-09-09 16:20:47 -07:00
Ishaan Jaff
f742d6162f fix otel defaults 2024-09-09 16:18:55 -07:00
Ishaan Jaff
4592d80f43 add doc on redacting otel message / response 2024-09-09 16:10:13 -07:00
Ishaan Jaff
7c9591881c use callback_settings when intializing otel 2024-09-09 16:05:48 -07:00
Ishaan Jaff
b36f964217 fix init custom logger when init OTEL runs 2024-09-09 16:03:39 -07:00
Ishaan Jaff
12d8c0d0a4 use redact_message_input_output_from_custom_logger 2024-09-09 16:02:24 -07:00
Ishaan Jaff
b86075ef9a refactor redact_message_input_output_from_custom_logger 2024-09-09 16:00:47 -07:00
Ishaan Jaff
715387c3c0 add message_logging on Custom Logger 2024-09-09 15:59:42 -07:00
Ishaan Jaff
15c761a56b
Merge pull request #5599 from BerriAI/litellm_allow_mounting_prom_callbacks
[Feat] support using "callbacks" for prometheus
2024-09-09 15:00:43 -07:00
Ishaan Jaff
05210fee6a update test_default_tagged_deployments 2024-09-09 14:48:29 -07:00
Ishaan Jaff
2fceeedd94 add "default" tag 2024-09-09 14:41:22 -07:00
Ishaan Jaff
fe7ab3f3d7 test test_default_tagged_deployments 2024-09-09 14:27:52 -07:00
Ishaan Jaff
c4052ee7d7 support default deployments 2024-09-09 14:23:17 -07:00
Krish Dholakia
b374990c79
build(deployment.yaml): Fix port + allow setting database url in helm chart (#5587) 2024-09-09 14:17:44 -07:00
Ishaan Jaff
f1d0045ae6 fix taf based routing debugging 2024-09-09 14:11:54 -07:00
Ishaan Jaff
a1f0df3cea fix debug statements 2024-09-09 14:00:17 -07:00
Ishaan Jaff
8a3ac60187 fix test_async_prometheus_success_logging_with_callbacks 2024-09-09 11:54:11 -07:00
Ishaan Jaff
7ff7028885 fix create script for pre-creating views 2024-09-09 11:03:27 -07:00
Ishaan Jaff
e253c100f4 support using "callbacks" for prometheus 2024-09-09 08:26:03 -07:00
Ishaan Jaff
3bf6589fab docs architecture 2024-09-07 19:09:33 -07:00
Ishaan Jaff
67c1853216 bump: version 1.44.21 → 1.44.22 2024-09-07 19:05:32 -07:00
Ishaan Jaff
79d605d2dd
Merge pull request #5586 from BerriAI/litellm_add_key_list_endpoint
Feat - Proxy add /key/list endpoint
2024-09-07 19:04:05 -07:00
Krrish Dholakia
0a016d33e6 Revert "fix(router.py): return model alias w/ underlying deployment on router.get_model_list()"
This reverts commit 638896309c.
2024-09-07 18:04:56 -07:00
Krrish Dholakia
638896309c fix(router.py): return model alias w/ underlying deployment on router.get_model_list()
Fixes https://github.com/BerriAI/litellm/issues/5524#issuecomment-2336410666
2024-09-07 18:01:31 -07:00
Krrish Dholakia
8294e8793c docs(deploy.md): add published non-root docker image to docs 2024-09-07 18:01:31 -07:00
Ishaan Jaff
204c384400 add /key/list endpoint 2024-09-07 16:52:28 -07:00
Ishaan Jaff
ba41a72f92 High Level architecture 2024-09-07 16:29:22 -07:00
Ishaan Jaff
c574c729cd ui new build 2024-09-07 16:24:06 -07:00
Ishaan Jaff
9eb59e3645
Merge pull request #5585 from BerriAI/litellm_docs_arch_diagram
[Docs] - Add Lifecycle of a request through LiteLLM Gateway
2024-09-07 16:22:02 -07:00
Ishaan Jaff
c2c63e4dbe docs add arch diagram 2024-09-07 16:21:29 -07:00
Ishaan Jaff
54db564529 add arch diagram 2024-09-07 15:49:51 -07:00
Ishaan Jaff
e88482e6cf
Merge pull request #5582 from BerriAI/litellm_ui
[Feat UI] allow setting input / output cost per M tokens
2024-09-07 12:32:42 -07:00
Ishaan Jaff
64e830ac21
Merge pull request #5581 from BerriAI/litellm_allow_setting_spend_report_frequency
[Feat] Slack Alerting - Allow setting custom spend report frequency
2024-09-07 12:32:18 -07:00
Ishaan Jaff
57d3d59aaf ui allow setting input / output cost per M tokens 2024-09-07 12:07:14 -07:00
Ishaan Jaff
ecb774c3e8 add doc on spend report frequency 2024-09-07 11:54:33 -07:00
Ishaan Jaff
805e4c5754 add spend_report_frequency as a general setting 2024-09-07 11:44:58 -07:00
Ishaan Jaff
1b732c485d fix slack alerting allow setting custom spend report frequency 2024-09-07 11:42:16 -07:00
Ishaan Jaff
009a1f7f86
Merge pull request #5579 from BerriAI/litellm_set_redis_cluster_env
[Feat] Allow setting up Redis Cluster using .env vars
2024-09-07 11:31:38 -07:00
Ishaan Jaff
05505903b2 docs better sidebar 2024-09-07 11:31:07 -07:00
Ishaan Jaff
3984b9080c docs cleanup 2024-09-07 11:23:44 -07:00
Ishaan Jaff
2cf0714b0d docs organize sidebar 2024-09-07 11:23:06 -07:00
Ishaan Jaff
808ba36b55 ui cleanup 2024-09-07 11:20:07 -07:00
Ishaan Jaff
66eba43f29 mark test_langfuse_masked_input_output 2024-09-07 11:15:29 -07:00
Ishaan Jaff
3bf2c06e06 add config for setting up redis cluster 2024-09-07 09:37:23 -07:00
Ishaan Jaff
9a9c0e42eb allow setting password for redis cluster 2024-09-07 09:25:13 -07:00
Ishaan Jaff
eaab0e761d add test_redis_cache_cluster_init_with_env_vars_unit_test 2024-09-07 08:56:00 -07:00
Ishaan Jaff
5c4f3a9a34 fix allow using .env vars for redis cluster 2024-09-07 08:54:40 -07:00
Peter Laß
72ea6f2ea8
litellm-helm: fix missing resource definitions in initContainer and missing DBname value for envVars in deployment.yaml (#5562)
* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

* fix missing resource definitions in initContainer and missing DBname value in envVars in deployment.yaml

---------

Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-07 08:23:05 -07:00
Pradyumna Singh Rathore
a4f5fb3c30
fix missing class object instantiation in custom_llm_server provider documentation's quick start (#5578)
Co-authored-by: Pradyumna Singh Rathore <pradyumna.singhrathore@halliburton.com>
2024-09-07 08:22:18 -07:00
Ishaan Jaff
9225d31776 allow setting REDIS_CLUSTER_NODES in .env 2024-09-07 07:41:49 -07:00