Commit graph

14594 commits

Author SHA1 Message Date
Ishaan Jaff
e3470d8e91
Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
6e86e4291a fix pytest 2024-07-11 10:34:28 -07:00
Ishaan Jaff
8d7db56deb fix Local only test. WIP 2024-07-11 10:30:40 -07:00
Ishaan Jaff
07ae8c6059 fix not clause on ci/cd tests 2024-07-11 10:25:34 -07:00
Ishaan Jaff
b124d9414b fix build and test test 2024-07-11 10:22:12 -07:00
Ishaan Jaff
73d19451bd fix test otel 2024-07-11 10:16:05 -07:00
Ishaan Jaff
77dcae6979 fix test otel tracing 2024-07-11 10:07:39 -07:00
Ishaan Jaff
bda9eb7faa fix build and test test 2024-07-11 10:04:05 -07:00
Ishaan Jaff
ab400d24f5 reduce deps in ci/cd test 2024-07-11 10:02:15 -07:00
Ishaan Jaff
775ce119b6 test otel 2024-07-11 10:01:36 -07:00
Ishaan Jaff
b4f8c7304f
Merge pull request #4652 from msabramo/shorter-success_callbacks-in-health-readiness-response
Shorter success callbacks from `/health/readiness`
2024-07-11 09:57:52 -07:00
Ishaan Jaff
79f409b21e
Merge pull request #4656 from BerriAI/litellm_otel_fix
[Proxy - OTEL] Fix logging DB, Redis Cache Reads
2024-07-11 09:55:51 -07:00
Ishaan Jaff
15d35cd62f test otel 2024-07-11 09:54:23 -07:00
Krrish Dholakia
070ab9f469 docs(model_management.md): update docs to clarify calling /model/info 2024-07-11 09:47:50 -07:00
Krrish Dholakia
8fa2cf15ee fix(watsonx.py): fix watson process response
Fixes https://github.com/BerriAI/litellm/issues/4654
2024-07-11 09:34:46 -07:00
Krrish Dholakia
b5a00722bc docs(assistants.md): add openai-compatible assistants api example to docs 2024-07-11 09:20:55 -07:00
Ishaan Jaff
e2c3b2b694 fix add master key in requests 2024-07-11 09:05:08 -07:00
Krrish Dholakia
57607dfc47 test(test_alangfuse.py): fix test to expect correct response object 2024-07-11 09:00:31 -07:00
Ishaan Jaff
42ae3d494d fix otel_test_config 2024-07-11 08:59:33 -07:00
Ishaan Jaff
5cc725078d ci/cd run otel test 2024-07-11 08:53:38 -07:00
Ishaan Jaff
02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Ishaan Jaff
cb6ddaf1f9 test - otel spans 2024-07-11 08:01:18 -07:00
Ishaan Jaff
a5b8db7f3a
Merge pull request #4625 from lowjiansheng/js/update-helm-chart-package
Create helm package and move index.yaml file location
2024-07-11 07:32:44 -07:00
Ishaan Jaff
19d993e120 add otel in callbacks 2024-07-11 07:24:48 -07:00
Ishaan Jaff
498d7d4228 fix - otel log db / redis calls 2024-07-11 07:22:45 -07:00
Krrish Dholakia
4b0181c79c docs(anthropic_completion.md): add doc on anthropic /v1/messages endpoint support 2024-07-10 22:56:33 -07:00
Krrish Dholakia
03e15d020e bump: version 1.41.16 → 1.41.17 2024-07-10 22:43:26 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
22bcbac9ea fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
1019355527 fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Marc Abramowitz
434953b38c More updates to health.md docs 2024-07-10 19:08:48 -07:00
Marc Abramowitz
6ccd635216 Update doc: health.md 2024-07-10 19:02:48 -07:00
Krrish Dholakia
31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml
Adds async router support for adapter_completion call
2024-07-10 18:53:54 -07:00
Marc Abramowitz
3d86c4f515 Shorter success callbacks from /health/readiness
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
2024-07-10 18:45:42 -07:00
Ishaan Jaff
b2f4cd9b56 bump: version 1.41.15 → 1.41.16 2024-07-10 18:34:30 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
f49837df19 ci/cd run again 2024-07-10 18:06:09 -07:00
Ishaan Jaff
dc5adbb0ca docs - control allowed ip address 2024-07-10 18:03:54 -07:00
Ishaan Jaff
b4a96e81c6 docs gdpr regions cloud 2024-07-10 18:00:16 -07:00
Ishaan Jaff
da73f3abda docs security cloud litellm 2024-07-10 17:54:54 -07:00
Ishaan Jaff
ca76d2fd72 fix test_completion_bedrock_httpx_models 2024-07-10 17:42:40 -07:00
Ishaan Jaff
9590d63a38 docs - Security Measures 2024-07-10 17:40:30 -07:00
Ishaan Jaff
d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Marc Abramowitz
45a9920080 Add/remove blank lines to make MD linter happy
This removed a lot of yellow squigglies in my VS Code.
2024-07-10 17:20:23 -07:00
Ishaan Jaff
7efe9beac5 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Marc Abramowitz
9dadbe52f7 Shorten title
I think it looks better to have a shorter title in the left sidebar
and then describe the longer details in the body of the document.
2024-07-10 17:07:51 -07:00
Marc Abramowitz
3e49cfa6ff Delete manual table of contents
It seems redudant since Docusaurus already generates a table of contents in the
right sidebar.

In fact, the `(BETA) Moderation with Azure Content-Safety` link in the manual
TOC was broken, which shows how easy it is to forget to update the manual TOC
when adding new content or to make a mistake while doing it.
2024-07-10 17:03:47 -07:00
Marc Abramowitz
dd0c07d2a1 Move JSX stuff so first line of file is heading
This prevents VS Code from displaying a warning about the file not starting with
a heading.
2024-07-10 17:02:56 -07:00
Ishaan Jaff
de0dacc42d fix test proxy routes 2024-07-10 16:58:53 -07:00
Ishaan Jaff
7b8670f883 add /files/{file_id}/content as openai route 2024-07-10 16:55:09 -07:00