Ishaan Jaff
e3470d8e91
Merge pull request #4658 from BerriAI/litellm_check_otel_spans
...
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
6e86e4291a
fix pytest
2024-07-11 10:34:28 -07:00
Ishaan Jaff
8d7db56deb
fix Local only test. WIP
2024-07-11 10:30:40 -07:00
Ishaan Jaff
07ae8c6059
fix not clause on ci/cd tests
2024-07-11 10:25:34 -07:00
Ishaan Jaff
b124d9414b
fix build and test test
2024-07-11 10:22:12 -07:00
Ishaan Jaff
73d19451bd
fix test otel
2024-07-11 10:16:05 -07:00
Ishaan Jaff
77dcae6979
fix test otel tracing
2024-07-11 10:07:39 -07:00
Ishaan Jaff
bda9eb7faa
fix build and test test
2024-07-11 10:04:05 -07:00
Ishaan Jaff
ab400d24f5
reduce deps in ci/cd test
2024-07-11 10:02:15 -07:00
Ishaan Jaff
775ce119b6
test otel
2024-07-11 10:01:36 -07:00
Ishaan Jaff
b4f8c7304f
Merge pull request #4652 from msabramo/shorter-success_callbacks-in-health-readiness-response
...
Shorter success callbacks from `/health/readiness`
2024-07-11 09:57:52 -07:00
Ishaan Jaff
79f409b21e
Merge pull request #4656 from BerriAI/litellm_otel_fix
...
[Proxy - OTEL] Fix logging DB, Redis Cache Reads
2024-07-11 09:55:51 -07:00
Ishaan Jaff
15d35cd62f
test otel
2024-07-11 09:54:23 -07:00
Krrish Dholakia
070ab9f469
docs(model_management.md): update docs to clarify calling /model/info
2024-07-11 09:47:50 -07:00
Krrish Dholakia
8fa2cf15ee
fix(watsonx.py): fix watson process response
...
Fixes https://github.com/BerriAI/litellm/issues/4654
2024-07-11 09:34:46 -07:00
Krrish Dholakia
b5a00722bc
docs(assistants.md): add openai-compatible assistants api example to docs
2024-07-11 09:20:55 -07:00
Ishaan Jaff
e2c3b2b694
fix add master key in requests
2024-07-11 09:05:08 -07:00
Krrish Dholakia
57607dfc47
test(test_alangfuse.py): fix test to expect correct response object
2024-07-11 09:00:31 -07:00
Ishaan Jaff
42ae3d494d
fix otel_test_config
2024-07-11 08:59:33 -07:00
Ishaan Jaff
5cc725078d
ci/cd run otel test
2024-07-11 08:53:38 -07:00
Ishaan Jaff
02ab3cb73d
test- otel span recording
2024-07-11 08:47:16 -07:00
Ishaan Jaff
cb6ddaf1f9
test - otel spans
2024-07-11 08:01:18 -07:00
Ishaan Jaff
a5b8db7f3a
Merge pull request #4625 from lowjiansheng/js/update-helm-chart-package
...
Create helm package and move index.yaml file location
2024-07-11 07:32:44 -07:00
Ishaan Jaff
19d993e120
add otel in callbacks
2024-07-11 07:24:48 -07:00
Ishaan Jaff
498d7d4228
fix - otel log db / redis calls
2024-07-11 07:22:45 -07:00
Krrish Dholakia
4b0181c79c
docs(anthropic_completion.md): add doc on anthropic /v1/messages
endpoint support
2024-07-10 22:56:33 -07:00
Krrish Dholakia
03e15d020e
bump: version 1.41.16 → 1.41.17
2024-07-10 22:43:26 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
...
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
22bcbac9ea
fix: fix linting error
2024-07-10 22:14:23 -07:00
Krrish Dholakia
1019355527
fix(types/utils.py): fix streaming function name
2024-07-10 21:56:47 -07:00
Marc Abramowitz
434953b38c
More updates to health.md docs
2024-07-10 19:08:48 -07:00
Marc Abramowitz
6ccd635216
Update doc: health.md
2024-07-10 19:02:48 -07:00
Krrish Dholakia
31829855c0
feat(proxy_server.py): working /v1/messages
with config.yaml
...
Adds async router support for adapter_completion call
2024-07-10 18:53:54 -07:00
Marc Abramowitz
3d86c4f515
Shorter success callbacks from /health/readiness
...
Before:
```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
"langfuse",
"<function _PROXY_track_cost_callback at 0x12fc14b80>",
"<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
"<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
"<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
"<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
"<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```
After:
```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
"langfuse",
"_PROXY_track_cost_callback",
"response_taking_too_long_callback",
"_PROXY_MaxParallelRequestsHandler",
"_PROXY_MaxBudgetLimiter",
"_PROXY_CacheControlCheck",
"ServiceLogging"
]
```
2024-07-10 18:45:42 -07:00
Ishaan Jaff
b2f4cd9b56
bump: version 1.41.15 → 1.41.16
2024-07-10 18:34:30 -07:00
Krrish Dholakia
2f8dbbeb97
feat(proxy_server.py): working /v1/messages
endpoint
...
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
f49837df19
ci/cd run again
2024-07-10 18:06:09 -07:00
Ishaan Jaff
dc5adbb0ca
docs - control allowed ip address
2024-07-10 18:03:54 -07:00
Ishaan Jaff
b4a96e81c6
docs gdpr regions cloud
2024-07-10 18:00:16 -07:00
Ishaan Jaff
da73f3abda
docs security cloud litellm
2024-07-10 17:54:54 -07:00
Ishaan Jaff
ca76d2fd72
fix test_completion_bedrock_httpx_models
2024-07-10 17:42:40 -07:00
Ishaan Jaff
9590d63a38
docs - Security Measures
2024-07-10 17:40:30 -07:00
Ishaan Jaff
d0a7983a41
fix try / except langfuse deep copy
2024-07-10 17:22:14 -07:00
Marc Abramowitz
45a9920080
Add/remove blank lines to make MD linter happy
...
This removed a lot of yellow squigglies in my VS Code.
2024-07-10 17:20:23 -07:00
Ishaan Jaff
7efe9beac5
fix test_bedrock_httpx_streaming
2024-07-10 17:14:53 -07:00
Marc Abramowitz
9dadbe52f7
Shorten title
...
I think it looks better to have a shorter title in the left sidebar
and then describe the longer details in the body of the document.
2024-07-10 17:07:51 -07:00
Marc Abramowitz
3e49cfa6ff
Delete manual table of contents
...
It seems redudant since Docusaurus already generates a table of contents in the
right sidebar.
In fact, the `(BETA) Moderation with Azure Content-Safety` link in the manual
TOC was broken, which shows how easy it is to forget to update the manual TOC
when adding new content or to make a mistake while doing it.
2024-07-10 17:03:47 -07:00
Marc Abramowitz
dd0c07d2a1
Move JSX stuff so first line of file is heading
...
This prevents VS Code from displaying a warning about the file not starting with
a heading.
2024-07-10 17:02:56 -07:00
Ishaan Jaff
de0dacc42d
fix test proxy routes
2024-07-10 16:58:53 -07:00
Ishaan Jaff
7b8670f883
add /files/{file_id}/content as openai route
2024-07-10 16:55:09 -07:00