Commit graph

14541 commits

Author SHA1 Message Date
dependabot[bot]
9fe5d9caa6
Bump azure-identity from 1.16.0 to 1.16.1
Bumps [azure-identity](https://github.com/Azure/azure-sdk-for-python) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-python/compare/azure-identity_1.16.0...azure-identity_1.16.1)

---
updated-dependencies:
- dependency-name: azure-identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-12 01:28:58 +00:00
Ishaan Jaff
60910cbc21
Merge pull request #4640 from freinold/main
Fix: Add prisma binary_cache_dir specification to pyproject.toml
2024-07-11 18:27:24 -07:00
Ishaan Jaff
28cfca87c1
Merge pull request #4647 from msabramo/msabramo/remove-unnecessary-imports
Remove unnecessary imports
2024-07-11 15:07:30 -07:00
Ishaan Jaff
17822db657
Merge pull request #4662 from msabramo/slack-alert-add-missing-space
Add missing space in "Failed Tracking Cost" Slack alert msg
2024-07-11 15:03:52 -07:00
Ishaan Jaff
8bf50ac5db
Merge pull request #4661 from BerriAI/litellm_fix_mh
[Fix] Model Hub - Show supports vision correctly
2024-07-11 15:03:37 -07:00
Krrish Dholakia
52b293e831 fix(types/utils.py): message role is always 'assistant' 2024-07-11 14:14:38 -07:00
Krish Dholakia
f755cc7558
Merge pull request #4663 from BerriAI/litellm_linting_fixes
Litellm linting fixes
2024-07-11 14:07:15 -07:00
Krrish Dholakia
77068575d7 fix: fix linting errors 2024-07-11 13:44:29 -07:00
Krrish Dholakia
389a51e05d fix: fix linting errors 2024-07-11 13:36:55 -07:00
Marc Abramowitz
fe27182e8e Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
6e9f048618 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Ishaan Jaff
46493303ed test get mode info for gemini/gemini-1.5-flash 2024-07-11 13:04:18 -07:00
Ishaan Jaff
341f88d191 fix supports vision 2024-07-11 12:59:42 -07:00
Krrish Dholakia
dd1048cb35 fix(main.py): fix linting errors 2024-07-11 12:11:50 -07:00
Krrish Dholakia
1ba3fcc3fb feat(utils.py): accept 'api_key' as param for validate_environment
Closes https://github.com/BerriAI/litellm/issues/4375
2024-07-11 12:02:23 -07:00
Krrish Dholakia
2163434ff3 fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
e3470d8e91
Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
6e86e4291a fix pytest 2024-07-11 10:34:28 -07:00
Ishaan Jaff
8d7db56deb fix Local only test. WIP 2024-07-11 10:30:40 -07:00
Ishaan Jaff
07ae8c6059 fix not clause on ci/cd tests 2024-07-11 10:25:34 -07:00
Ishaan Jaff
b124d9414b fix build and test test 2024-07-11 10:22:12 -07:00
Ishaan Jaff
73d19451bd fix test otel 2024-07-11 10:16:05 -07:00
Ishaan Jaff
77dcae6979 fix test otel tracing 2024-07-11 10:07:39 -07:00
Ishaan Jaff
bda9eb7faa fix build and test test 2024-07-11 10:04:05 -07:00
Ishaan Jaff
ab400d24f5 reduce deps in ci/cd test 2024-07-11 10:02:15 -07:00
Ishaan Jaff
775ce119b6 test otel 2024-07-11 10:01:36 -07:00
Ishaan Jaff
b4f8c7304f
Merge pull request #4652 from msabramo/shorter-success_callbacks-in-health-readiness-response
Shorter success callbacks from `/health/readiness`
2024-07-11 09:57:52 -07:00
Ishaan Jaff
79f409b21e
Merge pull request #4656 from BerriAI/litellm_otel_fix
[Proxy - OTEL] Fix logging DB, Redis Cache Reads
2024-07-11 09:55:51 -07:00
Ishaan Jaff
15d35cd62f test otel 2024-07-11 09:54:23 -07:00
Krrish Dholakia
070ab9f469 docs(model_management.md): update docs to clarify calling /model/info 2024-07-11 09:47:50 -07:00
Krrish Dholakia
8fa2cf15ee fix(watsonx.py): fix watson process response
Fixes https://github.com/BerriAI/litellm/issues/4654
2024-07-11 09:34:46 -07:00
Krrish Dholakia
b5a00722bc docs(assistants.md): add openai-compatible assistants api example to docs 2024-07-11 09:20:55 -07:00
Ishaan Jaff
e2c3b2b694 fix add master key in requests 2024-07-11 09:05:08 -07:00
Krrish Dholakia
57607dfc47 test(test_alangfuse.py): fix test to expect correct response object 2024-07-11 09:00:31 -07:00
Ishaan Jaff
42ae3d494d fix otel_test_config 2024-07-11 08:59:33 -07:00
Ishaan Jaff
5cc725078d ci/cd run otel test 2024-07-11 08:53:38 -07:00
Ishaan Jaff
02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Ishaan Jaff
cb6ddaf1f9 test - otel spans 2024-07-11 08:01:18 -07:00
Ishaan Jaff
a5b8db7f3a
Merge pull request #4625 from lowjiansheng/js/update-helm-chart-package
Create helm package and move index.yaml file location
2024-07-11 07:32:44 -07:00
Ishaan Jaff
19d993e120 add otel in callbacks 2024-07-11 07:24:48 -07:00
Ishaan Jaff
498d7d4228 fix - otel log db / redis calls 2024-07-11 07:22:45 -07:00
Krrish Dholakia
4b0181c79c docs(anthropic_completion.md): add doc on anthropic /v1/messages endpoint support 2024-07-10 22:56:33 -07:00
Krrish Dholakia
03e15d020e bump: version 1.41.16 → 1.41.17 2024-07-10 22:43:26 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
22bcbac9ea fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia
1019355527 fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Marc Abramowitz
434953b38c More updates to health.md docs 2024-07-10 19:08:48 -07:00
Marc Abramowitz
6ccd635216 Update doc: health.md 2024-07-10 19:02:48 -07:00
Krrish Dholakia
31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml
Adds async router support for adapter_completion call
2024-07-10 18:53:54 -07:00
Marc Abramowitz
3d86c4f515 Shorter success callbacks from /health/readiness
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
2024-07-10 18:45:42 -07:00