Commit graph

18313 commits

Author SHA1 Message Date
Ishaan Jaff
ea716d311d fix typing error on test 2024-09-05 15:47:18 -07:00
Ishaan Jaff
edc51f45ac add error message on test 2024-09-05 15:46:13 -07:00
Ishaan Jaff
30137b0b72 run ci - cd again 2024-09-05 15:42:40 -07:00
Ishaan Jaff
9eb35e47ee run ci/cd on main 2024-09-05 15:39:30 -07:00
Ishaan Jaff
05e02fbe76 run ci/cd again 2024-09-05 15:38:49 -07:00
Ishaan Jaff
004a71b8dc use requirements txt 2024-09-05 15:34:17 -07:00
Ishaan Jaff
c40f6f0437 fix on /user/info show all keys - even expired ones 2024-09-05 15:31:41 -07:00
Ishaan Jaff
0426aa5642 run test again 2024-09-05 15:26:48 -07:00
Ishaan Jaff
42b2566906 run ci/cd agaiin 2024-09-05 15:26:12 -07:00
Ishaan Jaff
3d9049df6d move folder key gen prisma is in 2024-09-05 15:24:00 -07:00
Ishaan Jaff
5b1d207cf4 run test again 2024-09-05 15:20:21 -07:00
Krrish Dholakia
c154c5e230 docs(configs.md): update to clarify you can use os.environ/ for any config value 2024-09-05 15:19:12 -07:00
Ishaan Jaff
89649282ee run again 2024-09-05 15:17:17 -07:00
Ishaan Jaff
e551680fce add step for ui testing 2024-09-05 15:15:41 -07:00
Ishaan Jaff
9aff6a4c9d add test for ui usage endpoints 2024-09-05 15:06:53 -07:00
Ishaan Jaff
a30917311e fix import 2024-09-05 14:42:56 -07:00
Krrish Dholakia
8ca7c2c9af test(test_function_call_parsing.py): handle anthropic internal server error 2024-09-05 14:37:53 -07:00
OrangeWolf
542b333c95 Update utils.py (#5530)
fix KeyError (cause by typo?)
2024-09-05 14:37:53 -07:00
Ishaan Jaff
94d6e800ee add test for internal vs admin user 2024-09-05 13:30:51 -07:00
Ishaan Jaff
48cf7ac52f fix tests on viewing spend logs 2024-09-05 13:17:03 -07:00
Ishaan Jaff
f9a3e343bb add ui testing folder 2024-09-05 13:13:58 -07:00
Ishaan Jaff
8d9a724400 fix test_call_with_key_over_budget 2024-09-05 13:08:13 -07:00
Ishaan Jaff
8344bbd3af ui add a check for isAdminOrAdminViewer 2024-09-05 13:04:20 -07:00
Ishaan Jaff
491e50f381 fix allow internal user to view their own usage 2024-09-05 12:53:44 -07:00
Ishaan Jaff
fe55563233 fix /global/spend/provider 2024-09-05 12:48:58 -07:00
Ishaan Jaff
2ba2de5e6d add global/spend/provider 2024-09-05 12:44:44 -07:00
Ishaan Jaff
936e486c95 fix import 2024-09-05 12:40:45 -07:00
Krrish Dholakia
08976370a3 docs(configs.md): update to clarify you can use os.environ/ for any config value 2024-09-05 12:40:31 -07:00
Ishaan Jaff
1b42e53e06 allow internal user to view global/spend/models 2024-09-05 12:38:48 -07:00
Ishaan Jaff
0a05c24a9a allow internal user to view their own spend 2024-09-05 12:35:04 -07:00
Ishaan Jaff
034de5b3cc add usage endpoints for internal user 2024-09-05 12:34:41 -07:00
Ishaan Jaff
09894204a5 show /spend/logs for internal users 2024-09-05 12:14:03 -07:00
Ishaan Jaff
e0400accca fix create view - MonthlyGlobalSpendPerUserPerKey 2024-09-05 12:11:59 -07:00
Ishaan Jaff
cc51fd0df9 use helper functions per endpoint 2024-09-05 10:57:12 -07:00
Ishaan Jaff
e6e5fb5843 add /spend/tags as allowed route for internal user 2024-09-05 10:41:43 -07:00
Ishaan Jaff
219fa492dc fix import 2024-09-05 10:41:13 -07:00
Ishaan Jaff
e9cb1e0853 fix import error 2024-09-05 10:27:35 -07:00
Ishaan Jaff
e1c989ad3d fix import error 2024-09-05 10:19:10 -07:00
Ishaan Jaff
7d2298d3c1 fix allow internal user and internal viewer to view usage 2024-09-05 10:16:25 -07:00
Ishaan Jaff
25887c1846 fix import error 2024-09-05 10:09:44 -07:00
Krrish Dholakia
e32d4a15b2 test(test_function_call_parsing.py): handle anthropic internal server error 2024-09-05 10:03:07 -07:00
Ishaan Jaff
ed627bc5d2 fix linting error 2024-09-05 09:56:33 -07:00
Ishaan Jaff
81ee1653af use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
OrangeWolf
773914bcb7
Update utils.py (#5530)
fix KeyError (cause by typo?)
2024-09-05 08:21:41 -07:00
Krrish Dholakia
a9be7dd79b docs(pass_through/bedrock.md): add bedrock agents support 2024-09-04 22:30:14 -07:00
Krrish Dholakia
3709a0565e bump: version 1.44.17 → 1.44.18 2024-09-04 22:22:40 -07:00
Krish Dholakia
ca37bb9de5
fix(pass_through_endpoints): support bedrock agents via pass through (#5527) 2024-09-04 22:22:22 -07:00
Krish Dholakia
1e7e538261
LiteLLM Minor fixes + improvements (08/04/2024) (#5505)
* Minor IAM AWS OIDC Improvements (#5246)

* AWS IAM: Temporary tokens are valid across all regions after being issued, so it is wasteful to request one for each region.

* AWS IAM: Include an inline policy, to help reduce misuse of overly permissive IAM roles.

* (test_bedrock_completion.py): Ensure we are testing cross AWS region OIDC flow.

* fix(router.py): log rejected requests

Fixes https://github.com/BerriAI/litellm/issues/5498

* refactor: don't use verbose_logger.exception, if exception is raised

User might already have handling for this. But alerting systems in prod will raise this as an unhandled error.

* fix(datadog.py): support setting datadog source as an env var

Fixes https://github.com/BerriAI/litellm/issues/5508

* docs(logging.md): add dd_source to datadog docs

* fix(proxy_server.py): expose `/customer/list` endpoint for showing all customers

* (bedrock): Fix usage with Cloudflare AI Gateway, and proxies in general. (#5509)

* feat(anthropic.py): support 'cache_control' param for content when it is a string

* Revert "(bedrock): Fix usage with Cloudflare AI Gateway, and proxies in gener…" (#5519)

This reverts commit 3fac0349c2.

* refactor: ci/cd run again

---------

Co-authored-by: David Manouchehri <david.manouchehri@ai.moda>
2024-09-04 22:16:55 -07:00
Ishaan Jaff
cdc312d51d mark test_team_logging as flaky 2024-09-04 20:29:21 -07:00
Ishaan Jaff
20a5bbe6a6 fix allow general guardrails on free tier 2024-09-04 19:59:32 -07:00