Commit graph

21517 commits

Author SHA1 Message Date
Ishaan Jaff
7c4268ff5a test_scim_transformations.py 2025-04-16 19:12:51 -07:00
Ishaan Jaff
ad41bbe251 fix ui linting 2025-04-16 19:05:48 -07:00
Ishaan Jaff
18b75cb39a fix code quality check 2025-04-16 19:04:18 -07:00
Ishaan Jaff
721e1f6f53 fix SCIM linting error 2025-04-16 18:59:39 -07:00
Ishaan Jaff
62c43efa15 refactor scim transform 2025-04-16 18:57:20 -07:00
Ishaan Jaff
61a9fcf9a5 add migration for allowed_routes in keys table 2025-04-16 18:52:06 -07:00
Ishaan Jaff
a953319778 Merge branch 'main' into litellm_scim_support 2025-04-16 18:50:37 -07:00
Ishaan Jaff
eea7050d20 clean up scim view 2025-04-16 18:39:32 -07:00
Ishaan Jaff
61190daf7c scim settings 2025-04-16 18:29:49 -07:00
Ishaan Jaff
3971a9e6ff fixes for SCIM settings on ui 2025-04-16 18:24:52 -07:00
Ishaan Jaff
d3e2949e7c fixes SCIM 2025-04-16 18:17:15 -07:00
Ishaan Jaff
2c3c0290f8 add UI tab for SCIM 2025-04-16 18:15:19 -07:00
Ishaan Jaff
af7ffcab80 ui SCIM support 2025-04-16 18:12:59 -07:00
Krish Dholakia
7ca553b235
Add team based usage dashboard at 1m+ spend logs (+ new /team/daily/activity API) (#10081)
* feat(ui/): add team based usage to dashboard

allows admin to see spend across teams + within teams at 1m+ spend logs

* fix(entity_usage.tsx): add activity page to entity usage

* style(entity_usage.tsx): place filter above tab switcher
2025-04-16 18:10:14 -07:00
Ishaan Jaff
cd4e923b42 fix for route checks 2025-04-16 18:05:32 -07:00
Ishaan Jaff
54aa100b47 fix code check 2025-04-16 17:41:57 -07:00
Ishaan Jaff
38de64e1cf clean up error message 2025-04-16 17:39:46 -07:00
Ishaan Jaff
f75aaaba49 fix allowed routes check 2025-04-16 17:36:00 -07:00
Ishaan Jaff
4fe81bc9f7 fix for key management 2025-04-16 17:30:58 -07:00
Ishaan Jaff
d16f9238ff fix allowed routes 2025-04-16 17:28:27 -07:00
Ishaan Jaff
b8a1bc521a add is_virtual_key_allowed_to_call_route 2025-04-16 17:27:18 -07:00
Ishaan Jaff
119ea80f60 add auth on all scim endpoints 2025-04-16 17:12:08 -07:00
Ishaan Jaff
a208598b04 fix dont auto create scim keys 2025-04-16 17:09:28 -07:00
Ishaan Jaff
edb50d4d6c fix import scim_router 2025-04-16 16:54:22 -07:00
Ishaan Jaff
ce71e85543 move scim folder 2025-04-16 16:53:32 -07:00
Ishaan Jaff
10d399a714 add SCIMPatchOp 2025-04-16 16:49:46 -07:00
Ishaan Jaff
a6e2988efb working team / group provisioning on SCIM 2025-04-16 16:09:32 -07:00
Ishaan Jaff
251c39846b working SCIMErrorResponse 2025-04-16 15:29:22 -07:00
Krish Dholakia
c0d7e9f16d
Add new /tag/daily/activity endpoint + Add tag dashboard to UI (#10073)
Some checks failed
Read Version from pyproject.toml / read-version (push) Successful in 15s
Helm unit test / unit-test (push) Successful in 24s
Publish Prisma Migrations / publish-migrations (push) Failing after 1m47s
* feat: initial commit adding daily tag spend table to db

* feat(db_spend_update_writer.py): correctly log tag spend transactions

* build(schema.prisma): add new tag table to root

* build: add new migration file

* feat(common_daily_activity.py): add `/tag/daily/activity` API endpoint

allows viewing daily spend by tag

* feat(tag_management_endpoints.py): support comma separated list of tags + tag breakdown metric

allows querying multiple tags + knowing what tags are driving spend

* feat(entity_usage.tsx): initial commit adding tag based usage to litellm dashboard

brings back tag based usage tracking to UI at 1m+ spend logs

* feat(entity_usage.tsx): add top api key view to ui

* feat(entity_usage.tsx): add tag table to ui

* feat(entity_usage.tsx): allow filtering by tag

* refactor(entity_usage.tsx): reorder components

* build(ui/): fix linting error

* fix: fix ruff checks

* fix(schema.prisma): drop uniqueness requirement on tag

allows dailytagspend to have multiple rows with the same tag

* build(schema.prisma): drop uniqueness requirement on tag in dailytagspend

allows tag agg. view to work on multiple rows with same tag

* build(schema.prisma): drop tag uniqueness requirement
2025-04-16 15:24:44 -07:00
Ishaan Jaff
f475564457 fix scim firstname and givenName storage 2025-04-16 14:46:30 -07:00
Ishaan Jaff
57e61bc4ed use 1 file for types 2025-04-16 14:20:55 -07:00
Ishaan Jaff
24978c92ca working scim transformation 2025-04-16 14:16:16 -07:00
Peter Dave Hello
5c078af738
Add OpenAI o3 & 4o-mini (#10065)
Reference:
- https://platform.openai.com/docs/models/o3
- https://platform.openai.com/docs/models/o4-mini
2025-04-16 12:40:13 -07:00
Ishaan Jaff
4deb795105 add v0 scim v2 endpoints 2025-04-16 12:38:41 -07:00
Ishaan Jaff
a14d0d91e9 add scim router 2025-04-16 12:37:41 -07:00
Ishaan Jaff
121fb32bbe fix NewUser response type 2025-04-16 12:35:16 -07:00
Krish Dholakia
d8a1071bc4
Add aggregate spend by tag (#10071)
* feat: initial commit adding daily tag spend table to db

* feat(db_spend_update_writer.py): correctly log tag spend transactions

* build(schema.prisma): add new tag table to root

* build: add new migration file
2025-04-16 12:26:21 -07:00
Krish Dholakia
47e811d6ce
fix(llm_http_handler.py): fix fake streaming (#10061)
* fix(llm_http_handler.py): fix fake streaming

allows groq to work with llm_http_handler

* fix(groq.py): migrate groq to openai like config

ensures json mode handling works correctly
2025-04-16 10:15:11 -07:00
Krish Dholakia
c603680d2a
fix(stream_chunk_builder_utils.py): don't set index on modelresponse (#10063)
* fix(stream_chunk_builder_utils.py): don't set index on modelresponse

* test: update tests
2025-04-16 10:11:47 -07:00
dependabot[bot]
7b7b43e1a7
build(deps): bump http-proxy-middleware in /docs/my-website (#10064)
Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware) from 2.0.7 to 2.0.9.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases)
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/v2.0.9/CHANGELOG.md)
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.7...v2.0.9)

---
updated-dependencies:
- dependency-name: http-proxy-middleware
  dependency-version: 2.0.9
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-16 09:55:44 -07:00
Ishaan Jaff
a9e8a36f89
[Bug Fix] Azure Blob Storage fixes (#10059)
* Simple fix for #9339 - upgrade the underlying library and cache the azure storage client (#9965)

* fix -  use constants for caching azure storage client

---------

Co-authored-by: Adrian Lyjak <adrian@chatmeter.com>
2025-04-16 09:47:10 -07:00
Krrish Dholakia
a743b6fc1f fix(bedrock/common_utils.py): add us-west-1 to us regions 2025-04-16 08:00:39 -07:00
Krrish Dholakia
6b7d20c911 test: fix test 2025-04-16 07:57:10 -07:00
ChaoFu Yang
c07eea864e
/utils/token_counter: get model_info from deployment directly (#10047) 2025-04-16 07:53:18 -07:00
Michael Leshchinsky
e19d05980c
Add litellm call id passing to Aim guardrails on pre and post-hooks calls (#10021)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 16s
Helm unit test / unit-test (push) Successful in 19s
* Add litellm_call_id passing to aim guardrails on pre and post-hooks

* Add test that ensures that pre_call_hook receives litellm call id when common_request_processing called
2025-04-16 07:41:28 -07:00
Ishaan Jaff
ca593e003a bump litellm-proxy-extras==0.1.9
Some checks failed
Publish Prisma Migrations / publish-migrations (push) Failing after 36s
Read Version from pyproject.toml / read-version (push) Successful in 45s
Helm unit test / unit-test (push) Successful in 54s
2025-04-15 22:49:24 -07:00
Ishaan Jaff
1d4fea509d ui new build 2025-04-15 22:36:44 -07:00
Ishaan Jaff
ad09d250ef test fix azure deprecated mistral 2025-04-15 22:32:14 -07:00
Ishaan Jaff
dcc43e797a
[Docs] Auto prompt caching (#10044)
* docs prompt cache controls

* doc fix auto prompt caching
2025-04-15 22:29:47 -07:00
Krish Dholakia
fdfa1108a6
Add property ordering for vertex ai schema (#9828) + Fix combining multiple tool calls (#10040)
* fix #9783: Retain schema field ordering for google gemini and vertex (#9828)

* test: update test

* refactor(groq.py): initial commit migrating groq to base_llm_http_handler

* fix(streaming_chunk_builder_utils.py): fix how tool content is combined

Fixes https://github.com/BerriAI/litellm/issues/10034

* fix(vertex_ai/common_utils.py): prevent infinite loop in helper function

* fix(groq/chat/transformation.py): handle groq streaming errors correctly

* fix(groq/chat/transformation.py): handle max_retries

---------

Co-authored-by: Adrian Lyjak <adrian@chatmeter.com>
2025-04-15 22:29:25 -07:00