phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
19310 commits 2484 branches 894 tags 536 MiB
Commit graph

9 commits

Author SHA1 Message Date
Ishaan Jaff
adeb09e091 (Feat) - New pass through add assembly ai passthrough endpoints (#8220) 
* add assembly ai pass through request

* fix assembly pass through

* fix test_assemblyai_basic_transcribe

* fix assemblyai auth check

* test_assemblyai_transcribe_with_non_admin_key

* working assembly ai test

* working assembly ai proxy route

* use helper func to pass through logging

* clean up logging assembly ai

* test: update test to handle gemini token counter change

* fix(factory.py): fix bedrock http:// handling

* add unit testing for assembly pt handler

* docs assembly ai pass through endpoint

* fix proxy_pass_through_endpoint_tests

* fix standard_passthrough_logging_object

* fix ASSEMBLYAI_API_KEY

* test test_assemblyai_proxy_route_basic_post

* test_assemblyai_proxy_route_get_transcript

* fix is is_assemblyai_route

* test_is_assemblyai_route

---------

Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
 2025-02-03 21:54:32 -08:00
Ishaan Jaff
ced059e371 Add /openai pass through route on litellm proxy (#7412) 
* add pt oai route - proxy

* pass through use safe read request body
 2024-12-25 20:15:59 -08:00
Ishaan Jaff
62a1cdec47 (code quality) run ruff rule to ban unused imports (#7313) 
* remove unused imports

* fix AmazonConverseConfig

* fix test

* fix import

* ruff check fixes

* test fixes

* fix testing

* fix imports
 2024-12-19 12:33:42 -08:00
Ishaan Jaff
427f2173d2 (feat) Add Bedrock knowledge base pass through endpoints (#7267) 
* bugfix: Proxy Routing for Bedrock Knowledgebase URLs are incorrect (#7097)

* Fixing routing bug where bedrock knowledgebase urls were being generated incorrectly

* Preparing for PR

* Preparing for PR

* Preparing for PR

---------

Co-authored-by: Luke Birk <lb0737@att.com>

* fix _is_bedrock_agent_runtime_route

* docs - Query Knowledge Base

* test_is_bedrock_agent_runtime_route

* fix bedrock_proxy_route

---------

Co-authored-by: LBirk <2731718+LBirk@users.noreply.github.com>
Co-authored-by: Luke Birk <lb0737@att.com>
 2024-12-16 22:19:34 -08:00
Ishaan Jaff
41aa604e6b (feat) pass through llm endpoints - add PATCH support (vertex context caching requires for update ops) (#6924) 
* add PATCH for pass through endpoints

* test_pass_through_routes_support_all_methods
 2024-11-26 14:39:13 -08:00
Krish Dholakia
4019ca38b4 fix(key_management_endpoints.py): fix user-membership check when creating team key (#6890) 
* fix(key_management_endpoints.py): fix user-membership check when creating team key

* docs: add deprecation notice on original `/v1/messages` endpoint + add better swagger tags on pass-through endpoints

* fix(gemini/): fix image_url handling for gemini

Fixes https://github.com/BerriAI/litellm/issues/6897

* fix(teams.tsx): fix member add when role is 'user'

* fix(team_endpoints.py): /team/member_add

fix adding several new members to team

* test(test_vertex.py): remove redundant test

* test(test_proxy_server.py): fix team member add tests
 2024-11-26 14:19:24 +05:30
Ishaan Jaff
2bb2f7b1e1 (feat) Add support for using @google/generative-ai JS with LiteLLM Proxy (#6899) 
* feat - allow using gemini js SDK with LiteLLM

* add auth for gemini_proxy_route

* basic local test for js

* test cost tagging gemini js requests

* add js sdk test for gemini with litellm

* add docs on gemini JS SDK

* run node.js tests

* fix google ai studio tests

* fix vertex js spend test
 2024-11-25 13:13:03 -08:00
Ishaan Jaff
5fd5bb615c (feat) Add usage tracking for streaming /anthropic passthrough routes (#6842) 
* use 1 file for AnthropicPassthroughLoggingHandler

* add support for anthropic streaming usage tracking

* ci/cd run again

* fix - add real streaming for anthropic pass through

* remove unused function stream_response

* working anthropic streaming logging

* fix code quality

* fix use 1 file for vertex success handler

* use helper for _handle_logging_vertex_collected_chunks

* enforce vertex streaming to use sse for streaming

* test test_basic_vertex_ai_pass_through_streaming_with_spendlog

* fix type hints

* add comment

* fix linting

* add pass through logging unit testing
 2024-11-21 19:36:03 -08:00
Ishaan Jaff
9ef254ff35 (fix) passthrough - allow internal users to access /anthropic (#6843) 
* fix /anthropic/

* test llm_passthrough_router

* fix test_gemini_pass_through_endpoint
 2024-11-21 11:46:50 -08:00
Renamed from litellm/proxy/vertex_ai_endpoints/google_ai_studio_endpoints.py (Browse further)