6 commits

Author	SHA1	Message	Date
Ishaan Jaff	f3b13a9af3	(feat) Add Bedrock knowledge base pass through endpoints (#7267) ... * bugfix: Proxy Routing for Bedrock Knowledgebase URLs are incorrect (#7097) * Fixing routing bug where bedrock knowledgebase urls were being generated incorrectly * Preparing for PR * Preparing for PR * Preparing for PR --------- Co-authored-by: Luke Birk <lb0737@att.com> * fix _is_bedrock_agent_runtime_route * docs - Query Knowledge Base * test_is_bedrock_agent_runtime_route * fix bedrock_proxy_route --------- Co-authored-by: LBirk <2731718+LBirk@users.noreply.github.com> Co-authored-by: Luke Birk <lb0737@att.com>	2024-12-16 22:19:34 -08:00
Ishaan Jaff	8fd3bf34d8	(feat) pass through llm endpoints - add PATCH support (vertex context caching requires for update ops) (#6924) ... * add PATCH for pass through endpoints * test_pass_through_routes_support_all_methods	2024-11-26 14:39:13 -08:00
Krish Dholakia	8673f2541e	fix(key_management_endpoints.py): fix user-membership check when creating team key (#6890) ... * fix(key_management_endpoints.py): fix user-membership check when creating team key * docs: add deprecation notice on original `/v1/messages` endpoint + add better swagger tags on pass-through endpoints * fix(gemini/): fix image_url handling for gemini Fixes https://github.com/BerriAI/litellm/issues/6897 * fix(teams.tsx): fix member add when role is 'user' * fix(team_endpoints.py): /team/member_add fix adding several new members to team * test(test_vertex.py): remove redundant test * test(test_proxy_server.py): fix team member add tests	2024-11-26 14:19:24 +05:30
Ishaan Jaff	c60261c3bc	(feat) Add support for using @google/generative-ai JS with LiteLLM Proxy (#6899) ... * feat - allow using gemini js SDK with LiteLLM * add auth for gemini_proxy_route * basic local test for js * test cost tagging gemini js requests * add js sdk test for gemini with litellm * add docs on gemini JS SDK * run node.js tests * fix google ai studio tests * fix vertex js spend test	2024-11-25 13:13:03 -08:00
Ishaan Jaff	b8af46e1a2	(feat) Add usage tracking for streaming /anthropic passthrough routes (#6842) ... * use 1 file for AnthropicPassthroughLoggingHandler * add support for anthropic streaming usage tracking * ci/cd run again * fix - add real streaming for anthropic pass through * remove unused function stream_response * working anthropic streaming logging * fix code quality * fix use 1 file for vertex success handler * use helper for _handle_logging_vertex_collected_chunks * enforce vertex streaming to use sse for streaming * test test_basic_vertex_ai_pass_through_streaming_with_spendlog * fix type hints * add comment * fix linting * add pass through logging unit testing	2024-11-21 19:36:03 -08:00
Ishaan Jaff	a7d5536872	(fix) passthrough - allow internal users to access /anthropic (#6843) ... * fix /anthropic/ * test llm_passthrough_router * fix test_gemini_pass_through_endpoint	2024-11-21 11:46:50 -08:00

Renamed from litellm/proxy/vertex_ai_endpoints/google_ai_studio_endpoints.py (Browse further)