litellm-mirror/litellm/proxy/pass_through_endpoints
Ishaan Jaff b2b3e40d13
(feat) use @google-cloud/vertexai js sdk with litellm (#6873)
* stash gemini JS test

* add vertex js sdj example

* handle vertex pass through separately

* tes vertex JS sdk

* fix vertex_proxy_route

* use PassThroughStreamingHandler

* fix PassThroughStreamingHandler

* use common _create_vertex_response_logging_payload_for_generate_content

* test vertex js

* add working vertex jest tests

* move basic bass through test

* use good name for test

* test vertex

* test_chunk_processor_yields_raw_bytes

* unit tests for streaming

* test_convert_raw_bytes_to_str_lines

* run unit tests 1st

* simplify local

* docs add usage example for js

* use get_litellm_virtual_key

* add unit tests for vertex pass through
2024-11-22 16:50:10 -08:00
..
llm_provider_handlers (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
llm_passthrough_endpoints.py (feat) Add usage tracking for streaming /anthropic passthrough routes (#6842) 2024-11-21 19:36:03 -08:00
pass_through_endpoints.py (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
streaming_handler.py (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
success_handler.py (feat) Add usage tracking for streaming /anthropic passthrough routes (#6842) 2024-11-21 19:36:03 -08:00
types.py (feat) add usage / cost tracking for Anthropic passthrough routes (#6835) 2024-11-20 17:25:12 -08:00