litellm/tests/load_tests
Ishaan Jaff 835db6ae98
(load testing) add vertex_ai embeddings load test (#6004)
* use vertex llm as base class for embeddings

* use correct vertex class in main.py

* set_headers in vertex llm base

* add types for vertex embedding requests

* add embedding handler for vertex

* use async mode for vertex embedding tests

* use vertexAI textEmbeddingConfig

* fix linting

* add sync and async mode testing for vertex ai embeddings

* add basic load test

* add vertex ai load test on ci cd
2024-10-03 14:39:15 +05:30
..
test_datadog_load_test.py [Feat - Perf Improvement] DataDog Logger 91% lower latency (#5687) 2024-09-13 17:39:17 -07:00
test_langsmith_load_test.py fix langsmith load tests 2024-09-11 21:19:03 -07:00
test_otel_load_test.py fic otel load test % 2024-09-14 18:04:28 -07:00
test_vertex_embeddings_load_test.py (load testing) add vertex_ai embeddings load test (#6004) 2024-10-03 14:39:15 +05:30
test_vertex_load_tests.py [Fix] Router cooldown logic - use % thresholds instead of allowed fails to cooldown deployments (#5698) 2024-09-14 18:01:19 -07:00
vertex_key.json [Fix] Performance - use in memory cache when downloading images from a url (#5657) 2024-09-13 07:23:42 -07:00