mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-03 18:00:36 +00:00
# What does this PR do? update the async detection test for vllm - remove a network access from unit tests - remove direct logging use the idea behind the test is to mock inference w/ a sleep, initiate concurrent inference calls, verify the total execution time is close to the sleep time. in a non-async env the total time would be closer to sleep * num concurrent calls. ## Test Plan ci |
||
|---|---|---|
| .. | ||
| bedrock | ||
| test_inference_client_caching.py | ||
| test_litellm_openai_mixin.py | ||
| test_openai_base_url_config.py | ||
| test_remote_vllm.py | ||