Commit graph

46 commits

Author SHA1 Message Date
ishaan-jaff
db002315e3 (feat) print debug info per deployment 2024-03-07 18:33:09 -08:00
ishaan-jaff
79f5e36540 (feat) add better debugging when DB read/write fails 2024-03-05 18:16:59 -08:00
ishaan-jaff
c40d31558d (test) large request 2024-02-12 21:49:47 -08:00
ishaan-jaff
3c06d2e34b (test) llama index VectorStoreIndex 2024-02-09 16:49:03 -08:00
ishaan-jaff
7a194de52b (test) Proxy llama index request 2024-02-09 16:09:03 -08:00
ishaan-jaff
1f229a46ad (fix) proxy - streaming sagemaker 2024-01-23 11:12:16 -08:00
ishaan-jaff
4353c9422f (docs) use proxy + Sagemaker stream test 2024-01-22 22:11:06 -08:00
ishaan-jaff
54c84e15e6 (chore) update load test 2024-01-19 08:52:17 -08:00
ishaan-jaff
9cf86a04a5 (docs) also test gpt-4 vision enhancements 2024-01-17 18:46:41 -08:00
ishaan-jaff
936df75a1a (test) proxy - add openai exception mapping error 2024-01-15 09:56:20 -08:00
ishaan-jaff
b4218439a5 (test) proxy - add JS OpenAI test 2024-01-15 09:53:57 -08:00
ishaan-jaff
f569b84ed2 (test) proxy - load test 2024-01-03 16:16:18 +05:30
ishaan-jaff
4f1df08f54 (test) sustained load test proxy 2024-01-02 12:10:34 +05:30
ishaan-jaff
99156edf82 (test) proxy - log metadata to langfuse 2024-01-01 11:54:16 +05:30
ishaan-jaff
bf0329e313 (test) proxy - pass metadata to openai client 2024-01-01 11:12:57 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
ishaan-jaff
7a1e10c371 (test) proxy - test exception mapping 2023-12-15 08:28:12 +05:30
Krrish Dholakia
c2acdfce09 test: remove local test 2023-12-05 12:45:52 -08:00
ishaan-jaff
7ba22141ed (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
67272e1d8e (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
Krrish Dholakia
6015bff80b fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
ishaan-jaff
c9e21d97cd (feat) proxy: use orjson 2023-11-30 19:50:47 -08:00
ishaan-jaff
ae6e852219 (test) load test embedding 2023-11-30 19:04:51 -08:00
ishaan-jaff
b6ffcd00b9 (test) proxy + router: add bursty load test 2023-11-30 13:17:11 -08:00
ishaan-jaff
700fee3eba (test) 1k requests 2023-11-29 16:22:18 -08:00
ishaan-jaff
bcc58e16be (test) load test completion 2023-11-28 15:44:56 -08:00
ishaan-jaff
547edd24e6 (test) load test 2023-11-27 18:08:47 -08:00
ishaan-jaff
aef3d2699f (test) load test router 2023-11-27 16:37:57 -08:00
ishaan-jaff
367468d655 (test) load test proxy completion 2023-11-27 12:13:21 -08:00
ishaan-jaff
c0dfc8d9b3 (test) load test embedding: proxy 2023-11-24 17:14:44 -08:00
ishaan-jaff
32b7c236e6 (docs) proxy performance 2023-11-24 17:07:46 -08:00
Krrish Dholakia
9618718080 test: refactor testing order 2023-11-24 12:47:28 -08:00
Krrish Dholakia
f630901a77 test(test_router_cooldowns.py): adding logging 2023-11-24 12:30:08 -08:00
Krrish Dholakia
2df4791ae9 fix: fix linting errors 2023-11-22 19:59:25 -08:00
ishaan-jaff
52e2ac0106 (test) proxy test exception mapping 2023-11-22 16:22:05 -08:00
Krrish Dholakia
2a681e578c fix(proxy_server): fix linting issues 2023-11-22 08:47:59 -08:00
ishaan-jaff
12c2d1411a (test) load test with api.litellm.ai 2023-11-21 21:07:27 -08:00
ishaan-jaff
bd5c89aab9 (test) load test proxy 2023-11-21 21:04:46 -08:00
ishaan-jaff
67b7aba40f (test) load test q 2023-11-21 20:48:56 -08:00
ishaan-jaff
5bf5bdf73a (test) test q 2023-11-21 19:45:46 -08:00
ishaan-jaff
466e5c2a86 (test) test q 2023-11-21 18:15:00 -08:00
ishaan-jaff
e8b2c64255 (test) refactor test 2023-11-21 18:02:49 -08:00
ishaan-jaff
7ec9dbc94e (test) add test for testing queuing 2023-11-21 16:59:33 -08:00
ishaan-jaff
0f80ae46a0 (test) move test file dir 2023-11-21 16:59:33 -08:00
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
ishaan-jaff
cc3ff1c3ae (test) add proxy cli tests 2023-11-09 10:23:14 -08:00