Commit graph

1543 commits

Author SHA1 Message Date
Krrish Dholakia
094144de58 fix(router.py): removing model id before making call 2023-11-28 10:09:45 -08:00
Krrish Dholakia
150b91d476 fix(utils.py): fix streaming on-success logging 2023-11-28 09:11:47 -08:00
Krrish Dholakia
c4aea7432f build: adding debug logs to gitignore 2023-11-27 22:05:07 -08:00
ishaan-jaff
c52861906b (test) router cooldowns 2023-11-27 22:03:02 -08:00
Krrish Dholakia
e8331a4647 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia
4cdd930fa2 fix(stream_chunk_builder): adding support for tool calling in completion counting 2023-11-27 18:39:47 -08:00
Krrish Dholakia
04f745e314 fix(router.py): speed improvements to the router 2023-11-27 17:35:26 -08:00
ishaan-jaff
18d9222945 (test) litellm using uuid for model name 2023-11-27 16:37:39 -08:00
ishaan-jaff
37f3b1edd1 (ci/cd) run again 2023-11-27 11:12:11 -08:00
ishaan-jaff
a4754f9098 (test) competion 2023-11-27 10:13:46 -08:00
ishaan-jaff
26938f697e (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
ishaan-jaff
90687d51f1 (test) sagemaker add chat models 2023-11-27 10:11:56 -08:00
Krrish Dholakia
fa713abfc3 fix(router.py): check for fallbacks in completion params for router 2023-11-25 18:46:45 -08:00
ishaan-jaff
2c4f52b6b1 (fix) linting 2023-11-25 15:46:07 -08:00
ishaan-jaff
0b56d584aa (test) openai exception mapping for openai.AuthenticationError 2023-11-25 15:43:46 -08:00
ishaan-jaff
afaca3f819 (fix) acompletion: Raise same error as completion 2023-11-25 15:33:46 -08:00
Krrish Dholakia
ab0bc87427 fix(router.py): check if fallbacks is none 2023-11-25 14:58:07 -08:00
Krrish Dholakia
95579fda7d fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
Krrish Dholakia
2eb7386095 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
Krrish Dholakia
6d9f7b8f9d fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
Krrish Dholakia
30f47d3169 bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
ishaan-jaff
fed620b202 (test) metadata test in embedding 2023-11-25 11:10:06 -08:00
ishaan-jaff
565d51a4b4 (test) metadata test in litellm.completion 2023-11-25 11:10:06 -08:00
ishaan-jaff
fbcdbf3a82 (fix) test embedding 2023-11-24 20:46:35 -08:00
ishaan-jaff
d9e1267b24 (fix) embedding test 2023-11-24 18:28:38 -08:00
ishaan-jaff
785c024324 (test) fix embedding 2023-11-24 18:14:06 -08:00
ishaan-jaff
ad1672b901 (test) fix embedding tests 2023-11-24 17:04:59 -08:00
Krrish Dholakia
e732fb8b97 fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
ishaan-jaff
41c6388185 (test) completion with many params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
2686894823 fix(router.py): fix retry logic 2023-11-24 13:27:44 -08:00
Krrish Dholakia
16e1070dbe test: refactor testing order 2023-11-24 12:47:28 -08:00
Krrish Dholakia
2a033fd8a2 test(test_router_cooldowns.py): adding logging 2023-11-24 12:30:08 -08:00
Krrish Dholakia
3dcbf6197a test(test_router.py): reintegrate router testing 2023-11-24 11:48:24 -08:00
Krrish Dholakia
c75e90663c test(test_stream_chunk_builder.py): fix setting api key 2023-11-24 11:47:48 -08:00
Krrish Dholakia
2e8d582a34 fix(proxy_server.py): fix linting issues 2023-11-24 11:39:01 -08:00
Krrish Dholakia
4a5dae3941 fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
ishaan-jaff
19fb24cd15 (feat) cost tracking for azure llms 2023-11-23 21:41:38 -08:00
Krrish Dholakia
9a44433844 feat(proxy_server.py): /key/delete endpoint 2023-11-23 21:37:53 -08:00
ishaan-jaff
0c210cc96c (test) caching 2023-11-23 21:23:41 -08:00
ishaan-jaff
c929c274f6 (test) proxy: test_embedding 2023-11-23 21:16:51 -08:00
ishaan-jaff
ba9dbbe6d5 (test) router: acompletion + caching 2023-11-23 21:05:48 -08:00
ishaan-jaff
39072bd196 (test) proxy - azure/chat/completion test 2023-11-23 20:56:41 -08:00
Krrish Dholakia
187403c5cc fix(router.py): add modelgroup to call metadata 2023-11-23 20:55:49 -08:00
ishaan-jaff
db8ed601b5 (test) temp comment router to test ci/cd 2023-11-23 20:28:43 -08:00
ishaan-jaff
8a72487dcf (test) proxy_server /chat/completions 2023-11-23 20:28:06 -08:00
Krrish Dholakia
7d221fe863 fix(utils.py): make failure logging sync 2023-11-23 20:19:27 -08:00
ishaan-jaff
4816232674 (test) cost tracker 2023-11-23 18:28:37 -08:00
ishaan-jaff
b6f8dbbc0e (test) caching 2023-11-23 18:17:12 -08:00
Krrish Dholakia
94dc3f66f3 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
Krrish Dholakia
f24786095a fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00