Commit graph

1179 commits

Author SHA1 Message Date
Krrish Dholakia
d77eee34f0 fix(openai.py): fix linting errors 2023-10-13 22:24:58 -07:00
Krrish Dholakia
3210ebfc7a fix(proxy_cli.py): fix adding keys flow - let user use --add_key to add new keys 2023-10-13 22:24:58 -07:00
ishaan-jaff
cacfac5726 (test) fix azure embedding test 2023-10-13 22:19:34 -07:00
ishaan-jaff
5e5c314bec (test) fix azure test 2023-10-13 22:18:53 -07:00
Krrish Dholakia
91c8e92e71 fix(openai.p): adding support for exception mapping for openai-compatible apis via http calls 2023-10-13 21:56:51 -07:00
ishaan-jaff
5a0284dd58 (fix) fix linting errors 2023-10-13 21:23:00 -07:00
ishaan-jaff
5d2881a2ce (tests) add 2023-10-13 21:16:41 -07:00
ishaan-jaff
b72dbe61c0 (feat) set api_base, api_key, api_version for embedding() 2023-10-13 21:09:44 -07:00
ishaan-jaff
b77492d574 (tests) add azure/embedding search 2023-10-13 21:09:08 -07:00
ishaan-jaff
d28586775a (feat) add swagger.json for litellm proxy 2023-10-13 20:41:04 -07:00
Krrish Dholakia
d9ddd7b338 fix(proxy_server): cleaning up print statements 2023-10-13 20:16:31 -07:00
Krrish Dholakia
3fc0375e34 fix(proxy_server): fix cors issue 2023-10-13 15:47:28 -07:00
Krrish Dholakia
b403bac500 refactor(utils.py): clean up print statement 2023-10-13 15:33:12 -07:00
Krrish Dholakia
4d4f8bfa5d feat(proxy_server): adding model fallbacks and default model to toml 2023-10-13 15:31:17 -07:00
Krrish Dholakia
2c0280cff3 fix(proxy_cli): add logs and config 2023-10-13 15:14:21 -07:00
ishaan-jaff
1502ba6a06 (test) add langchain ChatLiteLLM testing 2023-10-13 12:56:41 -07:00
Krrish Dholakia
f2eb1b4658 fix(proxy/): remove cloned repo 2023-10-12 21:46:18 -07:00
Krrish Dholakia
06f930a5fb refactor(proxy_server): clean up print statements 2023-10-12 21:39:16 -07:00
Krrish Dholakia
8dc009255b fix(init.py): fix linting errors 2023-10-12 21:31:53 -07:00
ishaan-jaff
feb91413ec (test) openrouter test use gpt-3.5 instead of gpt-4-32k 2023-10-12 21:29:35 -07:00
ishaan-jaff
91e2aebe8c (fix) ensure stop is always a list for anthropic 2023-10-12 21:25:18 -07:00
Krrish Dholakia
606543eac8 fix(gitmodules): remapping to new proxy 2023-10-12 21:23:53 -07:00
Krrish Dholakia
4f172101df docs(proxy): added readme 2023-10-12 21:09:40 -07:00
Krrish Dholakia
b28c055896 feat(proxy_server): adds create-proxy feature 2023-10-12 18:27:07 -07:00
ishaan-jaff
3da89a58ae (test) temp comment unstable NLP Cloud API test 2023-10-12 18:24:37 -07:00
ishaan-jaff
d6a9349685 (tests) fix test_completion_catch_nlp_exception to catch functions sent to nlp cloud 2023-10-12 18:11:02 -07:00
ishaan-jaff
dc879910e7 (test) load_dotenv in streaming tests 2023-10-12 16:35:33 -07:00
ishaan-jaff
e01d83cea6 (feat) bedrock add finish_reason to streaming responses 2023-10-12 16:22:34 -07:00
ishaan-jaff
0937d07d6d (test) catch bedrock RateLimitErrors 2023-10-12 16:04:32 -07:00
ishaan-jaff
66cbba3f55 (feat) add Rate Limit Error for bedrock 2023-10-12 15:57:34 -07:00
ishaan-jaff
93ceafc44b (test) try replicate test streaming with verbose mode 2023-10-12 15:48:20 -07:00
ishaan-jaff
8e756940dc (tests) remove old replicate stability ai tests 2023-10-12 15:45:09 -07:00
ishaan-jaff
640541f2ce (fix) add bedrock exception mapping for Auth 2023-10-12 15:38:09 -07:00
ishaan-jaff
cc2b19b893 (test) fix failing replicate test, catch AuthenticationError 2023-10-12 15:24:33 -07:00
ishaan-jaff
3839be8ed8 (tests) delete old testing files 2023-10-12 15:10:18 -07:00
ishaan-jaff
4b3e4c97b8 (feat) show costs.json in proxy_server.py 2023-10-12 15:07:37 -07:00
ishaan-jaff
e5ae870dd5 (feat) proxy_server new cost.json on litellm. Track daily cost & num_requests 2023-10-12 11:37:35 -07:00
ishaan-jaff
f8e3c11a38 (test) add logging to replicate test 2023-10-12 10:32:33 -07:00
ishaan-jaff
67168bf802 (test) openai api currently flaky - leading to failures 2023-10-11 22:32:53 -07:00
ishaan-jaff
60e9433476 (test) flaky cohere endpoint for streaming 2023-10-11 22:11:20 -07:00
ishaan-jaff
b9d249ba32 (test) fix streaming test - running into rate limits, set max_tokens 2023-10-11 21:32:00 -07:00
Krrish Dholakia
098a86f678 fix(proxy_cli): prints the location of the config file 2023-10-11 21:19:44 -07:00
Krrish Dholakia
4b0f8825f3 fix(proxy_server): fix prompt template for proxy server 2023-10-11 21:08:42 -07:00
ishaan-jaff
c3101967b6 (fix) proxy_server linting errors 2023-10-11 20:52:03 -07:00
ishaan-jaff
a1c9c80031 (test) add ollama testing 2023-10-11 17:00:39 -07:00
ishaan-jaff
fabad3dc42 (fix) Ollama use new streaming format 2023-10-11 17:00:39 -07:00
ishaan-jaff
7b3ee8d129 (feat) ollama raise Exceptions + use LiteLLM stream wrapper 2023-10-11 17:00:39 -07:00
ishaan-jaff
689acb8a08 (feat) add CustomStreamWrapper for Ollama - match OpenAI streaming 2023-10-11 17:00:39 -07:00
ishaan-jaff
897286ec15 (feat) add ollama exception mapping 2023-10-11 17:00:39 -07:00
Krrish Dholakia
e1ee2890b9 fix(utils): remove ui to view error message 2023-10-11 16:01:57 -07:00