Commit graph

2455 commits

Author SHA1 Message Date
ishaan-jaff
9eb8524c09 (docs) add palm to ChatLiteLLM example 2023-10-13 12:59:06 -07:00
ishaan-jaff
1502ba6a06 (test) add langchain ChatLiteLLM testing 2023-10-13 12:56:41 -07:00
ishaan-jaff
5a39a3554d (docs) litellm ollama docker image 2023-10-13 08:45:20 -07:00
Krrish Dholakia
f2eb1b4658 fix(proxy/): remove cloned repo 2023-10-12 21:46:18 -07:00
Krrish Dholakia
8bb9be3c5a docs(proxy_server): fix code 2023-10-12 21:42:19 -07:00
Krrish Dholakia
06f930a5fb refactor(proxy_server): clean up print statements 2023-10-12 21:39:16 -07:00
ishaan-jaff
3f0bbacac7 bump: version 0.7.9 → 0.7.10 2023-10-12 21:32:59 -07:00
Krrish Dholakia
8dc009255b fix(init.py): fix linting errors 2023-10-12 21:31:53 -07:00
ishaan-jaff
feb91413ec (test) openrouter test use gpt-3.5 instead of gpt-4-32k 2023-10-12 21:29:35 -07:00
ishaan-jaff
91e2aebe8c (fix) ensure stop is always a list for anthropic 2023-10-12 21:25:18 -07:00
ishaan-jaff
f194268b80 (docs) add example using guidance with proxy 2023-10-12 21:25:18 -07:00
Krrish Dholakia
606543eac8 fix(gitmodules): remapping to new proxy 2023-10-12 21:23:53 -07:00
Krrish Dholakia
4f172101df docs(proxy): added readme 2023-10-12 21:09:40 -07:00
Krrish Dholakia
b28c055896 feat(proxy_server): adds create-proxy feature 2023-10-12 18:27:07 -07:00
ishaan-jaff
3da89a58ae (test) temp comment unstable NLP Cloud API test 2023-10-12 18:24:37 -07:00
ishaan-jaff
d6a9349685 (tests) fix test_completion_catch_nlp_exception to catch functions sent to nlp cloud 2023-10-12 18:11:02 -07:00
ishaan-jaff
dc879910e7 (test) load_dotenv in streaming tests 2023-10-12 16:35:33 -07:00
ishaan-jaff
e01d83cea6 (feat) bedrock add finish_reason to streaming responses 2023-10-12 16:22:34 -07:00
ishaan-jaff
0937d07d6d (test) catch bedrock RateLimitErrors 2023-10-12 16:04:32 -07:00
ishaan-jaff
66cbba3f55 (feat) add Rate Limit Error for bedrock 2023-10-12 15:57:34 -07:00
ishaan-jaff
93ceafc44b (test) try replicate test streaming with verbose mode 2023-10-12 15:48:20 -07:00
ishaan-jaff
8e756940dc (tests) remove old replicate stability ai tests 2023-10-12 15:45:09 -07:00
ishaan-jaff
640541f2ce (fix) add bedrock exception mapping for Auth 2023-10-12 15:38:09 -07:00
ishaan-jaff
cc2b19b893 (test) fix failing replicate test, catch AuthenticationError 2023-10-12 15:24:33 -07:00
ishaan-jaff
3839be8ed8 (tests) delete old testing files 2023-10-12 15:10:18 -07:00
ishaan-jaff
4b3e4c97b8 (feat) show costs.json in proxy_server.py 2023-10-12 15:07:37 -07:00
ishaan-jaff
78d60f000e (docs) show where the costs are written to 2023-10-12 11:49:25 -07:00
ishaan-jaff
2453628bb3 (docs) update cost display on docs 2023-10-12 11:43:23 -07:00
ishaan-jaff
88679a6d08 (docs) import embedding on litellm hosted cache 2023-10-12 11:38:12 -07:00
ishaan-jaff
e5ae870dd5 (feat) proxy_server new cost.json on litellm. Track daily cost & num_requests 2023-10-12 11:37:35 -07:00
ishaan-jaff
171b8fce0a (docs) add import embedding for caching example 2023-10-12 11:25:13 -07:00
ishaan-jaff
f8e3c11a38 (test) add logging to replicate test 2023-10-12 10:32:33 -07:00
ishaan-jaff
c8d38dce46 (fix) add appdirs as a dependency as a requirements 2023-10-12 09:41:31 -07:00
ishaan-jaff
7a1a65dcdb bump: version 0.7.8 → 0.7.9 2023-10-11 22:32:59 -07:00
ishaan-jaff
67168bf802 (test) openai api currently flaky - leading to failures 2023-10-11 22:32:53 -07:00
ishaan-jaff
f949f89071 bump: version 0.7.7 → 0.7.8 2023-10-11 22:11:31 -07:00
ishaan-jaff
60e9433476 (test) flaky cohere endpoint for streaming 2023-10-11 22:11:20 -07:00
ishaan-jaff
3e40ba39bf bump: version 0.7.6 → 0.7.7 2023-10-11 21:32:06 -07:00
ishaan-jaff
b9d249ba32 (test) fix streaming test - running into rate limits, set max_tokens 2023-10-11 21:32:00 -07:00
Krrish Dholakia
098a86f678 fix(proxy_cli): prints the location of the config file 2023-10-11 21:19:44 -07:00
Krrish Dholakia
4b0f8825f3 fix(proxy_server): fix prompt template for proxy server 2023-10-11 21:08:42 -07:00
ishaan-jaff
413097f0a7 bump: version 0.7.5 → 0.7.6 2023-10-11 21:07:13 -07:00
ishaan-jaff
c3101967b6 (fix) proxy_server linting errors 2023-10-11 20:52:03 -07:00
ishaan-jaff
a1c9c80031 (test) add ollama testing 2023-10-11 17:00:39 -07:00
ishaan-jaff
fabad3dc42 (fix) Ollama use new streaming format 2023-10-11 17:00:39 -07:00
ishaan-jaff
7b3ee8d129 (feat) ollama raise Exceptions + use LiteLLM stream wrapper 2023-10-11 17:00:39 -07:00
ishaan-jaff
689acb8a08 (feat) add CustomStreamWrapper for Ollama - match OpenAI streaming 2023-10-11 17:00:39 -07:00
ishaan-jaff
897286ec15 (feat) add ollama exception mapping 2023-10-11 17:00:39 -07:00
Krrish Dholakia
e1ee2890b9 fix(utils): remove ui to view error message 2023-10-11 16:01:57 -07:00
ishaan-jaff
f9f2dcc7ea (fix) set default cost.log 2023-10-11 15:35:53 -07:00