134 commits

Author	SHA1	Message	Date
Krrish Dholakia	cfab098a9c	fix: fix run_ollama_serve to only run if api base is none	2023-12-09 21:31:46 -08:00
Krrish Dholakia	2048ef445d	fix(proxy_server.py): fix pydantic version errors	2023-12-09 12:09:49 -08:00
ishaan-jaff	aded35d3c8	(feat) proxy cli, better description of config yaml param	2023-12-05 18:11:29 -08:00
ishaan-jaff	9693e5ede6	(fix) prox cli: remove deprecated param	2023-12-05 18:04:08 -08:00
ishaan-jaff	3fbd2a853f	(feat) --health for checking config models	2023-11-27 12:13:21 -08:00
Krrish Dholakia	0e3064ac8c	fix(router.py): fix caching for tracking cooldowns + usage	2023-11-23 11:13:32 -08:00
Krrish Dholakia	550ddb4a6b	docs(routing.md): update routing docs	2023-11-21 19:32:50 -08:00
Krrish Dholakia	9205f70b0f	docs(routing.md): add queueing to docs	2023-11-21 18:01:02 -08:00
ishaan-jaff	05f9ff6351	(fix) proxy server LiteLLM warning	2023-11-21 08:50:31 -08:00
Krrish Dholakia	7472be1529	fix(routing.py): update token usage on streaming	2023-11-20 14:19:25 -08:00
Krrish Dholakia	5d58bb9cd0	fix(main.py): misrouting ollama models to nlp cloud	2023-11-14 18:55:08 -08:00
ishaan-jaff	aec5ad0f66	(fix) proxy cli compatible with openai v1.0.0	2023-11-13 10:58:20 -08:00
ishaan-jaff	cdd40ae45f	(fix) proxy cli use openai v1.0.0	2023-11-13 10:08:48 -08:00
ishaan-jaff	523fa7c81c	(fix) proxy + docs: use openai.chat.completions.create instead of openai.ChatCompletions	2023-11-13 08:24:26 -08:00
ishaan-jaff	7eeb931021	(fix) proxy raise exception when config passed in	2023-11-10 16:28:34 -08:00
ishaan-jaff	0e8a034360	(fix) proxy cli default local debug to False	2023-11-09 11:30:11 -08:00
ishaan-jaff	1f7d397836	(fix) proxy server clean print statements	2023-11-09 11:18:56 -08:00
ishaan-jaff	17c6eebb10	(fix) prxy server remove create_proxy	2023-11-09 11:12:20 -08:00
ishaan-jaff	44a65bdd59	(fix) proxy remove --create_proxy	2023-11-09 11:10:08 -08:00
ishaan-jaff	f46bd51571	(fix) clean up proxy cli	2023-11-08 13:48:02 -08:00
ishaan-jaff	a94532fedf	(fix) proxy cli --test	2023-11-08 12:00:13 -08:00
ishaan-jaff	5250366a4b	(test) run a test again	2023-11-08 10:34:57 -08:00
ishaan-jaff	769f3d1300	(test) run ci/cd again	2023-11-08 10:21:19 -08:00
ishaan-jaff	857e5fe6b8	(fix) proxy server remove bloat	2023-11-06 15:55:18 -08:00
Krrish Dholakia	c4ed875f47	fix(proxy_server.py): fixing import issues	2023-11-05 21:14:59 -08:00
Krrish Dholakia	597dc8f34c	bump: version 0.13.1 → 0.13.2.dev1	2023-11-05 21:12:13 -08:00
Krrish Dholakia	078c369e35	bump: version 0.13.1.dev2 → 0.13.1.dev3	2023-11-04 22:31:53 -07:00
Krrish Dholakia	2e9d00994e	bump: version 0.13.1.dev1 → 0.13.1.dev2	2023-11-04 22:31:53 -07:00
Krrish Dholakia	3aa538f369	fix(proxy_cli.py): uvicorn issue	2023-11-04 22:31:53 -07:00
Krrish Dholakia	f7c5595a0d	fix(main.py): fixing print_verbose	2023-11-04 14:41:34 -07:00
Krrish Dholakia	302b5ced99	fix(proxy_server.py): accept config.yaml	2023-11-03 12:50:52 -07:00
ishaan-jaff	c0a4881194	(fix) proxy cli tests	2023-11-02 21:14:08 -07:00
ishaan-jaff	414f503022	(feat) proxy add testing for openai.Completion.create	2023-11-01 18:25:13 -07:00
ishaan-jaff	63f9f63ba4	(add request_timeout) as param to proxy_server	2023-10-20 11:55:42 -07:00
coconut49	4fc7755662	Improve code formatting and allow configurable litellm config path via environment variable.	2023-10-20 12:19:26 +08:00
Krrish Dholakia	eb05b093ad	fix(utils.py): mapping azure api version missing exception	2023-10-17 17:12:51 -07:00
Krrish Dholakia	2e62021405	test(test_proxy.py): adding testing for proxy server	2023-10-17 16:29:11 -07:00
Krrish Dholakia	5e21178eed	refactor(proxy_cli.py): code cleanup	2023-10-17 13:29:47 -07:00
coconut49	701efc645f	Refactor Dockerfile and proxy_cli.py to use new secrets file location	2023-10-18 01:17:03 +08:00
Krrish Dholakia	5f9dd0b21f	bump: version 0.8.4 → 0.8.5	2023-10-14 16:43:06 -07:00
ishaan-jaff	cd0557c053	(feat) add swagger docs to cli config	2023-10-14 12:32:33 -07:00
ishaan-jaff	9f999629cd	(feat) proxy_cli cleanup	2023-10-14 12:19:56 -07:00
Krrish Dholakia	5269d0bd5f	docs(custom_callback.md): add details on what kwargs are passed to custom callbacks	2023-10-14 11:29:26 -07:00
Krrish Dholakia	29877b35b0	fix(proxy_cli.py): fix adding keys flow - let user use --add_key to add new keys	2023-10-13 22:24:58 -07:00
Krrish Dholakia	a27e9aaf8d	fix(proxy_server): cleaning up print statements	2023-10-13 20:16:31 -07:00
Krrish Dholakia	90c8b3a193	fix(proxy_cli): add logs and config	2023-10-13 15:14:21 -07:00
Krrish Dholakia	7ec5351305	docs(proxy): added readme	2023-10-12 21:09:40 -07:00
Krrish Dholakia	d0b4dfd26c	feat(proxy_server): adds create-proxy feature	2023-10-12 18:27:07 -07:00
Krrish Dholakia	e150dc2e8e	fix(proxy_cli): prints the location of the config file	2023-10-11 21:19:44 -07:00
ishaan-jaff	960ae5db58	(feat) proxy_server use fallback port if 8000 occupied	2023-10-11 15:35:14 -07:00