3479 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	b2c35bbd50	(test) load test proxy	2023-11-21 12:38:46 -08:00
Krrish Dholakia	331fe86c8f	refactor(proxy_server.py): experimental endpoint - defined job status	2023-11-21 12:37:00 -08:00
ishaan-jaff	4e06b4a26f	(test) add load test queuing	2023-11-21 12:14:20 -08:00
ishaan-jaff	78f90cd0d0	(test) load test litelm proxy	2023-11-21 12:14:20 -08:00
Krrish Dholakia	d0f228e53f	refactor(proxy_server.py): refactoring experimental endpoint names	2023-11-21 12:12:15 -08:00
Krrish Dholakia	c6a4744947	feat(proxy_server.py): EXPERIMENTAL: adding queuing endpoints to openai proxy server	2023-11-21 12:06:23 -08:00
ishaan-jaff	5dabcc21c9	(docs) update migration	2023-11-21 11:22:54 -08:00
ishaan-jaff	3aebc46ebf	(docs) update streaming	2023-11-21 11:20:53 -08:00
ishaan-jaff	f29a353796	(docs) update how to use litellm streaming	2023-11-21 11:19:32 -08:00
Krrish Dholakia	37187e8e88	test(test_completion.py): fix replicate streaming test	2023-11-21 10:38:05 -08:00
Krrish Dholakia	1218121e47	fix(huggingface_restapi.pyu): fix linting errors	2023-11-21 10:05:35 -08:00
Krrish Dholakia	c23d42305d	test(test_rules.py): refactor testing	2023-11-21 10:01:06 -08:00
ishaan-jaff	bb44fc8f9d	(docs) anthropic	2023-11-21 09:58:02 -08:00
Krrish Dholakia	ccdb2f051f	bump: version 1.3.3.dev3 → 1.3.3	2023-11-21 09:57:26 -08:00
Krrish Dholakia	41483d2660	feat(factory.py): add support for anthropic system prompts for claude 2.1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	f6bdbaee5d	bump: version 1.3.3.dev2 → 1.3.3.dev3	2023-11-21 09:57:26 -08:00
Krrish Dholakia	846a32ca87	fix(huggingface_restapi.py): fixing formatting	2023-11-21 09:57:26 -08:00
Krrish Dholakia	d1c0343fe1	bump: version 1.3.3.dev1 → 1.3.3.dev2	2023-11-21 09:57:26 -08:00
Krrish Dholakia	6892fd8b51	fix(huggingface_restapi.py): fix huggingface response format	2023-11-21 09:57:26 -08:00
Krrish Dholakia	a534928337	bump: version 1.3.2 → 1.3.3.dev1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	a89b8f55e3	fix(huggingface_restapi.py): handle generate text output	2023-11-21 09:57:26 -08:00
ishaan-jaff	f4dcff2864	(docs) add claude2.1	2023-11-21 09:54:32 -08:00
ishaan-jaff	219470ed68	(test) add claude-2.1	2023-11-21 09:53:47 -08:00
ishaan-jaff	07bca4dcb1	(feat) add claude2.1	2023-11-21 09:44:19 -08:00
ishaan-jaff	2a35ff88a7	(fix) proxy server LiteLLM warning	2023-11-21 08:50:31 -08:00
ishaan-jaff	8969c5f769	(docs) proxy starting config.yaml	2023-11-21 08:36:34 -08:00
ishaan-jaff	6898840218	(fix) proxy server - raise 500 on exceptions	2023-11-21 08:36:34 -08:00
Krrish Dholakia	6ddefc778a	bump: version 1.3.1 → 1.3.2	2023-11-21 08:36:18 -08:00
Krrish Dholakia	846a824c47	fix(proxy_server.py): run ollama serve when ollama in config.yaml	2023-11-21 08:35:04 -08:00
ishaan-jaff	c4f9ef86c9	(fix) fix anyscale context window	2023-11-21 08:22:21 -08:00
Krrish Dholakia	8534bf96d5	test(test_rules.py): clear rules after test completes	2023-11-21 08:18:04 -08:00
Krrish Dholakia	2a681c1874	fix(utils.py): fix pre call rules	2023-11-21 07:10:04 -08:00
Krrish Dholakia	b991a35ebe	fix(main.py): revert model alias map change	2023-11-20 21:07:52 -08:00
Krrish Dholakia	ab2986290e	fix(utils.py): fix rules calling	2023-11-20 21:06:36 -08:00
Krrish Dholakia	b2e52eedf8	fix(main.py): fix model alias map logic	2023-11-20 20:49:10 -08:00
ishaan-jaff	b752ba8a46	(docs) router	2023-11-20 19:29:58 -08:00
Krrish Dholakia	1306addfe8	fix(openai.py-+-azure.py): fix linting issues	2023-11-20 19:29:23 -08:00
Krrish Dholakia	311b4f9d2c	docs(rules.md): adding rules to docs	2023-11-20 19:14:07 -08:00
ishaan-jaff	d4caa918d5	(test) wandb logger	2023-11-20 19:08:53 -08:00
ishaan-jaff	80884e9cb3	(fix) using callbacks with router	2023-11-20 19:08:53 -08:00
Krrish Dholakia	668d45393c	bump: version 1.3.0 → 1.3.1	2023-11-20 18:58:22 -08:00
Krrish Dholakia	cb5c02888b	bump: version 1.2.0 → 1.3.0	2023-11-20 18:58:15 -08:00
Krrish Dholakia	855964ed45	fix(utils.py): adding support for rules + mythomax/alpaca prompt template	2023-11-20 18:58:15 -08:00
ishaan-jaff	4f46ac4ab5	(fix) linting error	2023-11-20 18:32:43 -08:00
ishaan-jaff	50f883a2fb	(fix) pydantic errors with response.time	2023-11-20 18:28:19 -08:00
ishaan-jaff	3f30f93516	(fix) pydantic errors openai usage	2023-11-20 18:28:19 -08:00
Ishaan Jaff	604b2f8ef2	Update README.md	2023-11-20 18:04:55 -08:00
ishaan-jaff	980a3502de	(fix) completion - always map finish_reason	2023-11-20 17:24:16 -08:00
Krrish Dholakia	53743f2124	docs(simple_proxy.md): add model alias tutorial to docs	2023-11-20 17:05:17 -08:00
ishaan-jaff	99515c2e25	(fix) linting	2023-11-20 17:00:20 -08:00