3493 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	8093a4fc6f	(test) load test queing	2023-11-21 14:05:04 -08:00
ishaan-jaff	34886a99cc	(docs) fix exception mapping	2023-11-21 14:05:04 -08:00
Krish Dholakia	e4f1e2b138	Merge pull request #845 from canada4663/upstream-main ... Added support for multiple embeddings via Bedrock	2023-11-21 14:00:06 -08:00
Krrish Dholakia	70f3159a2a	refactor(rq_worker.py): put rq worker behind function call (prevent default import)	2023-11-21 13:51:42 -08:00
Krrish Dholakia	a1f6b9b531	refactor(proxy_server.py): refactoring background rq worker	2023-11-21 13:47:09 -08:00
ishaan-jaff	7c79d10e9f	(test) catch streaming + timeout exceptions	2023-11-21 13:46:21 -08:00
ishaan-jaff	a2e2889d88	(docs) catch streaming exceptions	2023-11-21 13:45:54 -08:00
ishaan-jaff	f18a64f6a4	(docs) catching timeout exceptions	2023-11-21 13:39:59 -08:00
ishaan-jaff	9d6569791f	(test) timeout error	2023-11-21 13:37:12 -08:00
ishaan-jaff	589cdce8d3	(fix) request_timeout mapped to timeout for openai	2023-11-21 13:22:21 -08:00
ishaan-jaff	20b129b7ad	(docs) update timeout variable name	2023-11-21 13:14:55 -08:00
ishaan-jaff	b98d9199f6	(test) load test queing	2023-11-21 12:51:58 -08:00
Krrish Dholakia	015c7de549	fix(proxy_server.py): defaulting status to queued	2023-11-21 12:40:30 -08:00
ishaan-jaff	b2c35bbd50	(test) load test proxy	2023-11-21 12:38:46 -08:00
Krrish Dholakia	331fe86c8f	refactor(proxy_server.py): experimental endpoint - defined job status	2023-11-21 12:37:00 -08:00
ishaan-jaff	4e06b4a26f	(test) add load test queuing	2023-11-21 12:14:20 -08:00
ishaan-jaff	78f90cd0d0	(test) load test litelm proxy	2023-11-21 12:14:20 -08:00
Krrish Dholakia	d0f228e53f	refactor(proxy_server.py): refactoring experimental endpoint names	2023-11-21 12:12:15 -08:00
Krrish Dholakia	c6a4744947	feat(proxy_server.py): EXPERIMENTAL: adding queuing endpoints to openai proxy server	2023-11-21 12:06:23 -08:00
ishaan-jaff	5dabcc21c9	(docs) update migration	2023-11-21 11:22:54 -08:00
ishaan-jaff	3aebc46ebf	(docs) update streaming	2023-11-21 11:20:53 -08:00
ishaan-jaff	f29a353796	(docs) update how to use litellm streaming	2023-11-21 11:19:32 -08:00
Krrish Dholakia	37187e8e88	test(test_completion.py): fix replicate streaming test	2023-11-21 10:38:05 -08:00
Krrish Dholakia	1218121e47	fix(huggingface_restapi.pyu): fix linting errors	2023-11-21 10:05:35 -08:00
Krrish Dholakia	c23d42305d	test(test_rules.py): refactor testing	2023-11-21 10:01:06 -08:00
ishaan-jaff	bb44fc8f9d	(docs) anthropic	2023-11-21 09:58:02 -08:00
Krrish Dholakia	ccdb2f051f	bump: version 1.3.3.dev3 → 1.3.3	2023-11-21 09:57:26 -08:00
Krrish Dholakia	41483d2660	feat(factory.py): add support for anthropic system prompts for claude 2.1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	f6bdbaee5d	bump: version 1.3.3.dev2 → 1.3.3.dev3	2023-11-21 09:57:26 -08:00
Krrish Dholakia	846a32ca87	fix(huggingface_restapi.py): fixing formatting	2023-11-21 09:57:26 -08:00
Krrish Dholakia	d1c0343fe1	bump: version 1.3.3.dev1 → 1.3.3.dev2	2023-11-21 09:57:26 -08:00
Krrish Dholakia	6892fd8b51	fix(huggingface_restapi.py): fix huggingface response format	2023-11-21 09:57:26 -08:00
Krrish Dholakia	a534928337	bump: version 1.3.2 → 1.3.3.dev1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	a89b8f55e3	fix(huggingface_restapi.py): handle generate text output	2023-11-21 09:57:26 -08:00
ishaan-jaff	f4dcff2864	(docs) add claude2.1	2023-11-21 09:54:32 -08:00
ishaan-jaff	219470ed68	(test) add claude-2.1	2023-11-21 09:53:47 -08:00
ishaan-jaff	07bca4dcb1	(feat) add claude2.1	2023-11-21 09:44:19 -08:00
ishaan-jaff	2a35ff88a7	(fix) proxy server LiteLLM warning	2023-11-21 08:50:31 -08:00
ishaan-jaff	8969c5f769	(docs) proxy starting config.yaml	2023-11-21 08:36:34 -08:00
ishaan-jaff	6898840218	(fix) proxy server - raise 500 on exceptions	2023-11-21 08:36:34 -08:00
Krrish Dholakia	6ddefc778a	bump: version 1.3.1 → 1.3.2	2023-11-21 08:36:18 -08:00
Krrish Dholakia	846a824c47	fix(proxy_server.py): run ollama serve when ollama in config.yaml	2023-11-21 08:35:04 -08:00
ishaan-jaff	c4f9ef86c9	(fix) fix anyscale context window	2023-11-21 08:22:21 -08:00
Krrish Dholakia	8534bf96d5	test(test_rules.py): clear rules after test completes	2023-11-21 08:18:04 -08:00
Krrish Dholakia	2a681c1874	fix(utils.py): fix pre call rules	2023-11-21 07:10:04 -08:00
Krrish Dholakia	b991a35ebe	fix(main.py): revert model alias map change	2023-11-20 21:07:52 -08:00
Krrish Dholakia	ab2986290e	fix(utils.py): fix rules calling	2023-11-20 21:06:36 -08:00
Krrish Dholakia	b2e52eedf8	fix(main.py): fix model alias map logic	2023-11-20 20:49:10 -08:00
ishaan-jaff	b752ba8a46	(docs) router	2023-11-20 19:29:58 -08:00
Krrish Dholakia	1306addfe8	fix(openai.py-+-azure.py): fix linting issues	2023-11-20 19:29:23 -08:00