1909 commits

Author	SHA1	Message	Date
Krrish Dholakia	e4f302a8e2	fix(proxy_server.py): expose a /health endpoint	2023-11-25 18:28:47 -08:00
ishaan-jaff	2c4f52b6b1	(fix) linting	2023-11-25 15:46:07 -08:00
ishaan-jaff	0b56d584aa	(test) openai exception mapping for openai.AuthenticationError	2023-11-25 15:43:46 -08:00
ishaan-jaff	afaca3f819	(fix) acompletion: Raise same error as completion	2023-11-25 15:33:46 -08:00
Krrish Dholakia	ab0bc87427	fix(router.py): check if fallbacks is none	2023-11-25 14:58:07 -08:00
Krrish Dholakia	95579fda7d	fix(utils.py): fix bedrock + cohere calls	2023-11-25 14:45:42 -08:00
Krrish Dholakia	2eb7386095	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
Krrish Dholakia	e43e1e9ab1	fix(utils.py): fix linting errors	2023-11-25 14:19:14 -08:00
Krrish Dholakia	ec81b393e2	fix(utils.py): fix linting erros	2023-11-25 14:14:46 -08:00
Krrish Dholakia	a070bee5be	fix(utils.py): fix linting issues	2023-11-25 14:11:40 -08:00
Krrish Dholakia	8970f12780	fix(utils.py): fix linting issues	2023-11-25 13:48:50 -08:00
Krrish Dholakia	6d9f7b8f9d	fix: fix nlp cloud streaming	2023-11-25 13:45:23 -08:00
ishaan-jaff	a688df79b1	(feat) proxy: make chat/completions async	2023-11-25 12:54:03 -08:00
Krrish Dholakia	30f47d3169	bump: version 1.7.0 → 1.7.1	2023-11-25 12:34:28 -08:00
Krrish Dholakia	620633ec28	fix(openai.py): fix linting issues	2023-11-25 12:21:29 -08:00
Krrish Dholakia	dac76a4861	fix(utils.py): fix embedding response output parsing	2023-11-25 12:06:57 -08:00
ishaan-jaff	fed620b202	(test) metadata test in embedding	2023-11-25 11:10:06 -08:00
ishaan-jaff	565d51a4b4	(test) metadata test in litellm.completion	2023-11-25 11:10:06 -08:00
ishaan-jaff	6baaf629e5	(fix) embedding: filter out metadata from optional_params	2023-11-25 11:10:06 -08:00
ishaan-jaff	2e08acba93	(feat) embedding: better logging	2023-11-25 11:10:06 -08:00
ishaan-jaff	77a9eb8a77	(feat) logging: for embedding openai.py	2023-11-25 11:10:06 -08:00
ishaan-jaff	fbcdbf3a82	(fix) test embedding	2023-11-24 20:46:35 -08:00
ishaan-jaff	d9e1267b24	(fix) embedding test	2023-11-24 18:28:38 -08:00
ishaan-jaff	785c024324	(test) fix embedding	2023-11-24 18:14:06 -08:00
ishaan-jaff	dca0a5ad0f	(test) load test embedding: proxy	2023-11-24 17:14:44 -08:00
ishaan-jaff	111c7afaca	(docs) proxy performance	2023-11-24 17:07:46 -08:00
ishaan-jaff	ad1672b901	(test) fix embedding tests	2023-11-24 17:04:59 -08:00
ishaan-jaff	23466107a7	(feat) 10x faster embeddings	2023-11-24 17:02:57 -08:00
Krrish Dholakia	e732fb8b97	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
Krrish Dholakia	d62da29cbe	fix: fix linting issues	2023-11-24 15:46:25 -08:00
Krrish Dholakia	1a6ea20a0b	fix(main.py): fixing linting issues	2023-11-24 15:25:51 -08:00
Krrish Dholakia	bc84b38154	feat(proxy_server.py): new /key/info endpoint to access key information (master key only)	2023-11-24 15:24:50 -08:00
Krrish Dholakia	4f22e7de18	feat(proxy_server.py): tracking spend per api key	2023-11-24 15:14:06 -08:00
ishaan-jaff	41c6388185	(test) completion with many params	2023-11-24 14:01:21 -08:00
ishaan-jaff	a6bea946b3	(fix) completion: when logit bias is None	2023-11-24 14:01:21 -08:00
ishaan-jaff	0f873c756d	(fix) completion: OpenAI/Azure filter out None params	2023-11-24 14:01:21 -08:00
Krrish Dholakia	2686894823	fix(router.py): fix retry logic	2023-11-24 13:27:44 -08:00
Krrish Dholakia	16e1070dbe	test: refactor testing order	2023-11-24 12:47:28 -08:00
Krrish Dholakia	2a033fd8a2	test(test_router_cooldowns.py): adding logging	2023-11-24 12:30:08 -08:00
Krrish Dholakia	12dbdc4c15	docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy	2023-11-24 12:20:38 -08:00
Krrish Dholakia	3dcbf6197a	test(test_router.py): reintegrate router testing	2023-11-24 11:48:24 -08:00
Krrish Dholakia	c75e90663c	test(test_stream_chunk_builder.py): fix setting api key	2023-11-24 11:47:48 -08:00
Krrish Dholakia	2e8d582a34	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
Krrish Dholakia	4a5dae3941	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
ishaan-jaff	8edfcd8e5d	(fix) prisma using: secrets.compare_digest	2023-11-24 10:02:08 -08:00
David Manouchehri	ac08e3616c	Fix timing attack on master_key.	2023-11-24 12:12:29 -05:00
David Manouchehri	5b6f227170	Fix master key check.	2023-11-24 12:03:30 -05:00
David Manouchehri	3fa3a767b3	Fix OpenAPI auth spec.	2023-11-24 11:59:33 -05:00
ishaan-jaff	0a23af7990	(feat) proxy: cost tracking add track_cost_callback	2023-11-24 05:53:23 -08:00
Kumaran Rajendhiran	01fad94485	Fail gracefully if ollama is already being served	2023-11-24 16:52:55 +05:30