3758 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	6d9f7b8f9d	fix: fix nlp cloud streaming	2023-11-25 13:45:23 -08:00
ishaan-jaff	a688df79b1	(feat) proxy: make chat/completions async	2023-11-25 12:54:03 -08:00
Krrish Dholakia	30f47d3169	bump: version 1.7.0 → 1.7.1	2023-11-25 12:34:28 -08:00
Krrish Dholakia	620633ec28	fix(openai.py): fix linting issues	2023-11-25 12:21:29 -08:00
Krrish Dholakia	69a3b6b8cf	docs(simple_proxy.md): improve loading key from vault example	2023-11-25 12:18:35 -08:00
Krrish Dholakia	f9ac71a45a	docs(simple_proxy.md): add loading api keys from key vault to proxy docs	2023-11-25 12:15:11 -08:00
ishaan-jaff	c9fdf25c94	(docs) proxy embedding config	2023-11-25 12:14:19 -08:00
ishaan-jaff	f3fff173d2	(docs) custom openai embedding model config	2023-11-25 12:11:25 -08:00
Krrish Dholakia	dac76a4861	fix(utils.py): fix embedding response output parsing	2023-11-25 12:06:57 -08:00
ishaan-jaff	62d8f9ad2a	(docs) simple proxy - reorder configs	2023-11-25 11:59:57 -08:00
ishaan-jaff	c12d6c3fe8	(docs) custom openai embedding	2023-11-25 11:52:59 -08:00
ishaan-jaff	fed620b202	(test) metadata test in embedding	2023-11-25 11:10:06 -08:00
ishaan-jaff	565d51a4b4	(test) metadata test in litellm.completion	2023-11-25 11:10:06 -08:00
ishaan-jaff	6baaf629e5	(fix) embedding: filter out metadata from optional_params	2023-11-25 11:10:06 -08:00
ishaan-jaff	2e08acba93	(feat) embedding: better logging	2023-11-25 11:10:06 -08:00
ishaan-jaff	77a9eb8a77	(feat) logging: for embedding openai.py	2023-11-25 11:10:06 -08:00
Krrish Dholakia	7cf029d677	docs(simple_proxy.md): update simple proxy docs	2023-11-25 10:18:40 -08:00
ishaan-jaff	fbcdbf3a82	(fix) test embedding	2023-11-24 20:46:35 -08:00
ishaan-jaff	d9e1267b24	(fix) embedding test	2023-11-24 18:28:38 -08:00
ishaan-jaff	785c024324	(test) fix embedding	2023-11-24 18:14:06 -08:00
ishaan-jaff	dca0a5ad0f	(test) load test embedding: proxy	2023-11-24 17:14:44 -08:00
ishaan-jaff	1c5b3ad764	(docs) proxy	2023-11-24 17:09:38 -08:00
ishaan-jaff	111c7afaca	(docs) proxy performance	2023-11-24 17:07:46 -08:00
ishaan-jaff	ad1672b901	(test) fix embedding tests	2023-11-24 17:04:59 -08:00
ishaan-jaff	23466107a7	(feat) 10x faster embeddings	2023-11-24 17:02:57 -08:00
Krrish Dholakia	6738044170	bump: version 1.6.0 → 1.7.0	2023-11-24 16:05:59 -08:00
Krrish Dholakia	e732fb8b97	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
Krrish Dholakia	d62da29cbe	fix: fix linting issues	2023-11-24 15:46:25 -08:00
Krrish Dholakia	fe900966c1	docs(simple_proxy.md): adding tracking spend via proxy to docs	2023-11-24 15:41:52 -08:00
Krrish Dholakia	1a6ea20a0b	fix(main.py): fixing linting issues	2023-11-24 15:25:51 -08:00
Krrish Dholakia	bc84b38154	feat(proxy_server.py): new /key/info endpoint to access key information (master key only)	2023-11-24 15:24:50 -08:00
Krrish Dholakia	4f22e7de18	feat(proxy_server.py): tracking spend per api key	2023-11-24 15:14:06 -08:00
Krrish Dholakia	2b52e6995c	docs(perplexity.md): fix model list ... https://github.com/BerriAI/litellm/issues/908	2023-11-24 14:14:47 -08:00
ishaan-jaff	41c6388185	(test) completion with many params	2023-11-24 14:01:21 -08:00
ishaan-jaff	a6bea946b3	(fix) completion: when logit bias is None	2023-11-24 14:01:21 -08:00
ishaan-jaff	0f873c756d	(fix) completion: OpenAI/Azure filter out None params	2023-11-24 14:01:21 -08:00
Krrish Dholakia	f1dbdb58bb	docs(simple_proxy.md): add cooldown to docs	2023-11-24 13:37:16 -08:00
Krrish Dholakia	2686894823	fix(router.py): fix retry logic	2023-11-24 13:27:44 -08:00
Krrish Dholakia	16e1070dbe	test: refactor testing order	2023-11-24 12:47:28 -08:00
Krrish Dholakia	2a033fd8a2	test(test_router_cooldowns.py): adding logging	2023-11-24 12:30:08 -08:00
Krrish Dholakia	12dbdc4c15	docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy	2023-11-24 12:20:38 -08:00
Krrish Dholakia	3dcbf6197a	test(test_router.py): reintegrate router testing	2023-11-24 11:48:24 -08:00
Krrish Dholakia	c75e90663c	test(test_stream_chunk_builder.py): fix setting api key	2023-11-24 11:47:48 -08:00
Krrish Dholakia	2e8d582a34	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
Krish Dholakia	d3d8b86eaa	Updated config.yml	2023-11-24 11:34:24 -08:00
Krrish Dholakia	4a5dae3941	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
ishaan-jaff	8edfcd8e5d	(fix) prisma using: secrets.compare_digest	2023-11-24 10:02:08 -08:00
Ishaan Jaff	86e405c9ab	Merge pull request #904 from Manouchehri/fix-auth-1 ... Fix OpenAPI auth spec.	2023-11-24 09:44:30 -08:00
Ishaan Jaff	2e140fe56a	Merge pull request #903 from kumaranvpl/main ... Fix wrong model mentioned in simple proxy doc page	2023-11-24 09:39:06 -08:00
David Manouchehri	ac08e3616c	Fix timing attack on master_key.	2023-11-24 12:12:29 -05:00