857 commits

Author	SHA1	Message	Date
Krrish Dholakia	4791dda66f	feat(proxy_server.py): enable infinite retries on rate limited requests	2023-12-15 20:03:41 -08:00
Krrish Dholakia	cab870f73a	fix(ollama.py): fix ollama async streaming for /completions calls	2023-12-15 09:28:32 -08:00
ishaan-jaff	c9fb4ba88c	(feat) proxy - use async langfuse logger	2023-12-15 21:57:12 +05:30
ishaan-jaff	99c505dba6	(fix) make dynamo logger async for proxy	2023-12-15 18:52:09 +05:30
ishaan-jaff	fa57a6d1f8	(fix) async + stream +sync logging	2023-12-15 18:31:36 +05:30
ishaan-jaff	6af3e73495	(fix) async+stream logger - building complete resp	2023-12-15 18:13:29 +05:30
ishaan-jaff	6c58fe65ff	(feat) dynamo db - log call_type	2023-12-15 17:27:48 +05:30
ishaan-jaff	6b0f61f29b	(fix) dynamo.py spelling	2023-12-15 16:07:42 +05:30
ishaan-jaff	dacc95614c	(utils) add dynamoDB logger	2023-12-15 15:36:00 +05:30
ishaan-jaff	33afbd6ff5	(fix) raise openai.NotFoundError	2023-12-15 14:03:50 +05:30
ishaan-jaff	13eafa52e9	(feat) add openai.NotFoundError exception mapping	2023-12-15 13:33:03 +05:30
ishaan-jaff	353433e5ce	(feat) add openai.NotFoundError	2023-12-15 10:18:02 +05:30
ishaan-jaff	4fd59c5847	(feat) add BadRequestError for Azure	2023-12-15 09:53:56 +05:30
ishaan-jaff	ad18ab2144	(fix) utils - delete remove_model_id	2023-12-15 07:07:53 +05:30
Krrish Dholakia	e1679a44da	fix(utils.py): improved togetherai exception mapping	2023-12-14 15:28:11 -08:00
Krrish Dholakia	51d62189f1	test(test_optional_params.py): unit tests for get_optional_params_embeddings()	2023-12-14 14:32:36 -08:00
Krrish Dholakia	1608dd7e0b	fix(main.py): support async streaming for text completions endpoint	2023-12-14 13:56:32 -08:00
ishaan-jaff	17c3a1393b	(feat) control caching for embedding, completion	2023-12-14 22:31:04 +05:30
ishaan-jaff	ce6eb8a30e	(test) add ollama to ci/cd	2023-12-14 19:42:44 +05:30
ishaan-jaff	c0cc78b943	(feat) mistral - add exception mapping	2023-12-14 18:57:39 +05:30
ishaan-jaff	b52ffe1bdf	(feat) mistral - add random_seed, safe_mode params	2023-12-14 18:42:00 +05:30
ishaan-jaff	7945664e61	(feat) add mistral api	2023-12-14 18:17:48 +05:30
ishaan-jaff	008df34ddc	(feat) use async_cache for acompletion/aembedding	2023-12-14 16:04:45 +05:30
Krrish Dholakia	73e5b96d8e	fix(utils.py): support cache logging for async router calls	2023-12-13 19:11:43 -08:00
Krrish Dholakia	8d688b6217	fix(utils.py): support caching for embedding + log cache hits ... n n	2023-12-13 18:37:30 -08:00
Krrish Dholakia	e678009695	fix(vertex_ai.py): add exception mapping for acompletion calls	2023-12-13 16:35:50 -08:00
Krrish Dholakia	7b8851cce5	fix(ollama.py): fix async completion calls for ollama	2023-12-13 13:10:25 -08:00
Krrish Dholakia	69c29f8f86	fix(vertex_ai.py): add support for real async streaming + completion calls	2023-12-13 11:53:55 -08:00
Krrish Dholakia	ef7a6e3ae1	feat(vertex_ai.py): adds support for gemini-pro on vertex ai	2023-12-13 10:26:30 -08:00
Krrish Dholakia	d1aef59fbc	fix(utils.py): fix stream chunk builder for sync/async success	2023-12-13 07:52:51 -08:00
Krrish Dholakia	f9dfeb502a	fix(langfuse.py): serialize message for logging	2023-12-12 21:41:05 -08:00
Krrish Dholakia	669862643b	fix(utils.py): flush holding chunk for streaming, on stream end	2023-12-12 16:13:31 -08:00
Krrish Dholakia	8b07a6c046	fix(main.py): pass user_id + encoding_format for logging + to openai/azure	2023-12-12 15:46:44 -08:00
Krrish Dholakia	35fa176c97	fix(utils.py): fix logging ... n	2023-12-12 15:46:36 -08:00
Krrish Dholakia	1e970841a4	fix(utils.py): more logging	2023-12-12 15:46:27 -08:00
Krrish Dholakia	632d6e0bff	fix(utils.py): add more logging	2023-12-12 15:46:12 -08:00
Krrish Dholakia	6e87d1ca18	fix(utils.py): safe fail complete streaming response	2023-12-12 15:46:12 -08:00
Krrish Dholakia	d6669fe9e3	fix(utils.py): add more logging	2023-12-12 15:46:00 -08:00
Krrish Dholakia	bdf29ca71f	fix(sagemaker.py): debug streaming	2023-12-12 15:45:07 -08:00
ishaan-jaff	0dd1111cea	(fix) assert streaming response = streamchoices()	2023-12-12 00:12:57 -08:00
Krrish Dholakia	3e908bf507	fix(router.py): reset caching correctly	2023-12-11 19:57:34 -08:00
Krrish Dholakia	ad39afc0ad	test(test_custom_callback_input.py): embedding callback tests for azure, openai, bedrock	2023-12-11 15:32:46 -08:00
Krrish Dholakia	b09ecb986e	test(test_custom_callback_input.py): add bedrock testing ... n n	2023-12-11 13:00:01 -08:00
Krrish Dholakia	ea89a8a938	test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs	2023-12-11 11:44:09 -08:00
ishaan-jaff	8cc23b72ec	(feat) caching - bedrock	2023-12-11 08:43:50 -08:00
ishaan-jaff	ee53139ce2	(fix) langfuse test	2023-12-09 22:47:52 -08:00
ishaan-jaff	3c8603f148	(test) langfuse	2023-12-09 22:44:02 -08:00
ishaan-jaff	d18d5a3133	(feat) async completion caching	2023-12-09 14:22:10 -08:00
ishaan-jaff	5e5ffc3d8a	(fix) use cache + custom logger	2023-12-09 12:41:26 -08:00
ishaan-jaff	0294e1119e	(fix) success_handler / logging	2023-12-09 11:38:42 -08:00