639 commits

Author	SHA1	Message	Date
ishaan-jaff	ee8b23cf91	(feat) proxy: log model_info + proxy_server request	2023-12-08 14:26:18 -08:00
ishaan-jaff	d7af5f1d85	(feat) embedding - pass model_info, proxy_server request	2023-12-08 14:26:18 -08:00
ishaan-jaff	de6880dc09	(feat) pass model_info, proxy_server_request to callback	2023-12-08 14:26:18 -08:00
ishaan-jaff	f744445db4	(fix) make print_verbose non blocking	2023-12-07 17:31:32 -08:00
Krrish Dholakia	583de6ab92	fix(bedrock.py): fix output format for cohere embeddings	2023-12-06 22:47:01 -08:00
ishaan-jaff	40faeb6cd7	(feat) aembedding - add custom logging support	2023-12-06 19:09:06 -08:00
Krrish Dholakia	45e9c3eb31	feat(sagemaker.py): support huggingface embedding models	2023-12-06 11:41:38 -08:00
Krrish Dholakia	f9b74e54a3	fix(sagemaker.py): enable passing hf model name for prompt template	2023-12-05 16:31:59 -08:00
Krrish Dholakia	7e42c64cc5	fix(utils.py): support sagemaker llama2 custom endpoints	2023-12-05 16:05:15 -08:00
Krrish Dholakia	1e1fae3d58	fix(main.py): accept user in embedding()	2023-12-02 21:49:23 -08:00
estill01	2b20d78ce8	fix	2023-12-03 05:37:57 +00:00
estill01	27ebbaa8f1	Fix; persistent 'model' default value	2023-12-03 05:34:24 +00:00
Krrish Dholakia	95df9ea50d	fix(main.py): only send user if set	2023-12-02 20:36:30 -08:00
Krrish Dholakia	00a9150f54	fix(main.py): set user to none if not passed in	2023-12-02 20:08:25 -08:00
Krrish Dholakia	285f0b72c3	fix(main.py): fix pydantic warning for usage dict	2023-12-02 20:02:55 -08:00
estill01	145da887af	Enable setting default model value for Completions ... add `model` arg to `Completions` class; if you provide a value, it will be used when you create new completions from an instance of the class.	2023-12-02 19:50:18 -08:00
Krrish Dholakia	49684e9eb4	fix(azure.py): fix linting errors	2023-11-30 13:32:29 -08:00
Krrish Dholakia	526cc3a9c4	feat(main.py): add support for azure-openai via cloudflare ai gateway	2023-11-30 13:19:49 -08:00
Krrish Dholakia	68e0eca6b8	fix(utils.py): include system fingerprint in streaming response object	2023-11-30 08:45:52 -08:00
Krrish Dholakia	0341b0cd07	feat(main.py): allow updating model cost via completion()	2023-11-29 20:14:39 -08:00
Krrish Dholakia	a1ea893a73	fix(main.py): don't pass stream to petals	2023-11-29 19:58:04 -08:00
Krrish Dholakia	a05722571b	fix(replicate.py): fix custom prompt formatting	2023-11-29 19:44:09 -08:00
ishaan-jaff	dc9bafa959	(feat) Embedding: Async Azure	2023-11-29 19:43:47 -08:00
ishaan-jaff	ca03f83597	(feat) async embeddings: OpenAI	2023-11-29 19:35:08 -08:00
Krrish Dholakia	67df0804eb	fix(main.py): fix null finish reason issue for ollama	2023-11-29 16:50:11 -08:00
Krrish Dholakia	2a5592abe7	fix(bedrock.py): support ai21 / bedrock streaming	2023-11-29 16:35:06 -08:00
ishaan-jaff	0fbbefca94	(feat) completion: add rpm, tpm as litellm params	2023-11-29 16:19:05 -08:00
Krrish Dholakia	18afb51d72	bump: version 1.7.13 → 1.7.14	2023-11-29 15:19:18 -08:00
Krrish Dholakia	00b55e4389	fix(main.py): have stream_chunk_builder return successful response even if token_counter fails	2023-11-29 15:19:11 -08:00
Krrish Dholakia	622eaf4a21	fix(utils.py): fix parallel tool calling when streaming	2023-11-29 10:56:21 -08:00
ishaan-jaff	e88f498201	(fix) embedding pop out client from params	2023-11-28 21:22:01 -08:00
Krrish Dholakia	ceadb1547d	fix(main.py): passing client as a litellm-specific kwarg	2023-11-28 21:20:05 -08:00
ishaan-jaff	9d69ea5b12	(fix) router: passing client	2023-11-28 16:34:16 -08:00
ishaan-jaff	efd5dbccd5	(feat) completion:openai pass OpenAI client	2023-11-28 16:05:01 -08:00
ishaan-jaff	a2d7623d6e	(feat) completion: Azure allow users to pass client to router	2023-11-28 15:56:52 -08:00
ishaan-jaff	ad6a3fb8fe	(feat) allow users to pass azure client for acmompletion	2023-11-28 15:44:56 -08:00
Krrish Dholakia	6a7a8be4fb	fix(utils.py): fix streaming on-success logging	2023-11-28 09:11:47 -08:00
ishaan-jaff	49afff8c88	(fix) completion: AZURE_OPENAI_API_KEY	2023-11-28 08:06:06 -08:00
Krrish Dholakia	91e8ff439d	fix(main.py): fix linting errors	2023-11-27 19:11:38 -08:00
Krrish Dholakia	01a71cd0dc	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
Krrish Dholakia	e564f643f5	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00
Krrish Dholakia	fb680ce4a2	fix(acompletion): fix acompletion raise exception issue when custom llm provider is none	2023-11-27 11:34:48 -08:00
ishaan-jaff	815e1f385b	(fix) embedding: filter out metadata from optional_params	2023-11-25 11:10:06 -08:00
Krrish Dholakia	ff6975a98d	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
Krrish Dholakia	85854e00c9	fix(main.py): fixing linting issues	2023-11-24 15:25:51 -08:00
ishaan-jaff	95b7ba4634	(fix) completion: when logit bias is None	2023-11-24 14:01:21 -08:00
Krrish Dholakia	6f40fd8ee2	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
Krrish Dholakia	5a9a3aa89c	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
Krrish Dholakia	27f5703ca2	fix(main.py): only set api key to dynamic api key if it's not none	2023-11-23 16:45:44 -08:00
Krrish Dholakia	6999516f5b	fix: fix linting issues	2023-11-23 13:47:43 -08:00