45 commits

Author	SHA1	Message	Date
Krish Dholakia	d57be47b0f	Litellm ruff linting enforcement (#5992) ... * ci(config.yml): add a 'check_code_quality' step Addresses https://github.com/BerriAI/litellm/issues/5991 * ci(config.yml): check why circle ci doesn't pick up this test * ci(config.yml): fix to run 'check_code_quality' tests * fix(__init__.py): fix unprotected import * fix(__init__.py): don't remove unused imports * build(ruff.toml): update ruff.toml to ignore unused imports * fix: fix: ruff + pyright - fix linting + type-checking errors * fix: fix linting errors * fix(lago.py): fix module init error * fix: fix linting errors * ci(config.yml): cd into correct dir for checks * fix(proxy_server.py): fix linting error * fix(utils.py): fix bare except causes ruff linting errors * fix: ruff - fix remaining linting errors * fix(clickhouse.py): use standard logging object * fix(__init__.py): fix unprotected import * fix: ruff - fix linting errors * fix: fix linting errors * ci(config.yml): cleanup code qa step (formatting handled in local_testing) * fix(_health_endpoints.py): fix ruff linting errors * ci(config.yml): just use ruff in check_code_quality pipeline for now * build(custom_guardrail.py): include missing file * style(embedding_handler.py): fix ruff check	2024-10-01 19:44:20 -04:00
fracapuano	5553f84d51	fix: now supports single tokens prediction	2024-07-25 19:06:07 +02:00
Krrish Dholakia	77068575d7	fix: fix linting errors	2024-07-11 13:44:29 -07:00
Krrish Dholakia	6e9f048618	fix: move to using pydantic obj for setting values	2024-07-11 13:18:36 -07:00
Krrish Dholakia	d18dc2648c	fix(replicate.py): correctly handly invalid replicate response	2024-07-03 10:09:46 -07:00
Krrish Dholakia	d182ea0f77	fix(utils.py): catch 422-status errors	2024-06-24 19:41:48 -07:00
Krrish Dholakia	93c3635b64	fix: fix streaming with httpx client ... prevent overwriting streams in parallel streaming calls	2024-05-31 10:55:18 -07:00
Krrish Dholakia	709373b15c	fix(replicate.py): move replicate calls to being completely async ... Closes https://github.com/BerriAI/litellm/issues/3128	2024-05-16 17:24:08 -07:00
Krrish Dholakia	6575143460	feat(proxy_server.py): return litellm version in response headers	2024-05-08 16:00:08 -07:00
Krrish Dholakia	93463565fb	fix(replicate.py): pass version if passed in	2024-04-26 17:11:21 -07:00
Krrish Dholakia	4f46b4c397	fix(factory.py): add replicate meta llama prompt templating support	2024-04-25 08:25:00 -07:00
Krrish Dholakia	48c2c3d78a	fix(utils.py): fix streaming to not return usage dict ... Fixes https://github.com/BerriAI/litellm/issues/3237	2024-04-24 08:06:07 -07:00
Krrish Dholakia	47997c3f04	fix(replicate.py): handle empty response - replicate	2024-04-09 21:57:25 -07:00
Krrish Dholakia	ea303b0f61	fix(replicate.py): handle model endpoint	2024-03-05 19:06:24 -08:00
Krrish Dholakia	4905929de3	refactor: add black formatting	2023-12-25 14:11:20 +05:30
Krish Dholakia	bbbc5db104	Merge pull request #1080 from nbaldwin98/fixing-replicate-sys-prompt ... fix replicate system prompt: forgot to add **optional_params to input data	2023-12-11 07:11:52 -08:00
chabala98	c5ce11541b	adfix: ded **optional_params in input data when system prompt is available (allows to papass other optional params apart from sys prompt)	2023-12-11 14:42:05 +01:00
Krish Dholakia	b90fcbdac4	Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt ... fix system prompts for replicate	2023-12-04 16:39:44 -08:00
ishaan-jaff	32ecc1a677	(feat) replicate/deployments: add POST Req view	2023-12-04 13:43:03 -08:00
chabala98	c2e2e927fb	fix system prompts for replicate	2023-12-01 13:16:35 +01:00
Krrish Dholakia	1f5a1122fc	fix(replicate.py): fix custom prompt formatting	2023-11-29 19:44:09 -08:00
ishaan-jaff	50f883a2fb	(fix) pydantic errors with response.time	2023-11-20 18:28:19 -08:00
Krrish Dholakia	45b6f8b853	refactor: fixing linting issues	2023-11-11 18:52:28 -08:00
Krrish Dholakia	4f42beb9d9	refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk	2023-11-11 17:38:15 -08:00
ishaan-jaff	af98f74c82	(feat) replicate add exception mapping for streaming + better logging when polling	2023-11-10 12:46:33 -08:00
ishaan-jaff	4c3765119b	(fix) replicate print verbose	2023-11-10 12:46:33 -08:00
ishaan-jaff	49c7c851a8	(feat) replicate exception mapping	2023-11-10 12:46:33 -08:00
ishaan-jaff	00e1b46e68	(feat) replicate exception mapping	2023-11-10 12:46:33 -08:00
ishaan-jaff	d0c9bfd14a	(feat) completion - replicate custom deployments	2023-11-09 18:10:38 -08:00
ishaan-jaff	63928fa166	(feat) use usage class for model responses for cohere, hf, tg ai, cohere	2023-10-27 09:58:47 -07:00
Krrish Dholakia	00993f3575	fix: allow api base to be set for all providers ... enables proxy use cases	2023-10-19 19:07:42 -07:00
Krrish Dholakia	af2fd0e0de	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
ishaan-jaff	a4d135eef9	modify replicate polling interval	2023-10-02 07:43:38 -07:00
Krrish Dholakia	07c74838ff	remove print statement in replicate.py	2023-09-27 10:43:06 -07:00
Krrish Dholakia	889679a0dd	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
ishaan-jaff	8b3b682000	add replicate pricing	2023-09-06 18:14:34 -07:00
Krrish Dholakia	44f71aa321	logging replicate response logs	2023-09-06 11:28:40 -07:00
ishaan-jaff	1da6026622	add flan + vicuna + fix replicate errors	2023-09-06 11:23:58 -07:00
Krrish Dholakia	48ee4a08ac	updates	2023-09-06 11:21:48 -07:00
ishaan-jaff	d4c4a138ca	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	bc9b629726	add Replicate Error class	2023-09-06 10:25:40 -07:00
ishaan-jaff	1c61b7b229	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	c45b132675	use replicate http requests instead	2023-09-06 09:43:05 -07:00