4416 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	fe394df8fc	(ci/cd) update model_prices_and_context_window_backup	2023-12-11 11:27:51 -08:00
ishaan-jaff	05a469177b	(test) proxy custom logger	2023-12-11 11:21:46 -08:00
ishaan-jaff	c532224308	(test) custom logger proxy	2023-12-11 11:11:44 -08:00
ishaan-jaff	0522ffc4b7	(fix) update back model prices with latest llms	2023-12-11 10:56:01 -08:00
ishaan-jaff	04f6b976e9	(test) proxy callbacks	2023-12-11 10:49:53 -08:00
ishaan-jaff	38fe80266f	(test) debug proxy logger test	2023-12-11 10:40:01 -08:00
ishaan-jaff	426c741b40	(test) hf text completion	2023-12-11 10:27:43 -08:00
ishaan-jaff	6aa2f4bc1d	(test) custom logger embedding	2023-12-11 10:24:37 -08:00
ishaan-jaff	485c40b9ae	(test) proxy	2023-12-11 10:12:01 -08:00
ishaan-jaff	71eee5087d	(test) assert metadata in callbacks	2023-12-11 09:47:38 -08:00
ishaan-jaff	91f09365e8	(feat) access metadata in embedding kwargs()	2023-12-11 09:39:25 -08:00
ishaan-jaff	070ca682cf	bump: version 1.12.3 → 1.12.4	2023-12-11 09:19:07 -08:00
ishaan-jaff	43b0da3ebc	(docs) - proxy_config.yaml	2023-12-11 09:06:27 -08:00
ishaan-jaff	ee3c9d19a2	(feat) caching + stream - bedrock	2023-12-11 08:43:50 -08:00
ishaan-jaff	4b26c550c5	(test) bedrock caching + stream	2023-12-11 08:43:50 -08:00
ishaan-jaff	8cc23b72ec	(feat) caching - bedrock	2023-12-11 08:43:50 -08:00
Krish Dholakia	9796877f95	Update README.md	2023-12-11 08:30:55 -08:00
Krrish Dholakia	112881cbb2	test(test_completion.py): assert completion cost > 0.0	2023-12-11 07:59:06 -08:00
Krish Dholakia	dc50bf3c7d	Merge pull request #937 from BerriAI/dependabot/pip/aiohttp-3.9.0 ... build(deps): bump aiohttp from 3.8.6 to 3.9.0	2023-12-11 07:22:56 -08:00
Krish Dholakia	2c58721cfb	Merge pull request #1039 from Manouchehri/patch-3 ... Update Dockerfile to preinstall Prisma CLI	2023-12-11 07:18:54 -08:00
Krish Dholakia	4ffe6a4296	Merge pull request #1054 from James4Ever0/main ... Update factory.py to fix issue when calling from write-the -> langchain -> litellm served ollama	2023-12-11 07:18:02 -08:00
Krish Dholakia	bbbc5db104	Merge pull request #1080 from nbaldwin98/fixing-replicate-sys-prompt ... fix replicate system prompt: forgot to add **optional_params to input data	2023-12-11 07:11:52 -08:00
chabala98	c5ce11541b	adfix: ded **optional_params in input data when system prompt is available (allows to papass other optional params apart from sys prompt)	2023-12-11 14:42:05 +01:00
Krrish Dholakia	80821f62d1	docs(logging.md): add sentry logging to proxy docs	2023-12-09 23:03:48 -08:00
ishaan-jaff	7977f92bd2	(test) langfuse	2023-12-09 22:58:23 -08:00
ishaan-jaff	f6a8ade91a	(test) langfuse	2023-12-09 22:52:02 -08:00
ishaan-jaff	ee53139ce2	(fix) langfuse test	2023-12-09 22:47:52 -08:00
Krrish Dholakia	1ef9bfa125	test(test_proxy_server.py): add testing for /model/new endpoint	2023-12-09 22:44:11 -08:00
Krrish Dholakia	22f04e3b33	fix(proxy_server.py): fix /model/new adding new model issue	2023-12-09 22:44:11 -08:00
ishaan-jaff	3c8603f148	(test) langfuse	2023-12-09 22:44:02 -08:00
ishaan-jaff	127f25703a	(fix) proxy /model/info	2023-12-09 22:35:09 -08:00
ishaan-jaff	d46a52b8f4	(test) langfuse	2023-12-09 22:33:41 -08:00
ishaan-jaff	9909e49171	(test) langfuse	2023-12-09 22:27:07 -08:00
ishaan-jaff	b4c5bacea9	(test) langfuse - read ddebug logs to find status 200	2023-12-09 22:27:07 -08:00
ishaan-jaff	3acd393c5e	(feat) langfuse - print traceback.exec()	2023-12-09 22:27:07 -08:00
Krrish Dholakia	45d59ba64f	bump: version 1.12.2 → 1.12.3	2023-12-09 22:05:20 -08:00
Krrish Dholakia	07b4c72a98	fix(proxy_server.py): fix key gen error	2023-12-09 22:04:59 -08:00
Krrish Dholakia	f10bb708c0	fix: fix run_ollama_serve to only run if api base is none	2023-12-09 21:31:46 -08:00
Krrish Dholakia	82484691cb	fix: minor bug fixes	2023-12-09 21:24:52 -08:00
ishaan-jaff	bf1044444c	(test) caching	2023-12-09 16:58:56 -08:00
ishaan-jaff	8a52e17300	(test) caching - get cache key	2023-12-09 16:42:59 -08:00
ishaan-jaff	2879b36636	(fix) setting cache keys	2023-12-09 16:42:59 -08:00
Krrish Dholakia	149c1b3557	docs(configs.md): added docs on how to configure routing strategy on proxy	2023-12-09 16:31:31 -08:00
Krrish Dholakia	6ef0e8485e	fix(proxy_server.py): support for streaming	2023-12-09 16:23:04 -08:00
ishaan-jaff	0c8b8200b8	(ci/cd) run tests again	2023-12-09 16:02:02 -08:00
ishaan-jaff	adbdb31b9d	(docs) proxy caching	2023-12-09 15:56:57 -08:00
ishaan-jaff	1f1f749ad9	(feat) proxy - cache allow bool	2023-12-09 15:55:38 -08:00
ishaan-jaff	da08be1f43	(test) router + caching	2023-12-09 15:41:36 -08:00
ishaan-jaff	60bf552fe8	(fix) caching + proxy - use model group	2023-12-09 15:40:22 -08:00
ishaan-jaff	994c204e45	(fix) proxy - show logging when Cache created	2023-12-09 15:21:04 -08:00