3950 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ishaan-jaff	3e62f90b43	(feat) proxy: add OTEL logging input/output	2023-12-01 21:04:07 -08:00
ishaan-jaff	848acdf28e	(feat) proxy: add otel config	2023-12-01 21:04:07 -08:00
Krrish Dholakia	60af976aac	fix(proxy_server.py): expose model_info as part of pydantic model params object	2023-12-01 20:55:26 -08:00
Krrish Dholakia	41afe48bf8	bump: version 1.9.5 → 1.10.0	2023-12-01 20:47:40 -08:00
Krrish Dholakia	bb687cb96f	fix(proxy_server.py): redact api keys from proxy load	2023-12-01 20:47:13 -08:00
Krrish Dholakia	47730da262	fix(proxy_server.py): fix linting errors	2023-12-01 20:40:49 -08:00
Krrish Dholakia	72381c3cc2	feat(proxy_server.py): dynamic reloading config.yaml with new models	2023-12-01 20:32:24 -08:00
Krrish Dholakia	eae5b3ce50	fix(__init__.py): fix linting error	2023-12-01 20:08:08 -08:00
Krrish Dholakia	ccd10b07a8	docs(secret.md): add azure key vault support to docs	2023-12-01 20:07:20 -08:00
Krrish Dholakia	328113a28e	fix(proxy_server.py): fix linting errors	2023-12-01 19:45:09 -08:00
Krrish Dholakia	368fee224e	feat: support for azure key vault	2023-12-01 19:36:06 -08:00
Krrish Dholakia	cac7ecf840	fix(proxy_server.py): check if bearer token passed in	2023-12-01 17:06:29 -08:00
ishaan-jaff	a971d78d6c	bump: version 1.9.4 → 1.9.5	2023-12-01 16:47:14 -08:00
ishaan-jaff	6c6add2a3c	(fix) ci/cd	2023-12-01 16:06:22 -08:00
ishaan-jaff	61f902347f	(proxy) fix types	2023-12-01 16:05:29 -08:00
ishaan-jaff	80e2ffbfa6	(feat) proxy: use dict	2023-12-01 16:00:00 -08:00
Krrish Dholakia	2c1103247d	test: fix flaky test	2023-12-01 15:46:39 -08:00
Krrish Dholakia	4da20ac0b9	fix(proxy_server.py): accept max tokens as int	2023-12-01 15:19:34 -08:00
Krrish Dholakia	ac4429c35f	test(test_completion.py): commenting out flaky test	2023-12-01 15:06:54 -08:00
Krrish Dholakia	8c1439e910	fix: linting errors	2023-12-01 15:02:22 -08:00
ishaan-jaff	fc40e83783	(fix) linting	2023-12-01 14:51:44 -08:00
ishaan-jaff	455c915b70	(linting) fix	2023-12-01 14:34:15 -08:00
ishaan-jaff	73eb5a7718	(fix) linting	2023-12-01 14:08:19 -08:00
ishaan-jaff	24386c05aa	(fix) proxy: pydantic	2023-12-01 13:58:28 -08:00
ishaan-jaff	e8ae347681	(feat) proxy-pydantic,swagger for chat/completion	2023-12-01 13:50:51 -08:00
ishaan-jaff	e77b7e5a50	(docs) proxy: add tags=chat/completions + add response type	2023-12-01 10:00:48 -08:00
ishaan-jaff	2977d04f56	(fix) proxy: raise exceptions	2023-12-01 09:21:06 -08:00
ishaan-jaff	1e9aa69268	(fix) proxy: use orjson.loads()	2023-11-30 20:24:31 -08:00
ishaan-jaff	fb8ccdd422	(ci/cd) add orjson as a dep	2023-11-30 20:18:18 -08:00
ishaan-jaff	06805c7f47	(fix) formatting	2023-11-30 20:03:56 -08:00
ishaan-jaff	1081d4c766	(feat) aembedding: return raw openai response	2023-11-30 20:02:47 -08:00
ishaan-jaff	10d5ab8643	(feat) proxy: /embedding -> use ORJSON responses	2023-11-30 20:00:35 -08:00
ishaan-jaff	2d55cc753e	(feat) proxy: use orjson	2023-11-30 19:50:47 -08:00
ishaan-jaff	853af29a25	(test) load test embedding	2023-11-30 19:04:51 -08:00
ishaan-jaff	e1fe79e0c0	(docs) add embedding() profile	2023-11-30 19:04:51 -08:00
Krrish Dholakia	aa36bd2784	fix(utils.py): expand openai_token_counter selection	2023-11-30 18:51:51 -08:00
Krrish Dholakia	ff4457e2d2	fix(router.py): back-off if no models available	2023-11-30 18:42:29 -08:00
Krrish Dholakia	7b99cfe6b9	test(test_token_counter.py): include testing for function calls	2023-11-30 18:24:21 -08:00
Krrish Dholakia	7f04758bcb	(fix) support counting tokens for tool calls	2023-11-30 18:24:21 -08:00
Ishaan Jaff	854ffbe79a	Merge pull request #966 from PSU3D0/proxy_extras ... (feat) Allow installing proxy dependencies explicitly with `pip install litellm[proxy]`	2023-11-30 15:46:25 -08:00
Frank Colson	6fb178dc94	Update docs	2023-11-30 16:43:09 -07:00
Frank Colson	7ddfeb75bc	Add backwards compatability	2023-11-30 16:35:19 -07:00
Frank Colson	d557f3be74	Remove YAML dependency	2023-11-30 16:31:43 -07:00
Ishaan Jaff	8d39af11d6	Azure Deploy - fix startup command	2023-11-30 15:31:03 -08:00
Frank Colson	5e6913dff2	Use poetry extras for proxy	2023-11-30 16:23:34 -07:00
ishaan-jaff	0da78a64df	bump: version 1.9.3 → 1.9.4	2023-11-30 15:20:29 -08:00
ishaan-jaff	bc2299184b	(fix) proxy - don't overwrite metadata passed	2023-11-30 15:15:47 -08:00
Ishaan Jaff	f305c3aaef	Add or update the Azure App Service build and deployment workflow config	2023-11-30 14:56:41 -08:00
ishaan-jaff	afc1b2209b	(feat) docker - allow user to specify base image	2023-11-30 14:49:21 -08:00
ishaan-jaff	8c1a9f1c4e	(feat) add bedrock:llama2-70bchat	2023-11-30 14:41:19 -08:00