3925 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
chabala98	c5ce11541b	adfix: ded **optional_params in input data when system prompt is available (allows to papass other optional params apart from sys prompt)	2023-12-11 14:42:05 +01:00
chabala98	c2e2e927fb	fix system prompts for replicate	2023-12-01 13:16:35 +01:00
ishaan-jaff	1e9aa69268	(fix) proxy: use orjson.loads()	2023-11-30 20:24:31 -08:00
ishaan-jaff	fb8ccdd422	(ci/cd) add orjson as a dep	2023-11-30 20:18:18 -08:00
ishaan-jaff	06805c7f47	(fix) formatting	2023-11-30 20:03:56 -08:00
ishaan-jaff	1081d4c766	(feat) aembedding: return raw openai response	2023-11-30 20:02:47 -08:00
ishaan-jaff	10d5ab8643	(feat) proxy: /embedding -> use ORJSON responses	2023-11-30 20:00:35 -08:00
ishaan-jaff	2d55cc753e	(feat) proxy: use orjson	2023-11-30 19:50:47 -08:00
ishaan-jaff	853af29a25	(test) load test embedding	2023-11-30 19:04:51 -08:00
ishaan-jaff	e1fe79e0c0	(docs) add embedding() profile	2023-11-30 19:04:51 -08:00
Krrish Dholakia	aa36bd2784	fix(utils.py): expand openai_token_counter selection	2023-11-30 18:51:51 -08:00
Krrish Dholakia	ff4457e2d2	fix(router.py): back-off if no models available	2023-11-30 18:42:29 -08:00
Krrish Dholakia	7b99cfe6b9	test(test_token_counter.py): include testing for function calls	2023-11-30 18:24:21 -08:00
Krrish Dholakia	7f04758bcb	(fix) support counting tokens for tool calls	2023-11-30 18:24:21 -08:00
Ishaan Jaff	854ffbe79a	Merge pull request #966 from PSU3D0/proxy_extras ... (feat) Allow installing proxy dependencies explicitly with `pip install litellm[proxy]`	2023-11-30 15:46:25 -08:00
Frank Colson	6fb178dc94	Update docs	2023-11-30 16:43:09 -07:00
Frank Colson	7ddfeb75bc	Add backwards compatability	2023-11-30 16:35:19 -07:00
Frank Colson	d557f3be74	Remove YAML dependency	2023-11-30 16:31:43 -07:00
Ishaan Jaff	8d39af11d6	Azure Deploy - fix startup command	2023-11-30 15:31:03 -08:00
Frank Colson	5e6913dff2	Use poetry extras for proxy	2023-11-30 16:23:34 -07:00
ishaan-jaff	0da78a64df	bump: version 1.9.3 → 1.9.4	2023-11-30 15:20:29 -08:00
ishaan-jaff	bc2299184b	(fix) proxy - don't overwrite metadata passed	2023-11-30 15:15:47 -08:00
Ishaan Jaff	f305c3aaef	Add or update the Azure App Service build and deployment workflow config	2023-11-30 14:56:41 -08:00
ishaan-jaff	afc1b2209b	(feat) docker - allow user to specify base image	2023-11-30 14:49:21 -08:00
ishaan-jaff	8c1a9f1c4e	(feat) add bedrock:llama2-70bchat	2023-11-30 14:41:19 -08:00
ishaan-jaff	95634bde76	bump: version 1.9.2 → 1.9.3	2023-11-30 14:30:12 -08:00
ishaan-jaff	f565e6249d	(feat) proxy: docker - use wheels for builds	2023-11-30 14:29:30 -08:00
ishaan-jaff	3b2bbc757e	(feat) add pip wheel - faster docker image builds	2023-11-30 14:20:30 -08:00
Krrish Dholakia	c473abde49	fix(azure.py): logging fix	2023-11-30 14:13:40 -08:00
Krrish Dholakia	10c522025f	bump: version 1.9.1 → 1.9.2	2023-11-30 14:09:06 -08:00
Krrish Dholakia	032f71adb2	fix(router.py): support cloudflare ai gateway for azure models on router	2023-11-30 14:09:06 -08:00
ishaan-jaff	936c27c9ee	(fix +test) langfuse log metadata	2023-11-30 13:53:43 -08:00
Krrish Dholakia	6475e0a916	bump: version 1.9.0 → 1.9.1	2023-11-30 13:45:38 -08:00
Krrish Dholakia	a5c99d8594	fix(langfuse.py): fix metadata logging for langfuse	2023-11-30 13:45:34 -08:00
ishaan-jaff	cc0df56bd6	(chore) remove old doc -> this is now Router	2023-11-30 13:33:17 -08:00
Krrish Dholakia	82553e8aac	fix(azure.py): fix linting errors	2023-11-30 13:32:29 -08:00
ishaan-jaff	9a1accfe2a	(chore) proxy: remove junk load test	2023-11-30 13:31:23 -08:00
Krrish Dholakia	1f3ef72a4b	bump: version 1.8.1 → 1.9.0	2023-11-30 13:19:49 -08:00
Krrish Dholakia	4f07c8565a	feat(main.py): add support for azure-openai via cloudflare ai gateway	2023-11-30 13:19:49 -08:00
ishaan-jaff	be8bdb580a	(test) proxy + router: add bursty load test	2023-11-30 13:17:11 -08:00
ishaan-jaff	a8a6838867	(docs) example: azure config.yaml	2023-11-30 13:16:41 -08:00
ishaan-jaff	97ff0caf70	(feat) proxy: config - azure allow users to pass in base_url	2023-11-30 10:56:55 -08:00
ishaan-jaff	908c32c9c1	(docs) librechat + proxy	2023-11-30 10:47:16 -08:00
ishaan-jaff	fe6ff7cf10	(docs) proxy + librechat	2023-11-30 10:46:48 -08:00
Krrish Dholakia	aea74758e6	docs(simple_proxy.md): improve librechat tutorial	2023-11-30 10:19:18 -08:00
Krrish Dholakia	3d850337a2	docs(routing.md): shoutout sweep on load balancing docs	2023-11-30 09:35:28 -08:00
Ishaan Jaff	e3d37b9bdc	Update proxy_server_config.yaml	2023-11-30 09:30:41 -08:00
Ishaan Jaff	94fd2e3227	Update Dockerfile	2023-11-30 09:27:42 -08:00
Ishaan Jaff	a965c4dfb1	Update proxy_server_config.yaml	2023-11-30 09:26:54 -08:00
Krrish Dholakia	062ede96e3	refactor(proxy_server.py): fix linting issues	2023-11-30 09:24:59 -08:00