Commit graph

3916 commits

Author SHA1 Message Date
ishaan-jaff
e1fe79e0c0 (docs) add embedding() profile 2023-11-30 19:04:51 -08:00
Krrish Dholakia
aa36bd2784 fix(utils.py): expand openai_token_counter selection 2023-11-30 18:51:51 -08:00
Krrish Dholakia
ff4457e2d2 fix(router.py): back-off if no models available 2023-11-30 18:42:29 -08:00
Krrish Dholakia
7b99cfe6b9 test(test_token_counter.py): include testing for function calls 2023-11-30 18:24:21 -08:00
Krrish Dholakia
7f04758bcb (fix) support counting tokens for tool calls 2023-11-30 18:24:21 -08:00
Ishaan Jaff
854ffbe79a
Merge pull request #966 from PSU3D0/proxy_extras
(feat) Allow installing proxy dependencies explicitly with `pip install litellm[proxy]`
2023-11-30 15:46:25 -08:00
Frank Colson
6fb178dc94 Update docs 2023-11-30 16:43:09 -07:00
Frank Colson
7ddfeb75bc Add backwards compatability 2023-11-30 16:35:19 -07:00
Frank Colson
d557f3be74 Remove YAML dependency 2023-11-30 16:31:43 -07:00
Ishaan Jaff
8d39af11d6
Azure Deploy - fix startup command 2023-11-30 15:31:03 -08:00
Frank Colson
5e6913dff2 Use poetry extras for proxy 2023-11-30 16:23:34 -07:00
ishaan-jaff
0da78a64df bump: version 1.9.3 → 1.9.4 2023-11-30 15:20:29 -08:00
ishaan-jaff
bc2299184b (fix) proxy - don't overwrite metadata passed 2023-11-30 15:15:47 -08:00
Ishaan Jaff
f305c3aaef Add or update the Azure App Service build and deployment workflow config 2023-11-30 14:56:41 -08:00
ishaan-jaff
afc1b2209b (feat) docker - allow user to specify base image 2023-11-30 14:49:21 -08:00
ishaan-jaff
8c1a9f1c4e (feat) add bedrock:llama2-70bchat 2023-11-30 14:41:19 -08:00
ishaan-jaff
95634bde76 bump: version 1.9.2 → 1.9.3 2023-11-30 14:30:12 -08:00
ishaan-jaff
f565e6249d (feat) proxy: docker - use wheels for builds 2023-11-30 14:29:30 -08:00
ishaan-jaff
3b2bbc757e (feat) add pip wheel - faster docker image builds 2023-11-30 14:20:30 -08:00
Krrish Dholakia
c473abde49 fix(azure.py): logging fix 2023-11-30 14:13:40 -08:00
Krrish Dholakia
10c522025f bump: version 1.9.1 → 1.9.2 2023-11-30 14:09:06 -08:00
Krrish Dholakia
032f71adb2 fix(router.py): support cloudflare ai gateway for azure models on router 2023-11-30 14:09:06 -08:00
ishaan-jaff
936c27c9ee (fix +test) langfuse log metadata 2023-11-30 13:53:43 -08:00
Krrish Dholakia
6475e0a916 bump: version 1.9.0 → 1.9.1 2023-11-30 13:45:38 -08:00
Krrish Dholakia
a5c99d8594 fix(langfuse.py): fix metadata logging for langfuse 2023-11-30 13:45:34 -08:00
ishaan-jaff
cc0df56bd6 (chore) remove old doc -> this is now Router 2023-11-30 13:33:17 -08:00
Krrish Dholakia
82553e8aac fix(azure.py): fix linting errors 2023-11-30 13:32:29 -08:00
ishaan-jaff
9a1accfe2a (chore) proxy: remove junk load test 2023-11-30 13:31:23 -08:00
Krrish Dholakia
1f3ef72a4b bump: version 1.8.1 → 1.9.0 2023-11-30 13:19:49 -08:00
Krrish Dholakia
4f07c8565a feat(main.py): add support for azure-openai via cloudflare ai gateway 2023-11-30 13:19:49 -08:00
ishaan-jaff
be8bdb580a (test) proxy + router: add bursty load test 2023-11-30 13:17:11 -08:00
ishaan-jaff
a8a6838867 (docs) example: azure config.yaml 2023-11-30 13:16:41 -08:00
ishaan-jaff
97ff0caf70 (feat) proxy: config - azure allow users to pass in base_url 2023-11-30 10:56:55 -08:00
ishaan-jaff
908c32c9c1 (docs) librechat + proxy 2023-11-30 10:47:16 -08:00
ishaan-jaff
fe6ff7cf10 (docs) proxy + librechat 2023-11-30 10:46:48 -08:00
Krrish Dholakia
aea74758e6 docs(simple_proxy.md): improve librechat tutorial 2023-11-30 10:19:18 -08:00
Krrish Dholakia
3d850337a2 docs(routing.md): shoutout sweep on load balancing docs 2023-11-30 09:35:28 -08:00
Ishaan Jaff
e3d37b9bdc
Update proxy_server_config.yaml 2023-11-30 09:30:41 -08:00
Ishaan Jaff
94fd2e3227
Update Dockerfile 2023-11-30 09:27:42 -08:00
Ishaan Jaff
a965c4dfb1
Update proxy_server_config.yaml 2023-11-30 09:26:54 -08:00
Krrish Dholakia
062ede96e3 refactor(proxy_server.py): fix linting issues 2023-11-30 09:24:59 -08:00
ishaan-jaff
cbc358ef77 (docs) proxy: Render deploys 2023-11-30 09:21:07 -08:00
Krrish Dholakia
b4b7acdb72 fix(utils.py): fix azure completion cost calculation 2023-11-30 09:19:35 -08:00
Krrish Dholakia
7ee089b5ca fix(proxy_server.py): provide an endpoint that gives model-specific info from proxy 2023-11-30 09:08:19 -08:00
Ishaan Jaff
f742d14582
Update Dockerfile 2023-11-30 09:03:04 -08:00
Ishaan Jaff
57df87120a
Update Dockerfile 2023-11-30 09:00:23 -08:00
Ishaan Jaff
6fddd078b9
Update Dockerfile 2023-11-30 08:57:44 -08:00
Ishaan Jaff
96151cf260
Update Dockerfile 2023-11-30 08:57:10 -08:00
ishaan-jaff
a56d4a1e83 (fix) proxy: print cwd() 2023-11-30 08:52:06 -08:00
Ishaan Jaff
1772da92c0
Update Dockerfile 2023-11-30 08:46:38 -08:00