Commit graph

914 commits

Author SHA1 Message Date
ishaan-jaff
c1914a01bc (docs) routing 2023-11-29 18:09:39 -08:00
ishaan-jaff
f299120394 (docs) router 2023-11-29 18:08:00 -08:00
ishaan-jaff
69eca78000 (docs) simple proxy 2023-11-29 16:44:40 -08:00
ishaan-jaff
4b78481fbd (docs) simple proxy 2023-11-29 16:38:36 -08:00
ishaan-jaff
2d0432c5b7 (docs) simple proxy 2023-11-29 16:36:07 -08:00
ishaan-jaff
3b89cff65e (docs) simple proxy 2023-11-29 16:33:00 -08:00
ishaan-jaff
032cd0121b (docs) simple proxy 2023-11-29 16:31:08 -08:00
Krrish Dholakia
cd2883065a docs(stream.md): add stream chunk builder helper function to docs 2023-11-28 08:58:35 -08:00
ishaan-jaff
30b80afe31 (docs) fix local debugging 2023-11-28 08:49:14 -08:00
ishaan-jaff
d7dd9f0307 (docs) health check proxy llms 2023-11-27 12:20:15 -08:00
ishaan-jaff
f54c4ee4b8 (docs) sagemaker add chat llms 2023-11-27 10:24:32 -08:00
Krrish Dholakia
59ba1560e5 fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia
ec81b393e2 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia
69a3b6b8cf docs(simple_proxy.md): improve loading key from vault example 2023-11-25 12:18:35 -08:00
Krrish Dholakia
f9ac71a45a docs(simple_proxy.md): add loading api keys from key vault to proxy docs 2023-11-25 12:15:11 -08:00
ishaan-jaff
c9fdf25c94 (docs) proxy embedding config 2023-11-25 12:14:19 -08:00
ishaan-jaff
f3fff173d2 (docs) custom openai embedding model config 2023-11-25 12:11:25 -08:00
ishaan-jaff
62d8f9ad2a (docs) simple proxy - reorder configs 2023-11-25 11:59:57 -08:00
ishaan-jaff
c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
Krrish Dholakia
7cf029d677 docs(simple_proxy.md): update simple proxy docs 2023-11-25 10:18:40 -08:00
ishaan-jaff
1c5b3ad764 (docs) proxy 2023-11-24 17:09:38 -08:00
ishaan-jaff
111c7afaca (docs) proxy performance 2023-11-24 17:07:46 -08:00
Krrish Dholakia
fe900966c1 docs(simple_proxy.md): adding tracking spend via proxy to docs 2023-11-24 15:41:52 -08:00
Krrish Dholakia
2b52e6995c docs(perplexity.md): fix model list
https://github.com/BerriAI/litellm/issues/908
2023-11-24 14:14:47 -08:00
Krrish Dholakia
f1dbdb58bb docs(simple_proxy.md): add cooldown to docs 2023-11-24 13:37:16 -08:00
Krrish Dholakia
12dbdc4c15 docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy 2023-11-24 12:20:38 -08:00
Kumaran Rajendhiran
79569e4f2c Fix wrong model mentioned in simple proxy doc page 2023-11-24 19:46:35 +05:30
Krrish Dholakia
f24786095a fix(vertex_ai.py): fix exception mapping for vertex ai 2023-11-23 17:35:33 -08:00
Krrish Dholakia
2cc6acdeec docs(routing.md): add docs on fallbacks, caching, retries, timeouts for router 2023-11-23 17:17:18 -08:00
Krrish Dholakia
abe2a009f9 test(test_completion.py): fix azure read from env variable test 2023-11-23 16:58:07 -08:00
ishaan-jaff
65d978622d (docs) proxy 2023-11-23 11:46:59 -08:00
Krrish Dholakia
276041e3bb docs(routing.md): updating routing docs to include cooldown info 2023-11-23 11:27:22 -08:00
Krrish Dholakia
61fc76a8c4 fix(router.py): fix caching for tracking cooldowns + usage 2023-11-23 11:13:32 -08:00
ishaan-jaff
94c1d71b2c (docs) proxy server 2023-11-23 11:13:26 -08:00
ishaan-jaff
28a192df3a (docs) simple proxy 2023-11-23 11:10:50 -08:00
ishaan-jaff
71042ee345 (docs) caching 2023-11-23 10:40:32 -08:00
ishaan-jaff
efe6fb8831 (docs) proxy server caching 2023-11-23 10:35:34 -08:00
ishaan-jaff
b15b723567 (docs) proxy server: add caching 2023-11-23 08:08:12 -08:00
ishaan-jaff
44e867499f (docs) proxy 2023-11-23 07:55:12 -08:00
ishaan-jaff
1af7575c86 (docs) rename reliability -> Fallbacks, num retries 2023-11-22 20:55:53 -08:00
ishaan-jaff
4ece219ec5 (docs) simple proxy 2023-11-22 15:01:26 -08:00
ishaan-jaff
d0f11e7a13 (docs) input params for litellm.embedding() 2023-11-22 14:40:52 -08:00
Krrish Dholakia
b0801f61e6 test(test_caching.py): cleaning up tests 2023-11-22 13:43:48 -08:00
ishaan-jaff
7a4be44805 (docs) request q 2023-11-22 08:10:30 -08:00
ishaan-jaff
898f15af2b (docs) update routing with api.litellm.ai 2023-11-21 19:54:29 -08:00
Krrish Dholakia
826f56a6a0 docs(routing.md): update routing docs 2023-11-21 19:32:50 -08:00
Krrish Dholakia
9d97082eed docs(routing.md): add queueing to docs 2023-11-21 18:01:02 -08:00
ishaan-jaff
dcc60ae31a (docs) routing 2023-11-21 17:22:06 -08:00
ishaan-jaff
8b8e5890e3 (docs) routing 2023-11-21 17:20:24 -08:00
ishaan-jaff
da90d01d04 (docs) proxy 2023-11-21 16:59:33 -08:00