Commit graph

3803 commits

Author SHA1 Message Date
Krrish Dholakia
f9ac71a45a docs(simple_proxy.md): add loading api keys from key vault to proxy docs 2023-11-25 12:15:11 -08:00
ishaan-jaff
c9fdf25c94 (docs) proxy embedding config 2023-11-25 12:14:19 -08:00
ishaan-jaff
f3fff173d2 (docs) custom openai embedding model config 2023-11-25 12:11:25 -08:00
Krrish Dholakia
dac76a4861 fix(utils.py): fix embedding response output parsing 2023-11-25 12:06:57 -08:00
ishaan-jaff
62d8f9ad2a (docs) simple proxy - reorder configs 2023-11-25 11:59:57 -08:00
ishaan-jaff
c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
ishaan-jaff
fed620b202 (test) metadata test in embedding 2023-11-25 11:10:06 -08:00
ishaan-jaff
565d51a4b4 (test) metadata test in litellm.completion 2023-11-25 11:10:06 -08:00
ishaan-jaff
6baaf629e5 (fix) embedding: filter out metadata from optional_params 2023-11-25 11:10:06 -08:00
ishaan-jaff
2e08acba93 (feat) embedding: better logging 2023-11-25 11:10:06 -08:00
ishaan-jaff
77a9eb8a77 (feat) logging: for embedding openai.py 2023-11-25 11:10:06 -08:00
Krrish Dholakia
7cf029d677 docs(simple_proxy.md): update simple proxy docs 2023-11-25 10:18:40 -08:00
ishaan-jaff
fbcdbf3a82 (fix) test embedding 2023-11-24 20:46:35 -08:00
ishaan-jaff
d9e1267b24 (fix) embedding test 2023-11-24 18:28:38 -08:00
ishaan-jaff
785c024324 (test) fix embedding 2023-11-24 18:14:06 -08:00
ishaan-jaff
dca0a5ad0f (test) load test embedding: proxy 2023-11-24 17:14:44 -08:00
ishaan-jaff
1c5b3ad764 (docs) proxy 2023-11-24 17:09:38 -08:00
ishaan-jaff
111c7afaca (docs) proxy performance 2023-11-24 17:07:46 -08:00
ishaan-jaff
ad1672b901 (test) fix embedding tests 2023-11-24 17:04:59 -08:00
ishaan-jaff
23466107a7 (feat) 10x faster embeddings 2023-11-24 17:02:57 -08:00
Krrish Dholakia
6738044170 bump: version 1.6.0 → 1.7.0 2023-11-24 16:05:59 -08:00
Krrish Dholakia
e732fb8b97 fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
Krrish Dholakia
d62da29cbe fix: fix linting issues 2023-11-24 15:46:25 -08:00
Krrish Dholakia
fe900966c1 docs(simple_proxy.md): adding tracking spend via proxy to docs 2023-11-24 15:41:52 -08:00
Krrish Dholakia
1a6ea20a0b fix(main.py): fixing linting issues 2023-11-24 15:25:51 -08:00
Krrish Dholakia
bc84b38154 feat(proxy_server.py): new /key/info endpoint to access key information (master key only) 2023-11-24 15:24:50 -08:00
Krrish Dholakia
4f22e7de18 feat(proxy_server.py): tracking spend per api key 2023-11-24 15:14:06 -08:00
Krrish Dholakia
2b52e6995c docs(perplexity.md): fix model list
https://github.com/BerriAI/litellm/issues/908
2023-11-24 14:14:47 -08:00
ishaan-jaff
41c6388185 (test) completion with many params 2023-11-24 14:01:21 -08:00
ishaan-jaff
a6bea946b3 (fix) completion: when logit bias is None 2023-11-24 14:01:21 -08:00
ishaan-jaff
0f873c756d (fix) completion: OpenAI/Azure filter out None params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
f1dbdb58bb docs(simple_proxy.md): add cooldown to docs 2023-11-24 13:37:16 -08:00
Krrish Dholakia
2686894823 fix(router.py): fix retry logic 2023-11-24 13:27:44 -08:00
Krrish Dholakia
16e1070dbe test: refactor testing order 2023-11-24 12:47:28 -08:00
Krrish Dholakia
2a033fd8a2 test(test_router_cooldowns.py): adding logging 2023-11-24 12:30:08 -08:00
Krrish Dholakia
12dbdc4c15 docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy 2023-11-24 12:20:38 -08:00
Krrish Dholakia
3dcbf6197a test(test_router.py): reintegrate router testing 2023-11-24 11:48:24 -08:00
Krrish Dholakia
c75e90663c test(test_stream_chunk_builder.py): fix setting api key 2023-11-24 11:47:48 -08:00
Krrish Dholakia
2e8d582a34 fix(proxy_server.py): fix linting issues 2023-11-24 11:39:01 -08:00
Krish Dholakia
d3d8b86eaa Updated config.yml 2023-11-24 11:34:24 -08:00
Krrish Dholakia
4a5dae3941 fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
ishaan-jaff
8edfcd8e5d (fix) prisma using: secrets.compare_digest 2023-11-24 10:02:08 -08:00
Ishaan Jaff
86e405c9ab
Merge pull request #904 from Manouchehri/fix-auth-1
Fix OpenAPI auth spec.
2023-11-24 09:44:30 -08:00
Ishaan Jaff
2e140fe56a
Merge pull request #903 from kumaranvpl/main
Fix wrong model mentioned in simple proxy doc page
2023-11-24 09:39:06 -08:00
David Manouchehri
ac08e3616c
Fix timing attack on master_key. 2023-11-24 12:12:29 -05:00
David Manouchehri
5b6f227170
Fix master key check. 2023-11-24 12:03:30 -05:00
David Manouchehri
3fa3a767b3
Fix OpenAPI auth spec. 2023-11-24 11:59:33 -05:00
Kumaran Rajendhiran
d695e9dfdd Fix minor README issue 2023-11-24 19:53:51 +05:30
Kumaran Rajendhiran
79569e4f2c Fix wrong model mentioned in simple proxy doc page 2023-11-24 19:46:35 +05:30
ishaan-jaff
0a23af7990 (feat) proxy: cost tracking add track_cost_callback 2023-11-24 05:53:23 -08:00