Commit graph

4681 commits

Author SHA1 Message Date
ishaan-jaff
55e2beeaf1 (feat) add gemini pro vision 2023-12-16 18:35:28 +05:30
ishaan-jaff
db188507b9 (test) gemini pro vision 2023-12-16 18:31:55 +05:30
ishaan-jaff
774a725ccb (feat) add vertex ai gemini-pro-vision 2023-12-16 18:31:03 +05:30
ishaan-jaff
7b851a3870 (docs) cache params 2023-12-16 14:45:19 +05:30
ishaan-jaff
ed0b5d29b0 (test) proxy - cache config 2023-12-16 14:45:06 +05:30
ishaan-jaff
6b7d0eada4 (feat) proxy - set cache configs on proxy 2023-12-16 14:44:39 +05:30
ishaan-jaff
80bf99b1af (docs) proxy - advanced caching 2023-12-16 13:52:58 +05:30
ishaan-jaff
a04f43ef38 (docs) proxy: embeddings 2023-12-16 13:29:26 +05:30
ishaan-jaff
cc483ad69d (docs) embedding config yaml 2023-12-16 13:14:26 +05:30
ishaan-jaff
20b5505476 (feat) show POST request for HF embeddings 2023-12-16 13:09:49 +05:30
ishaan-jaff
4316477276 (docs) embedding 2023-12-16 12:44:21 +05:30
ishaan-jaff
37bf94dcdf (fix) proxy remove errant print 2023-12-16 12:26:02 +05:30
Krrish Dholakia
f9ee9a8276 bump: version 1.14.10 → 1.15.0 2023-12-15 21:54:20 -08:00
Krrish Dholakia
5b4ca42de6 docs(routing.md): add docs on using caching groups across deployments 2023-12-15 21:51:59 -08:00
Krrish Dholakia
84ad9f441e feat(router.py): support caching groups 2023-12-15 21:45:51 -08:00
ishaan-jaff
a7822b8772 (test) ollama-local, add llava test 2023-12-16 10:35:43 +05:30
ishaan-jaff
287633887e (feat) add ollama/llava 2023-12-16 10:35:27 +05:30
Krrish Dholakia
add153d110 fix(huggingface_restapi.py): add support for additional hf embedding formats 2023-12-15 21:02:41 -08:00
Krrish Dholakia
5fe5149070 refactor(test_router_caching.py): add tests for router caching 2023-12-15 20:38:51 -08:00
Krrish Dholakia
4d8376a8e9 fix(router.py): init clients for azure/openai on set_model_list 2023-12-15 20:23:29 -08:00
Krrish Dholakia
4791dda66f feat(proxy_server.py): enable infinite retries on rate limited requests 2023-12-15 20:03:41 -08:00
Krrish Dholakia
e5268fa6bc fix(router.py): support openai-compatible endpoints 2023-12-15 14:47:54 -08:00
Krrish Dholakia
d2e9798de9 fix(router.py): adding mistral to list of openai-compatible endpoints 2023-12-15 14:24:43 -08:00
Krrish Dholakia
69f545cf36 bump: version 1.14.8 → 1.14.9 2023-12-15 10:46:46 -08:00
Krrish Dholakia
edb88e31e4 fix(together_ai.py): return empty tgai responses 2023-12-15 10:46:35 -08:00
Krrish Dholakia
a09a6f24a4 fix(together_ai.py): additional logging for together ai encoding prompt 2023-12-15 10:39:23 -08:00
Krrish Dholakia
cab870f73a fix(ollama.py): fix ollama async streaming for /completions calls 2023-12-15 09:28:32 -08:00
ishaan-jaff
c9fb4ba88c (feat) proxy - use async langfuse logger 2023-12-15 21:57:12 +05:30
ishaan-jaff
7915a5a120 (feat) langfuse add _async_log_event 2023-12-15 21:46:32 +05:30
ishaan-jaff
707cd0364e bump: version 1.14.7 → 1.14.8 2023-12-15 21:40:36 +05:30
ishaan-jaff
bb930b6660 (docs) dynamodb 2023-12-15 21:39:12 +05:30
ishaan-jaff
003cf92af3 (test) dynamodb set table name 2023-12-15 21:39:03 +05:30
ishaan-jaff
9bdd6e73bb (feat) proxy logs: dynamodb - set table name 2023-12-15 21:38:44 +05:30
ishaan-jaff
3f89edca20 bump: version 1.14.6 → 1.14.7 2023-12-15 18:52:28 +05:30
ishaan-jaff
99c505dba6 (fix) make dynamo logger async for proxy 2023-12-15 18:52:09 +05:30
ishaan-jaff
fa57a6d1f8 (fix) async + stream +sync logging 2023-12-15 18:31:36 +05:30
ishaan-jaff
ae10299058 (docs) dynamo 2023-12-15 18:20:15 +05:30
ishaan-jaff
6af3e73495 (fix) async+stream logger - building complete resp 2023-12-15 18:13:29 +05:30
ishaan-jaff
b14e75773e bump: version 1.14.5 → 1.14.6 2023-12-15 17:56:33 +05:30
ishaan-jaff
0f4fa487a5 (docs) dynamodb 2023-12-15 17:32:21 +05:30
ishaan-jaff
6c58fe65ff (feat) dynamo db - log call_type 2023-12-15 17:27:48 +05:30
ishaan-jaff
cec7fcee2c (test) dynamo logger 2023-12-15 17:22:21 +05:30
ishaan-jaff
8cfa233b74 (test) dynamo logger 2023-12-15 17:22:07 +05:30
ishaan-jaff
e35f0cbbdc (feat) dynamo logger - all payload vals are str 2023-12-15 17:00:38 +05:30
ishaan-jaff
42bc170579 (chore) add dynamo.log to gitignore 2023-12-15 16:59:49 +05:30
ishaan-jaff
15b1e758ab (test) dynamo db writes 2023-12-15 16:43:33 +05:30
ishaan-jaff
6b0f61f29b (fix) dynamo.py spelling 2023-12-15 16:07:42 +05:30
ishaan-jaff
eaf4182966 (docs) log proxy i/o to dynamoDB 2023-12-15 15:59:06 +05:30
ishaan-jaff
8b75d30a77 (test) dynamo db logger 2023-12-15 15:36:29 +05:30
ishaan-jaff
dacc95614c (utils) add dynamoDB logger 2023-12-15 15:36:00 +05:30