Commit graph

997 commits

Author SHA1 Message Date
Krrish Dholakia
80821f62d1 docs(logging.md): add sentry logging to proxy docs 2023-12-09 23:03:48 -08:00
Krrish Dholakia
149c1b3557 docs(configs.md): added docs on how to configure routing strategy on proxy 2023-12-09 16:31:31 -08:00
ishaan-jaff
adbdb31b9d (docs) proxy caching 2023-12-09 15:56:57 -08:00
ishaan-jaff
9e9781d193 (Docs) Proxy,remove traceloop api key req 2023-12-08 19:26:05 -08:00
ishaan-jaff
dface6a36f (docs) traceloop 2023-12-08 18:47:18 -08:00
ishaan-jaff
0dc7d538b5 (docs) proxy - OTEL + traceloop 2023-12-08 18:39:52 -08:00
ishaan-jaff
b84f6670ea (docs) custom callbacks proxy 2023-12-08 18:00:58 -08:00
ishaan-jaff
34428a8e67 (docs) fix 2023-12-08 17:25:05 -08:00
ishaan-jaff
977bfaaab9 (docs) proxy - get model_info,server_request 2023-12-08 14:57:29 -08:00
Krrish Dholakia
2ede903f0b docs: fix imports 2023-12-08 07:39:13 -08:00
Krrish Dholakia
d548836903 docs: add proxy req/s 2023-12-08 07:33:33 -08:00
Krrish Dholakia
0406e01c6d docs(deploy.md): add proxy perf to docs 2023-12-08 07:32:23 -08:00
Krrish Dholakia
e5638e2c5d fix(router.py): fix default caching response value 2023-12-07 13:44:31 -08:00
Krrish Dholakia
7585b58d2d docs: sagemaker embedding model added to docs 2023-12-07 11:42:51 -08:00
Krrish Dholakia
db12ca4ecb docs(bedrock.md): add cohere embeddings to bedrock docs 2023-12-07 11:35:08 -08:00
Krrish Dholakia
2134285523 docs(quick_start.md): adding gunicorn worker script to docs 2023-12-07 11:31:54 -08:00
Krrish Dholakia
d77e0cc716 docs(config.md): adding docs on parallel request rate limiting 2023-12-07 11:27:48 -08:00
Krrish Dholakia
c7aaa4adf8 docs(deploy.md): add docker instructions to deploy docs 2023-12-07 09:22:54 -08:00
Krrish Dholakia
d18a5e8a11 docs(quick_start.md): adding langchain embedding tutorials to docs 2023-12-06 23:14:02 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
ishaan-jaff
cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00
Krrish Dholakia
f6546076b0 docs(quick_start.md): add docs on calling openai-compatible endpoint on proxy 2023-12-06 11:06:09 -08:00
Krrish Dholakia
37251d327d docs(virtual_keys.md): add custom auth to docs 2023-12-06 10:29:52 -08:00
Ayush Somani
f0df1fade7
(docs) update docs 2023-12-06 10:38:52 +05:30
Ayush Somani
0bf3de0a01
(docs) update docker compose docs 2023-12-06 10:37:45 +05:30
Ayush Somani
b0fcc5af67
Merge branch 'main' into main 2023-12-06 10:32:59 +05:30
Krrish Dholakia
e4fae5a3e8 docs(aws_sagemaker.md): support for all huggingface/jumpstart modelsn 2023-12-05 16:59:37 -08:00
Krrish Dholakia
1addaecf48 docs(aws_sagemaker.md): add hf_model_name to sagemaker docs 2023-12-05 16:58:19 -08:00
Krrish Dholakia
ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
ishaan-jaff
4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff
e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff
a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff
41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff
f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
ishaan-jaff
05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff
acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff
3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
Krrish Dholakia
7adb8f493d docs(custom_callback.md): add async callbacks to docs 2023-12-04 17:01:46 -08:00
Krish Dholakia
b90fcbdac4
Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff
bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff
74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff
6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff
333e77d161 (docs) custom logger 2023-12-04 11:44:12 -08:00
ishaan-jaff
533b5bcc44 (docs) clean up proxy logging 2023-12-04 11:37:15 -08:00
ishaan-jaff
85ac2b179a (docs) custom logger: proxy 2023-12-04 11:30:09 -08:00
ishaan-jaff
c5b92837c2 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
Krrish Dholakia
31d9762b50 fix(model_management.md): add docs on model management on proxy 2023-12-04 09:36:45 -08:00