Commit graph

28 commits

Author SHA1 Message Date
Ishaan Jaff
8eda374d79 feat log request / response on pass through endpoints 2024-09-04 16:26:32 -07:00
Ishaan Jaff
42b95c5979 code cleanup 2024-09-02 16:36:19 -07:00
Ishaan Jaff
a6d4a27207 pass through track usage for streaming endpoints 2024-09-02 16:11:20 -07:00
Ishaan Jaff
73d0a78444 use chunk_processort 2024-09-02 15:51:52 -07:00
Ishaan Jaff
f50374e81d use helper class for pass through success handler 2024-08-30 15:52:47 -07:00
Ishaan Jaff
bcc0f99476 fix pass through endpoints 2024-08-21 17:21:22 -07:00
Krrish Dholakia
e747127e3b fix(pass_through_endpoints.py): fix query param pass through 2024-08-19 21:38:30 -07:00
Krrish Dholakia
663a0c1b83 feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints 2024-08-17 17:57:43 -07:00
Krrish Dholakia
f7a2e04426 feat(pass_through_endpoints.py): add pass-through support for all cohere endpoints 2024-08-17 16:57:55 -07:00
Krrish Dholakia
db54b66457 style(vertex_httpx.py): make vertex error string more helpful 2024-08-17 15:09:55 -07:00
Krrish Dholakia
fd44cf8d26 feat(pass_through_endpoints.py): support streaming requests 2024-08-17 12:46:57 -07:00
Krrish Dholakia
bc0023a409 feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests
New Feature
2024-08-17 10:46:59 -07:00
Krrish Dholakia
b56ecd7e02 fix(pass_through_endpoints.py): fix returned response headers for pass-through endpoitns 2024-08-17 09:00:00 -07:00
Krrish Dholakia
61f4b71ef7 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Krrish Dholakia
589da45c24 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Krrish Dholakia
28faafadb1 feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints 2024-08-14 21:36:07 -07:00
Krrish Dholakia
742e3cbccf feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth 2024-08-13 20:26:24 -07:00
Ishaan Jaff
ab920ab461 fix pass through endpoint tests 2024-08-06 21:16:07 -07:00
Ishaan Jaff
c277a71c1e init pass through endpoints 2024-08-06 12:04:04 -07:00
Ishaan Jaff
bd1f323297 use helper to forward headers from request 2024-08-06 11:34:10 -07:00
Ishaan Jaff
d1b8c4e08d forward headers from request 2024-08-05 21:45:44 -07:00
Krrish Dholakia
77325358b4 fix(pass_through_endpoints.py): fix client init 2024-07-13 14:46:56 -07:00
Krrish Dholakia
0cc273d77b feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints
Closes https://github.com/BerriAI/litellm/issues/4698
2024-07-13 13:29:44 -07:00
Krrish Dholakia
667fd2b376 docs(pass_through.md): add doc on creating custom chat endpoints on proxy
Allows developers to call proxy with anthropic sdk/boto3/etc.
2024-07-12 18:48:40 -07:00
Ishaan Jaff
c578816434 feat - setting up auth on pass through endpoint 2024-06-29 08:38:44 -07:00
Ishaan Jaff
6af1293384 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
8f2931937a fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Ishaan Jaff
f52cc18adb feat - support pass through endpoints 2024-06-28 15:03:21 -07:00