Commit graph

3232 commits

Author SHA1 Message Date
Krrish Dholakia
a09a6f24a4 fix(together_ai.py): additional logging for together ai encoding prompt 2023-12-15 10:39:23 -08:00
Krrish Dholakia
cab870f73a fix(ollama.py): fix ollama async streaming for /completions calls 2023-12-15 09:28:32 -08:00
ishaan-jaff
c9fb4ba88c (feat) proxy - use async langfuse logger 2023-12-15 21:57:12 +05:30
ishaan-jaff
7915a5a120 (feat) langfuse add _async_log_event 2023-12-15 21:46:32 +05:30
ishaan-jaff
003cf92af3 (test) dynamodb set table name 2023-12-15 21:39:03 +05:30
ishaan-jaff
9bdd6e73bb (feat) proxy logs: dynamodb - set table name 2023-12-15 21:38:44 +05:30
ishaan-jaff
99c505dba6 (fix) make dynamo logger async for proxy 2023-12-15 18:52:09 +05:30
ishaan-jaff
fa57a6d1f8 (fix) async + stream +sync logging 2023-12-15 18:31:36 +05:30
ishaan-jaff
6af3e73495 (fix) async+stream logger - building complete resp 2023-12-15 18:13:29 +05:30
ishaan-jaff
6c58fe65ff (feat) dynamo db - log call_type 2023-12-15 17:27:48 +05:30
ishaan-jaff
cec7fcee2c (test) dynamo logger 2023-12-15 17:22:21 +05:30
ishaan-jaff
8cfa233b74 (test) dynamo logger 2023-12-15 17:22:07 +05:30
ishaan-jaff
e35f0cbbdc (feat) dynamo logger - all payload vals are str 2023-12-15 17:00:38 +05:30
ishaan-jaff
15b1e758ab (test) dynamo db writes 2023-12-15 16:43:33 +05:30
ishaan-jaff
6b0f61f29b (fix) dynamo.py spelling 2023-12-15 16:07:42 +05:30
ishaan-jaff
8b75d30a77 (test) dynamo db logger 2023-12-15 15:36:29 +05:30
ishaan-jaff
dacc95614c (utils) add dynamoDB logger 2023-12-15 15:36:00 +05:30
ishaan-jaff
98662d1f59 (feat) add dynamoDB logger 2023-12-15 15:35:35 +05:30
ishaan-jaff
4413ef6dd2 (test) proxy - AuthError Exception mapping 2023-12-15 14:10:42 +05:30
ishaan-jaff
33afbd6ff5 (fix) raise openai.NotFoundError 2023-12-15 14:03:50 +05:30
ishaan-jaff
0b4f1dee42 (feat) proxy: embeddings-add OpenAI exception mapping 2023-12-15 14:02:24 +05:30
ishaan-jaff
d797bb100f (test) proxy - exception mapping openai.NotFoundError 2023-12-15 13:34:51 +05:30
ishaan-jaff
13eafa52e9 (feat) add openai.NotFoundError exception mapping 2023-12-15 13:33:03 +05:30
ishaan-jaff
9826fd6c98 (test) raise NotFoundError 2023-12-15 10:18:53 +05:30
ishaan-jaff
353433e5ce (feat) add openai.NotFoundError 2023-12-15 10:18:02 +05:30
ishaan-jaff
4fd59c5847 (feat) add BadRequestError for Azure 2023-12-15 09:53:56 +05:30
ishaan-jaff
191c1d2887 (feat) add BadRequestError for Azure 2023-12-15 09:53:38 +05:30
ishaan-jaff
8451badaa1 (test) proxy - Auth Error 2023-12-15 09:36:17 +05:30
ishaan-jaff
cc85aa9af3 (test) proxy - raise openai.AuthenticationError 2023-12-15 09:36:07 +05:30
ishaan-jaff
f09ce1d316 (test) proxy - test exception mapping 2023-12-15 08:28:12 +05:30
ishaan-jaff
85a3c67574 (feat) - acompletion, correct exception mapping 2023-12-15 08:28:12 +05:30
Krrish Dholakia
adaf341f54 fix(proxy_server.py): allow post-call rules to be passed in as a file 2023-12-14 18:21:09 -08:00
ishaan-jaff
ad18ab2144 (fix) utils - delete remove_model_id 2023-12-15 07:07:53 +05:30
ishaan-jaff
fff148a835 (test) router_get_deployments - stop using remove_model_id 2023-12-15 07:07:53 +05:30
ishaan-jaff
0a6f6bd045 (test) test_cooldown_same_model_name 2023-12-15 07:07:53 +05:30
ishaan-jaff
b6a78cd349 (feat) router - remove confusing -ModelID-XXXX 2023-12-15 07:07:53 +05:30
Krrish Dholakia
e1679a44da fix(utils.py): improved togetherai exception mapping 2023-12-14 15:28:11 -08:00
Krrish Dholakia
804d58eb20 bump: version 1.14.4 → 1.14.5.dev1 2023-12-14 15:23:52 -08:00
Krrish Dholakia
e45b491985 fix(main.py): log user for embedding calls 2023-12-14 15:14:37 -08:00
Krrish Dholakia
03dd7bff13 test(test_proxy_server.py): add testing for sagemaker embeddings to proxy server tests 2023-12-14 14:38:27 -08:00
Krrish Dholakia
51d62189f1 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00
Krrish Dholakia
2a4c1a1803 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
1608dd7e0b fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
0f14fb3797 docs(custom_callback.md): add async failure + streaming logging events to docs
https://github.com/BerriAI/litellm/issues/1125
2023-12-14 10:46:53 -08:00
Krish Dholakia
a6e78497b5
Merge pull request #1122 from emsi/main
Fix #1119, no content when streaming.
2023-12-14 10:01:00 -08:00
Krrish Dholakia
db8d793618 fix(proxy_server.py): handle scenario where no json body is passed in - e.g. GET request
https://github.com/BerriAI/litellm/issues/1062
2023-12-14 09:57:35 -08:00
Krrish Dholakia
6cdcc1370f test(test_custom_callback_router.py): fix testing 2023-12-14 09:57:35 -08:00
ishaan-jaff
4b3ef49d60 (fix) linting 2023-12-14 22:35:29 +05:30
ishaan-jaff
17c3a1393b (feat) control caching for embedding, completion 2023-12-14 22:31:04 +05:30
ishaan-jaff
9ee16bc962 (feat) caching - add supported call types 2023-12-14 22:27:14 +05:30