phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3074 commits 2497 branches 897 tags 550 MiB
Commit graph

216 commits

Author SHA1 Message Date
ishaan-jaff
c2b263e66d (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
1affa89ad7 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia
272a6dc9b0 refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
9b278f567b refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
1d46891ceb fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
4206f95256 refactor(azure.py): fix linting errors 2023-11-08 19:24:53 -08:00
Krrish Dholakia
678249ee09 refactor(azure.py): moving embeddings to http call 2023-11-08 19:07:21 -08:00
Krrish Dholakia
880768f83d refactor(openai.py): moving embedding calls to http 2023-11-08 19:01:17 -08:00
Krrish Dholakia
e66373bd47 refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
decf86b145 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
17f5e46080 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
ishaan-jaff
edccfbb1da (fix) remove errant print from hf 2023-11-08 11:49:15 -08:00
Krrish Dholakia
81953f1025 (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
ishaan-jaff
e7b6ef8f50 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
Krrish Dholakia
9baafd7dbf fix(huggingface_restapi.py): output parsing chat template models 2023-11-06 11:43:12 -08:00
Krrish Dholakia
d53a0d9663 refactor(bedrock.py): better exception mapping for bedrock + huggingface 2023-11-04 16:12:12 -07:00
Krrish Dholakia
b1dcd0f1b9 fix(timeout.py): import errors 2023-11-04 16:05:14 -07:00
Krrish Dholakia
f7c5595a0d fix(main.py): fixing print_verbose 2023-11-04 14:41:34 -07:00
Krrish Dholakia
d0b23a2722 refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions 2023-11-04 12:50:15 -07:00
Krrish Dholakia
64b6b0155d fix(bedrock.py): add exception mapping coverage for authentication scenarios 2023-11-03 18:25:34 -07:00
Krrish Dholakia
8bf8464fc2 fix(bedrock.py): fix bedrock exception mapping 2023-11-03 18:14:12 -07:00
ishaan-jaff
10f72f0f4a (fix) bedrock: remove check for - if "error" in outputText 2023-11-03 18:06:23 -07:00
ishaan-jaff
d278417682 (fix) hf calculating usage non blocking 2023-11-03 18:03:19 -07:00
Krrish Dholakia
fa24a61976 refactor(proxy_server.py): print statement showing how to add debug for logs 2023-11-03 17:41:14 -07:00
ishaan-jaff
ee60c04251 (fix) remove errant print statements 2023-11-03 13:02:52 -07:00
ishaan-jaff
838e261ab9 (fix) remove errant tg ai print statements 2023-11-03 12:59:23 -07:00
ishaan-jaff
fbd5117a6d (fix) vertex ai streaming 2023-11-03 12:54:36 -07:00
Krrish Dholakia
127972a80b build(litellm_server/utils.py): add support for general settings + num retries as a module variable 2023-11-02 20:56:41 -07:00
Krrish Dholakia
33c1118080 feat(completion()): enable setting prompt templates via completion() 2023-11-02 16:24:01 -07:00
ishaan-jaff
36a2266382 (feat) add setting input_type for cohere 2023-11-02 10:16:35 -07:00
ishaan-jaff
d100bfdc2e (fix) improve cohere error handling 2023-11-02 10:07:11 -07:00
Krrish Dholakia
8475772daa fix(huggingface_restapi.py): fix linting issue 2023-11-01 16:43:35 -07:00
Krrish Dholakia
80cb421e02 fix(huggingface_restapi.py): fix embeddings for sentence-transformer models 2023-11-01 16:36:46 -07:00
ishaan-jaff
0668d8d81e (feat) embedding() add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
ishaan-jaff
c6229b7113 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
ishaan-jaff
525e5476f6 (feat) textcompletion - transform hf log probs to openai text completion 2023-10-31 17:15:35 -07:00
Krish Dholakia
ed8f1ab5dc Merge pull request #717 from canada4663/main 
support for custom bedrock runtime endpoint
 2023-10-31 16:47:33 -07:00
Krrish Dholakia
147d69f230 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
canada4663
49033bbe27 add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client 2023-10-28 22:25:45 -07:00
canada4663
46ef5a94b9 add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available 2023-10-28 21:43:48 -07:00
ishaan-jaff
75d45c27c1 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
485a7ff136 (feat) use usage class for model responses for cohere, hf, tg ai, cohere 2023-10-27 09:58:47 -07:00
ishaan-jaff
194b6263c7 (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
ishaan-jaff
66e934b0ad (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
ishaan-jaff
a9331edfd9 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00
Krrish Dholakia
98c25b08cd fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
5e83c34913 fix(vertex_ai.py): parse out text response from response object 2023-10-24 08:53:22 -07:00
Krrish Dholakia
2f9e112c14 fix(anthropic.py-+-bedrock.py): anthropic prompt format 2023-10-20 10:56:15 -07:00
Krrish Dholakia
18a6facdb3 fix: allow api base to be set for all providers 
enables proxy use cases
 2023-10-19 19:07:42 -07:00
Krrish Dholakia
a415c79b8b fix(anthropic.py): enable api base to be customized 2023-10-19 18:45:29 -07:00