phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21468 commits 2480 branches 894 tags 534 MiB
Commit graph

2221 commits

Author SHA1 Message Date
ishaan-jaff
4c3765119b (fix) replicate print verbose 2023-11-10 12:46:33 -08:00
ishaan-jaff
49c7c851a8 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
ishaan-jaff
00e1b46e68 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
Krrish Dholakia
18a8bd5543 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
ishaan-jaff
2f07460333 (feat) completion ollama raise exception when ollama resp != 200 2023-11-10 08:54:05 -08:00
ishaan-jaff
d0c9bfd14a (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
b9e6989e41 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
86ef2a02f7 fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
7c5fd5824b refactor(azure.py): fix linting errors 2023-11-08 19:24:53 -08:00
Krrish Dholakia
6f4707bbb3 refactor(azure.py): moving embeddings to http call 2023-11-08 19:07:21 -08:00
Krrish Dholakia
70311502c8 refactor(openai.py): moving embedding calls to http 2023-11-08 19:01:17 -08:00
Krrish Dholakia
c2cbdb23fd refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
c57ed0a9d7 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
53abc31c27 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
ishaan-jaff
a404b0fc3b (fix) remove errant print from hf 2023-11-08 11:49:15 -08:00
Krrish Dholakia
ce27e08e7d (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
ishaan-jaff
3c67de7f04 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
Krrish Dholakia
65c01eae23 fix(huggingface_restapi.py): output parsing chat template models 2023-11-06 11:43:12 -08:00
Krrish Dholakia
7c46e85ed6 refactor(bedrock.py): better exception mapping for bedrock + huggingface 2023-11-04 16:12:12 -07:00
Krrish Dholakia
ab54262d37 fix(timeout.py): import errors 2023-11-04 16:05:14 -07:00
Krrish Dholakia
5b3978eff4 fix(main.py): fixing print_verbose 2023-11-04 14:41:34 -07:00
Krrish Dholakia
6b40546e59 refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions 2023-11-04 12:50:15 -07:00
Krrish Dholakia
1c4dd0671b fix(bedrock.py): add exception mapping coverage for authentication scenarios 2023-11-03 18:25:34 -07:00
Krrish Dholakia
142750adff fix(bedrock.py): fix bedrock exception mapping 2023-11-03 18:14:12 -07:00
ishaan-jaff
49650af444 (fix) bedrock: remove check for - if "error" in outputText 2023-11-03 18:06:23 -07:00
ishaan-jaff
df57e9247a (fix) hf calculating usage non blocking 2023-11-03 18:03:19 -07:00
Krrish Dholakia
4e1885734a refactor(proxy_server.py): print statement showing how to add debug for logs 2023-11-03 17:41:14 -07:00
ishaan-jaff
6fc0c74878 (fix) remove errant print statements 2023-11-03 13:02:52 -07:00
ishaan-jaff
89e32db321 (fix) remove errant tg ai print statements 2023-11-03 12:59:23 -07:00
ishaan-jaff
6c82abf5bf (fix) vertex ai streaming 2023-11-03 12:54:36 -07:00
Krrish Dholakia
e3a1c58dd9 build(litellm_server/utils.py): add support for general settings + num retries as a module variable 2023-11-02 20:56:41 -07:00
Krrish Dholakia
512a1637eb feat(completion()): enable setting prompt templates via completion() 2023-11-02 16:24:01 -07:00
ishaan-jaff
03860984eb (feat) add setting input_type for cohere 2023-11-02 10:16:35 -07:00
ishaan-jaff
724e169f32 (fix) improve cohere error handling 2023-11-02 10:07:11 -07:00
Krrish Dholakia
b305492a0b fix(huggingface_restapi.py): fix linting issue 2023-11-01 16:43:35 -07:00
Krrish Dholakia
2c4cb76ce5 fix(huggingface_restapi.py): fix embeddings for sentence-transformer models 2023-11-01 16:36:46 -07:00
ishaan-jaff
2ad81bdd7b (feat) embedding() add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
ishaan-jaff
fa7e063198 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
ishaan-jaff
9223f7cc7a (feat) textcompletion - transform hf log probs to openai text completion 2023-10-31 17:15:35 -07:00
Krish Dholakia
523c08a646
Merge pull request #717 from canada4663/main 
support for custom bedrock runtime endpoint
 2023-10-31 16:47:33 -07:00
Krrish Dholakia
0ed3917b09 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
canada4663
bfa297e82f add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client 2023-10-28 22:25:45 -07:00
canada4663
1add0d604e add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available 2023-10-28 21:43:48 -07:00
ishaan-jaff
6515eef382 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
63928fa166 (feat) use usage class for model responses for cohere, hf, tg ai, cohere 2023-10-27 09:58:47 -07:00
ishaan-jaff
194f85e92f (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
ishaan-jaff
3691dc9b08 (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
ishaan-jaff
0a2de59932 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00