Commit graph

158 commits

Author SHA1 Message Date
Krrish Dholakia
de3b314620 fix(openai.py): switch to using openai sdk for text completion calls 2024-04-02 15:08:12 -07:00
Krrish Dholakia
ed46af19ec fix(openai.py): return logprobs for text completion calls 2024-04-02 14:05:56 -07:00
Krrish Dholakia
5546f9f10a fix(main.py): support max retries for transcription calls 2024-04-01 18:37:53 -07:00
Krrish Dholakia
e94c4f818c fix(openai.py): return model name with custom llm provider for openai compatible endpoints 2024-03-12 10:30:10 -07:00
Krrish Dholakia
548e9a3590 fix(utils.py): fix model name checking 2024-03-09 18:22:26 -08:00
Krrish Dholakia
b2ce963498 feat: add cost tracking + caching for transcription calls 2024-03-09 15:43:38 -08:00
Krrish Dholakia
5b5f28dee8 fix(openai.py): fix async audio transcription 2024-03-08 23:33:54 -08:00
Krish Dholakia
f461352908 Merge branch 'main' into litellm_load_balancing_transcription_endpoints 2024-03-08 23:08:47 -08:00
Krish Dholakia
75bc854294 Merge pull request #2401 from BerriAI/litellm_transcription_endpoints
feat(main.py): support openai transcription endpoints
2024-03-08 23:07:48 -08:00
Krrish Dholakia
93615682fe feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
Krrish Dholakia
bdf8e2d3c7 feat(main.py): support openai transcription endpoints
enable user to load balance between openai + azure transcription endpoints
2024-03-08 10:25:19 -08:00
ishaan-jaff
1f5b238667 (fix) support name on perplexity/ 2024-03-08 09:41:58 -08:00
Krrish Dholakia
56869b4121 refactor(openai.py): more logging around failed openai calls 2024-02-29 19:30:40 -08:00
ishaan-jaff
1ff241e4b3 (fix) use api_base in health checks 2024-02-24 18:39:20 -08:00
Krrish Dholakia
f04be2ec3f fix(factory.py): mistral message input fix 2024-02-08 20:54:26 -08:00
Krrish Dholakia
85a3515d83 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
ishaan-jaff
2806a2e99f (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
38c6e4194f (feat) OpenAI set organization 2024-01-30 10:54:56 -08:00
Krrish Dholakia
70ff55dd2a fix(openai.py): fix openai image gen logging 2024-01-26 21:05:49 -08:00
Krrish Dholakia
9aaec44dff fix(router.py): fix client init 2024-01-22 22:15:39 -08:00
Krrish Dholakia
db2b7bfd4e fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
0e1ea4325c fix(azure.py): support health checks to text completion endpoints 2024-01-12 00:13:01 +05:30
Krrish Dholakia
556e7d4e1a fix(openai.py): fix exception raising logic 2024-01-09 11:58:30 +05:30
Krrish Dholakia
d105751643 fix(azure.py,-openai.py): raise the correct exceptions for image generation calls 2024-01-09 11:55:38 +05:30
Krrish Dholakia
e4a5a3395c fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions
https://github.com/BerriAI/litellm/issues/1334
2024-01-08 11:40:56 +05:30
Krrish Dholakia
4c7d530c2a fix(openai.py): fix image generation model dump 2024-01-06 17:55:32 +05:30
Krrish Dholakia
807b64e68e perf(azure+openai-files): use model_dump instead of json.loads + model_dump_json 2024-01-06 15:50:05 +05:30
ishaan-jaff
a36b1a4890 (fix) undo - model_dump_json() before logging 2024-01-05 11:47:16 +05:30
ishaan-jaff
6e1ea2c44c (fix) proxy - log response before model_dump_json 2024-01-05 11:00:02 +05:30
Krrish Dholakia
7be5f74b70 fix(aimage_generation): fix response type 2023-12-30 12:53:24 +05:30
Krrish Dholakia
4d239f1e65 fix(openai.py): fix async image gen call 2023-12-30 12:44:54 +05:30
Krrish Dholakia
b69ffb3738 fix: support dynamic timeouts for openai and azure 2023-12-30 12:14:02 +05:30
Krrish Dholakia
7d55a563ee fix(main.py): don't set timeout as an optional api param 2023-12-30 11:47:07 +05:30
Krrish Dholakia
2285282ef8 feat(health_check.py): more detailed health check calls 2023-12-28 09:12:57 +05:30
Krrish Dholakia
fd5e6efb1d fix(azure.py,-openai.py): correctly raise errors if streaming calls fail 2023-12-27 15:08:37 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
a8f997eceb feat(main.py): add async image generation support 2023-12-20 16:58:40 +05:30
Krrish Dholakia
e03713ef74 fix(main.py): return async completion calls 2023-12-18 17:41:54 -08:00
Krrish Dholakia
51cb16a015 feat(main.py): add support for image generation endpoint 2023-12-16 21:07:29 -08:00
Krrish Dholakia
6081602bf8 fix(router.py): support openai-compatible endpoints 2023-12-15 14:47:54 -08:00
ishaan-jaff
fb2d3c9aa6 (feat) - acompletion, correct exception mapping 2023-12-15 08:28:12 +05:30
Krrish Dholakia
bb5b883316 fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
e396fcb55c fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
ishaan-jaff
873ff14990 (chore) remove junk tkinter import 2023-12-12 13:54:50 -08:00
Krrish Dholakia
0cf0c2d6dd fix(router.py): deepcopy initial model list, don't mutate it 2023-12-12 09:54:06 -08:00
Krrish Dholakia
02cfefa257 test(test_custom_callback_input.py): embedding callback tests for azure, openai, bedrock 2023-12-11 15:32:46 -08:00
Krrish Dholakia
47d0884c0c test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs 2023-12-11 11:44:09 -08:00
ishaan-jaff
6ca30724df (feat) aembedding: return raw openai response 2023-11-30 20:02:47 -08:00
ishaan-jaff
1a1b549caa (chore) linting fix 2023-11-29 19:58:12 -08:00
ishaan-jaff
ca03f83597 (feat) async embeddings: OpenAI 2023-11-29 19:35:08 -08:00