phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17681 commits 2497 branches 898 tags 550 MiB
Commit graph

55 commits

Author SHA1 Message Date
Krish Dholakia
52849e6422 LiteLLM Minor Fixes and Improvements (09/07/2024) (#5580) 
* fix(litellm_logging.py): set completion_start_time_float to end_time_float if none

Fixes https://github.com/BerriAI/litellm/issues/5500

* feat(_init_.py): add new 'openai_text_completion_compatible_providers' list

Fixes https://github.com/BerriAI/litellm/issues/5558

Handles correctly routing fireworks ai calls when done via text completions

* fix: fix linting errors

* fix: fix linting errors

* fix(openai.py): fix exception raised

* fix(openai.py): fix error handling

* fix(_redis.py): allow all supported arguments for redis cluster (#5554)

* Revert "fix(_redis.py): allow all supported arguments for redis cluster (#5554)" (#5583)

This reverts commit f2191ef4cb.

* fix(router.py): return model alias w/ underlying deployment on router.get_model_list()

Fixes https://github.com/BerriAI/litellm/issues/5524#issuecomment-2336410666

* test: handle flaky tests

---------

Co-authored-by: Jonas Dittrich <58814480+Kakadus@users.noreply.github.com>
 2024-09-09 18:54:17 -07:00
Ishaan Jaff
6b3fe3715b fix test_completion_vllm 2024-08-27 18:40:39 -07:00
Krrish Dholakia
cb9b19e887 feat(vertex_ai_partner.py): add vertex ai codestral FIM support 
Closes https://github.com/BerriAI/litellm/issues/4984
 2024-08-01 17:10:27 -07:00
Krrish Dholakia
5945da4a66 fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 09:57:19 -07:00
Krrish Dholakia
f0a5ca3522 fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Krrish Dholakia
7966266d4f fix(main.py): route openai calls to /completion when text_completion is True 2024-06-19 12:37:05 -07:00
Krish Dholakia
ea2f27e472 Merge branch 'main' into litellm_aws_kms_fixes 2024-06-19 09:30:54 -07:00
Ishaan Jaff
c1981f5534 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Ishaan Jaff
9641533709 test - codestral streaming 2024-06-17 14:17:25 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
55bfb181a3 working chat, text for codestral 2024-06-17 11:30:22 -07:00
Krrish Dholakia
3d2de1c8d4 fix(utils.py): fix tgai timeout exception mapping + skip flaky test 2024-06-10 19:50:16 -07:00
Krrish Dholakia
b3d53787da test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Krrish Dholakia
24ffb1e601 fix(main.py): fix together ai text completion call 2024-05-08 09:10:45 -07:00
Krrish Dholakia
7880dcbdf7 fix(openai.py): support passing prompt as list instead of concat string 2024-04-03 15:23:20 -07:00
Krrish Dholakia
f3fcfe3007 fix(proxy_server.py): return original model response via response headers - /v1/completions 
to help devs with debugging
 2024-04-03 13:05:43 -07:00
Krrish Dholakia
be3146c505 test(test_text_completion.py): unit testing for text completion pydantic object 2024-04-03 12:26:51 -07:00
Krrish Dholakia
ed46af19ec fix(openai.py): return logprobs for text completion calls 2024-04-02 14:05:56 -07:00
Krrish Dholakia
ecc0cf5d9c fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
ishaan-jaff
7c6fe0f8d2 (test-fix) hf is unstable 2024-03-04 08:44:39 -08:00
ishaan-jaff
1d581c128d (test) hf currently loading error 2024-01-15 17:07:49 -08:00
ishaan-jaff
56b21a053b (test) fix - skip HF is currently loading exception 2024-01-09 15:53:19 +05:30
Krrish Dholakia
11ff324ff7 test(test_router.py): fix router test 2024-01-09 11:08:35 +05:30
ishaan-jaff
83835f10f6 (fix) test - deprecated textdavinci003 2024-01-09 10:55:35 +05:30
Krrish Dholakia
d89a58ec54 fix(ollama.py): use tiktoken as backup for prompt token counting 2024-01-09 09:47:18 +05:30
Krrish Dholakia
5daa3ce237 fix(main.py): support cost calculation for text completion streaming object 2024-01-08 12:41:43 +05:30
Krrish Dholakia
9cf43cd5dc refactor: move async text completion testing to test_text_completion.py 2023-12-29 11:46:40 +05:30
ishaan-jaff
e212afc46c (ci/cd) set num retries for HF test 2023-12-29 10:52:45 +05:30
ishaan-jaff
3d2049a9f0 (test) gpt-3.5-turbo-instruct finish reason 2023-12-27 15:45:40 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
e03713ef74 fix(main.py): return async completion calls 2023-12-18 17:41:54 -08:00
Krrish Dholakia
bb5b883316 fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
ishaan-jaff
158bf444f4 (test) hf text completion 2023-12-11 10:27:43 -08:00
Krrish Dholakia
34decba3cf fix(text_completion): allow either model or engine to be set 2023-11-17 18:25:21 -08:00
ishaan-jaff
945761c36b (test) hf streaming 2023-11-16 12:24:31 -08:00
ishaan-jaff
bef9ead3a6 (test) regular hf tests 2023-11-16 12:00:49 -08:00
ishaan-jaff
d951f849a7 (test) text_completion 2023-11-16 11:37:46 -08:00
Krrish Dholakia
8ba438b3a2 fix(caching.py): dump model response object as json 2023-11-13 10:41:04 -08:00
ishaan-jaff
fa61276407 (test) add text completion steaming test 2023-11-08 11:59:31 -08:00
ishaan-jaff
739e9c4732 (test) remove dup hf test 2023-11-08 09:54:40 -08:00
ishaan-jaff
c570de72fe bump: version 0.13.7 → 0.13.8 2023-11-08 09:46:57 -08:00
ishaan-jaff
7de10d184a (test) hf inference api - text_completion 2023-11-06 17:56:41 -08:00
ishaan-jaff
df774cdc29 (fix) linting errors 2023-11-06 14:42:12 -08:00
ishaan-jaff
ae44302c16 (test) hf max tokens, temp 2023-11-06 14:38:21 -08:00
ishaan-jaff
b4fd02c9e5 (test) text_completion 2023-11-06 13:17:49 -08:00
ishaan-jaff
70fc10c010 (fix) linting fixes 2023-11-06 13:02:11 -08:00
ishaan-jaff
c166b14a3b (test) text completion 2023-11-06 09:10:48 -08:00
ishaan-jaff
b2322b8802 (test) text completion 2023-11-06 08:37:01 -08:00
ishaan-jaff
03738ac0d9 (test) text_completion more testing 2023-11-06 08:36:50 -08:00