Commit graph

13 commits

Author SHA1 Message Date
Krish Dholakia
fac3b2ee42
Add pyright to ci/cd + Fix remaining type-checking errors (#6082)
* fix: fix type-checking errors

* fix: fix additional type-checking errors

* fix: additional type-checking error fixes

* fix: fix additional type-checking errors

* fix: additional type-check fixes

* fix: fix all type-checking errors + add pyright to ci/cd

* fix: fix incorrect import

* ci(config.yml): use mypy on ci/cd

* fix: fix type-checking errors in utils.py

* fix: fix all type-checking errors on main.py

* fix: fix mypy linting errors

* fix(anthropic/cost_calculator.py): fix linting errors

* fix: fix mypy linting errors

* fix: fix linting errors
2024-10-05 17:04:00 -04:00
Artem Zemliak
5290490106
Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
Ishaan Jaff
aba600a892 fix triton linting 2024-07-23 11:03:34 -07:00
Sophia Loris
d779253949 resolve merge conflicts 2024-07-19 09:45:53 -05:00
Sophia Loris
d5c65c6be2 Add support for Triton streaming & triton async completions 2024-07-19 09:35:27 -05:00
Ishaan Jaff
b04d20d367 fix linting error 2024-07-16 21:21:50 -07:00
davidschuler-8451
35b733f14d feat: enables batch embedding support for triton 2024-07-16 13:31:59 -04:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Giri Tatavarty
1b3050477a #added type ignore for httpx and requests 2024-05-29 15:47:23 -07:00
Giri Tatavarty
51b9178630 #Fixed mypy errors. The requests package and stubs need to be imported - waiting to hear from Ishaan/Krrish before changing requirements.txt 2024-05-29 15:08:56 -07:00
Ishaan Jaff
99e506525c
Revert "Added support for Triton chat completion using trtlllm generate endpo…" 2024-05-29 13:42:49 -07:00
Giri Tatavarty
a58dc68418 Added support for Triton chat completion using trtlllm generate endpoint and custom infer endpoint 2024-05-28 07:54:11 -07:00
Ishaan Jaff
d3550379b0 feat - triton embeddings 2024-05-10 18:57:06 -07:00