Commit graph

1173 commits

Author SHA1 Message Date
ishaan-jaff
1bd41ab636 (feat) add perplexity llms 2023-10-20 14:39:29 -07:00
ishaan-jaff
66206aea3a (test) native perplexity ai api test 2023-10-20 14:29:07 -07:00
ishaan-jaff
61dd4f167f (feat) native perplexity support 2023-10-20 14:29:07 -07:00
ishaan-jaff
114d8fda65 (feat) native perplexity support 2023-10-20 14:29:07 -07:00
ishaan-jaff
3548a6ffc3 (test) test accessing class attributes for streamed responses 2023-10-20 13:06:25 -07:00
Krrish Dholakia
1f1cf7a11c feat(main.py): support multiple deployments in 1 completion call 2023-10-20 13:01:53 -07:00
Krrish Dholakia
4eeadd284a feat(utils.py): adding encode and decode functions 2023-10-20 11:59:47 -07:00
ishaan-jaff
c038731c48 (add request_timeout) as param to proxy_server 2023-10-20 11:55:42 -07:00
Krrish Dholakia
4b48af7c3c fix(anthropic.py-+-bedrock.py): anthropic prompt format 2023-10-20 10:56:15 -07:00
ishaan-jaff
220935c3cc (fix) litellm proxy with router 2023-10-20 09:38:22 -07:00
Krrish Dholakia
8ad152a7a4 test(test_proxy.py): fix azure test 2023-10-20 09:21:59 -07:00
Ishaan Jaff
9d1ce893b7
Merge pull request #638 from deepinfra/deepinfra-models
deepinfra: Add supported models
2023-10-20 09:10:32 -07:00
ishaan-jaff
8e9340f3b9 (fix) llmonitor track function calls 2023-10-20 09:05:14 -07:00
Iskren Chernev
629fe3c6ba Load deepinfra models from json 2023-10-20 11:34:17 +03:00
Krish Dholakia
123c0f41f8
Merge pull request #655 from coconut49/main
Create GitHub Action to automatically build docker images
2023-10-19 21:49:18 -07:00
coconut49
f890aa1db5
Refactor code for better readability and remove unnecessary comments in Dockerfile. 2023-10-20 12:19:56 +08:00
coconut49
be78f2ade9
Move Dockerfile to root and set environment variable for config path 2023-10-20 12:19:29 +08:00
coconut49
52fdfe5819
Improve code formatting and allow configurable litellm config path via environment variable. 2023-10-20 12:19:26 +08:00
coconut49
a9ebf1b6ab
Relocate Dockerfile to litellm/proxy directory. 2023-10-20 12:18:37 +08:00
Krrish Dholakia
00993f3575 fix: allow api base to be set for all providers
enables proxy use cases
2023-10-19 19:07:42 -07:00
Krrish Dholakia
76bf8c4be3 fix(anthropic.py): enable api base to be customized 2023-10-19 18:45:29 -07:00
Krrish Dholakia
04f8840a92 test: fix linting testing 2023-10-19 18:40:33 -07:00
Krrish Dholakia
4198901a2d docs(token_usage.md): adding new register model function 2023-10-19 18:33:53 -07:00
Krrish Dholakia
8dda69e216 feat(utils.py): add register model helper function 2023-10-19 18:26:36 -07:00
ishaan-jaff
3f3af9dae7 (test) add slack custom webhook testing 2023-10-19 09:11:58 -07:00
ishaan-jaff
310d65bd62 (feat) failure handler - log exceptions when incorrect model passed and result=None 2023-10-19 09:11:58 -07:00
ishaan-jaff
16f598aa3f (fix) allow using more than 1 custom callback 2023-10-19 09:11:58 -07:00
ishaan-jaff
5cf3c3dc86 (fix) allow using more than 1 custom callback 2023-10-19 09:11:58 -07:00
Krrish Dholakia
01ba459682 fix(proxy_server.py): adding coverage for v1/models 2023-10-18 21:45:58 -07:00
Krrish Dholakia
3a8c8f56d6 feat(proxy_server.py): add model router to proxy 2023-10-18 17:40:08 -07:00
Krrish Dholakia
3863920ea5 feat(proxy_cli.py): optional logging 2023-10-18 16:51:47 -07:00
Krrish Dholakia
50a3c9768b test(init.py): improving testing for get_model_cost_map
b69449a811
2023-10-18 14:55:36 -07:00
Krish Dholakia
a0f6279bff
Merge pull request #643 from nirga/batch
fix: disabled batch by default for Traceloop
2023-10-18 13:59:45 -07:00
Krrish Dholakia
b69449a811 fix(init.py): adding local cached copy of model mapping for fallbacks 2023-10-18 13:59:12 -07:00
Nir Gazit
92d4ae1eaa fix: disabled batch by default 2023-10-18 22:30:16 +02:00
Krrish Dholakia
e35562d188 fix(router.py): completing redis support work for router 2023-10-18 12:13:00 -07:00
ishaan-jaff
92b56de2db (test) langsmith logger with metadata 2023-10-18 12:00:30 -07:00
ishaan-jaff
4258828969 (fix) langsmith logger track project_name and run_name 2023-10-18 12:00:12 -07:00
ishaan-jaff
c9763789f3 (test) test langsmith logger 2023-10-18 11:39:37 -07:00
ishaan-jaff
994979a3f4 (feat) add langsmith logger to litellm 2023-10-18 11:39:37 -07:00
ishaan-jaff
f2d8e43f67 (feat) add langsmith logger to litellm 2023-10-18 11:39:37 -07:00
ishaan-jaff
85f13e8655 (test) fix wandb logger 2023-10-18 10:20:26 -07:00
ishaan-jaff
0c090e3675 (fix) update docstring for get_max_tokens 2023-10-18 09:16:34 -07:00
Krrish Dholakia
fa488e29e0 fix(test_proxy.py): fix tests 2023-10-17 22:34:12 -07:00
Krrish Dholakia
b20cf3171b feat(router.py): add routing capabilities for multiple deployments 2023-10-17 22:28:31 -07:00
ishaan-jaff
da3625e2f3 (fix) linting fix for wandb logger 2023-10-17 18:06:14 -07:00
ishaan-jaff
46cd3cb7a4 (test) wandb logger 2023-10-17 18:04:55 -07:00
ishaan-jaff
b6b9f9487d (test) add weights & biases logger 2023-10-17 18:01:53 -07:00
ishaan-jaff
5fd7720029 (feat) weights & biases logger 2023-10-17 18:01:53 -07:00
Krrish Dholakia
a7c3fc2fd9 fix(utils.py): mapping azure api version missing exception 2023-10-17 17:12:51 -07:00