2876 commits

Author	SHA1	Message	Date
Krrish Dholakia	901b343519	fix(proxy_server.py): support smtp email auth ... previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)	2024-01-02 22:22:19 +05:30
Ased Mammad	a0611430dd	fix(proxy_server.py) Check when '_hidden_params' is None	2024-01-02 19:04:51 +03:30
Krrish Dholakia	5f5a6eb7bc	feat(proxy_server.py): add slack alerting to proxy server ... add alerting for calls hanging, failing and db read/writes failing https://github.com/BerriAI/litellm/issues/1298	2024-01-02 17:45:18 +05:30
ishaan-jaff	7d9ff31a95	(feat) proxy swagger - make admin link clickable	2024-01-02 17:04:32 +05:30
ishaan-jaff	7458957d8e	(test) xinference on litellm router	2024-01-02 16:51:08 +05:30
ishaan-jaff	1f4a328131	(test) xinference embeddings	2024-01-02 15:41:51 +05:30
ishaan-jaff	0e8809abf2	(feat) add xinference as an embedding provider	2024-01-02 15:32:26 +05:30
Krrish Dholakia	d4da63800e	fix(utils.py): support token counting for gpt-4-vision models	2024-01-02 14:41:42 +05:30
ishaan-jaff	4db20ef478	(test) proxy - pass user_config	2024-01-02 14:15:03 +05:30
ishaan-jaff	2adcf8c762	(types) routerConfig	2024-01-02 14:14:29 +05:30
ishaan-jaff	2cbbfa72f1	(feat) add Router init Pydantic Type	2024-01-02 13:30:24 +05:30
ishaan-jaff	f7fc4da850	(feat) litellm add types for completion, embedding request	2024-01-02 12:27:08 +05:30
ishaan-jaff	e1c121737c	(feat) use - user router for aembedding	2024-01-02 12:27:08 +05:30
Krrish Dholakia	de1d51e3de	fix(lowest_tpm_rpm.py): handle null case for text/message input	2024-01-02 12:24:29 +05:30
ishaan-jaff	4f1df08f54	(test) sustained load test proxy	2024-01-02 12:10:34 +05:30
ishaan-jaff	7fca998026	(test) proxy - use, user provided model_list	2024-01-02 12:10:34 +05:30
ishaan-jaff	dc5984c41d	(feat) proxy - use user_config for /chat/compeltions	2024-01-02 12:10:34 +05:30
Krrish Dholakia	01c042fdc6	feat(router.py): add support for retry/fallbacks for async embedding calls	2024-01-02 11:54:28 +05:30
Krrish Dholakia	b82e20e517	fix(router.py): fix model name passed through	2024-01-02 11:15:30 +05:30
Krrish Dholakia	4f988058a1	refactor(test_router_caching.py): move tpm/rpm routing tests to separate file	2024-01-02 11:10:11 +05:30
ishaan-jaff	163b78fef1	(test) bedrock-test passing boto3 client	2024-01-02 10:23:28 +05:30
ishaan-jaff	6672591198	(fix) init_bedrock_client	2024-01-01 22:48:56 +05:30
Ishaan Jaff	0e870c2746	(test) fix test_get_model_cost_map.py	2024-01-01 21:58:48 +05:30
Krrish Dholakia	4eae0c9a0d	fix(router.py): correctly raise no model available error ... https://github.com/BerriAI/litellm/issues/1289	2024-01-01 21:22:42 +05:30
Ishaan Jaff	41491b2153	Merge pull request #1290 from fcakyon/patch-1 ... fix typos & add missing names for azure models	2024-01-01 17:58:17 +05:30
Krrish Dholakia	4c4e8d0290	build(user.py): fix page param read issue	2024-01-01 17:25:52 +05:30
Krrish Dholakia	81bb382f98	fix(proxy_server.py): enabling user auth via ui ... https://github.com/BerriAI/litellm/issues/1231	2024-01-01 17:14:24 +05:30
fatih	783f5378f4	update azure turbo namings	2024-01-01 13:03:08 +03:00
Krrish Dholakia	dcfcf99d63	fix(proxy_server.py): check if user email in user db	2024-01-01 14:19:59 +05:30
ishaan-jaff	e599c1655f	(feat) proxy - only use print_verbose	2024-01-01 13:52:11 +05:30
ishaan-jaff	988ce6ae6d	(test) ci/cd	2024-01-01 13:51:27 +05:30
Krrish Dholakia	b9e6379977	feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth ... decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.	2024-01-01 13:44:47 +05:30
ishaan-jaff	829fd5868f	(feat) proxy - remove streamlit ui on startup	2024-01-01 12:54:23 +05:30
ishaan-jaff	99156edf82	(test) proxy - log metadata to langfuse	2024-01-01 11:54:16 +05:30
ishaan-jaff	bf0329e313	(test) proxy - pass metadata to openai client	2024-01-01 11:12:57 +05:30
ishaan-jaff	869bac5f9d	(fix) proxy - remove extra print statemet	2024-01-01 10:52:09 +05:30
ishaan-jaff	f1c68e06fa	(fix) proxy - remove errant print statement	2024-01-01 10:48:12 +05:30
ishaan-jaff	d908ec7e44	(test) langfuse - set custom trace_id	2023-12-30 20:19:22 +05:30
ishaan-jaff	3e933b75d0	(feat) langfuse - set custom trace_id, trace_user_id	2023-12-30 20:19:03 +05:30
ishaan-jaff	07706f42fe	(docs) add litellm.cache docstring	2023-12-30 20:04:08 +05:30
ishaan-jaff	6f1f40ef58	(feat) cache context manager - update cache	2023-12-30 19:50:53 +05:30
ishaan-jaff	8d6a805312	(test) caching - context managers	2023-12-30 19:33:47 +05:30
ishaan-jaff	e8bebb2e14	(feat) add cache context manager	2023-12-30 19:32:51 +05:30
Krrish Dholakia	e7fec954c6	fix(proxy_server.py): router model group alias routing ... check model alias group routing before specific deployment routing, to deal with an alias being the same as a deployment name (e.g. gpt-3.5-turbo) n	2023-12-30 17:55:24 +05:30
Krrish Dholakia	d3dee9b20c	test(test_lowest_latency_routing.py): add more tests	2023-12-30 17:41:42 +05:30
Krrish Dholakia	25ee96271e	fix(router.py): fix latency based routing	2023-12-30 17:25:40 +05:30
Krrish Dholakia	2b56daae0d	test(test_router_init.py): fix test router init	2023-12-30 16:51:39 +05:30
Krrish Dholakia	30c9c91520	test(test_least_busy_routing.py): fix test	2023-12-30 16:12:52 +05:30
Krrish Dholakia	1ed96b1fc8	test(test_router.py): add retries	2023-12-30 15:54:46 +05:30
Krrish Dholakia	2cea8b0e83	fix(router.py): periodically re-initialize azure/openai clients to solve max conn issue	2023-12-30 15:48:34 +05:30