209 commits

Author	SHA1	Message	Date
Krish Dholakia	34bdf36eab	Add inference providers support for Hugging Face (#8258) (#9738) (#9773) ... * Add inference providers support for Hugging Face (#8258) * add first version of inference providers for huggingface * temporarily skipping tests * Add documentation * Fix titles * remove max_retries from params and clean up * add suggestions * use llm http handler * update doc * add suggestions * run formatters * add tests * revert * revert * rename file * set maxsize for lru cache * fix embeddings * fix inference url * fix tests following breaking change in main * use ChatCompletionRequest * fix tests and lint * [Hugging Face] Remove outdated chat completion tests and fix embedding tests (#9749) * remove or fix tests * fix link in doc * fix(config_settings.md): document hf api key --------- Co-authored-by: célina <hanouticelina@gmail.com>	2025-04-05 10:50:15 -07:00
Ishaan Jaff	5965680176	fix dev release.txt	2025-04-01 12:02:51 -07:00
dependabot[bot]	8f35bdffb0	build(deps): bump litellm in /cookbook/litellm-ollama-docker-image ... Bumps [litellm](https://github.com/BerriAI/litellm) from 1.55.3 to 1.61.15. - [Release notes](https://github.com/BerriAI/litellm/releases) - [Commits](https://github.com/BerriAI/litellm/commits) --- updated-dependencies: - dependency-name: litellm dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>	2025-03-20 21:03:29 +00:00
Ishaan Jaff	e1c0025a55	docs litellm x langfuse cookbook	2025-02-14 09:31:51 -08:00
Ishaan Jaff	a551f978fb	update cookbook	2025-02-14 09:23:04 -08:00
Ishaan Jaff	9511cdddcd	docs litellm langfuse cookbook	2025-02-14 08:16:27 -08:00
Ishaan Jaff	1e423cadf4	cookbook litellm proxy langfuse (#8541)	2025-02-14 08:07:59 -08:00
exiao	85491a0bab	Add Arize Cookbook for Turning on LiteLLM Proxy (#8336) ... * Add files via upload * Update arize_integration.md	2025-02-06 16:16:28 -08:00
Ishaan Jaff	6f6c651ee0	(Feat) Add input_cost_per_token_batches, output_cost_per_token_batches for OpenAI cost tracking Batches API (#7391) ... * add input_cost_per_token_batches * input_cost_per_token_batches	2024-12-23 17:42:58 -08:00
Ishaan Jaff	c7f14e936a	(code quality) run ruff rule to ban unused imports (#7313) ... * remove unused imports * fix AmazonConverseConfig * fix test * fix import * ruff check fixes * test fixes * fix testing * fix imports	2024-12-19 12:33:42 -08:00
Krish Dholakia	e332e93786	Litellm security fixes (#7282) ... * build(Dockerfile): bump node version * build(Dockerfile): bump python version fix critical errors * build(requirements.txt): fix snyk errors	2024-12-18 09:38:52 -08:00
Ishaan Jaff	7a5f997fc9	(refactor) remove berrispendLogger - unused logging integration (#6363) ... * fix remove berrispendLogger * remove unused clickhouse logger	2024-10-22 16:53:25 +05:30
Krish Dholakia	f252350881	LiteLLM Minor Fixes & Improvements (10/17/2024) (#6293) ... * fix(ui_sso.py): fix faulty admin only check Fixes https://github.com/BerriAI/litellm/issues/6286 * refactor(sso_helper_utils.py): refactor /sso/callback to use helper utils, covered by unit testing Prevent future regressions * feat(prompt_factory): support 'ensure_alternating_roles' param Closes https://github.com/BerriAI/litellm/issues/6257 * fix(proxy/utils.py): add dailytagspend to expected views * feat(auth_utils.py): support setting regex for clientside auth credentials Fixes https://github.com/BerriAI/litellm/issues/6203 * build(cookbook): add tutorial for mlflow + langchain + litellm proxy tracing * feat(argilla.py): add argilla logging integration Closes https://github.com/BerriAI/litellm/issues/6201 * fix: fix linting errors * fix: fix ruff error * test: fix test * fix: update vertex ai assumption - parts not always guaranteed (#6296) * docs(configs.md): add argila env var to docs	2024-10-17 22:09:11 -07:00
Ishaan Jaff	4d1b4beb3d	(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) ... * use folder for caching * fix importing caching * fix clickhouse pyright * fix linting * fix correctly pass kwargs and args * fix test case for embedding * fix linting * fix embedding caching logic * fix refactor handle utils.py * fix test_embedding_caching_azure_individual_items_reordered	2024-10-14 16:34:01 +05:30
Ishaan Jaff	b1e9d344b2	Update readme.md	2024-10-07 18:15:15 +05:30
Ishaan Jaff	a0cbf31fcf	Update readme.md	2024-10-07 18:12:43 +05:30
Ishaan Jaff	1bafbf8382	(feat proxy) add v2 maintained LiteLLM grafana dashboard (#6098) ... * add new grafana dashboard litellm * add v2 grafana dashboard	2024-10-07 18:11:20 +05:30
Victor Mustar	b2d62f00a3	update cookbook ... simplify	2024-08-28 17:19:48 +02:00
Ishaan Jaff	5bc8b59b11	docs - use consistent name for LiteLLM proxy server	2024-08-03 12:49:35 -07:00
Krrish Dholakia	c5ee6fe4b9	build: cookbook on migrating to litellm proxy from openai/azure sdk	2024-07-27 16:09:50 -07:00
Ishaan Jaff	c99a5a58ec	docs grafana dashboard litellm	2024-07-05 14:08:55 -07:00
Ishaan Jaff	9c6080be1a	Create readme.md	2024-07-05 14:04:47 -07:00
Ishaan Jaff	8b741f5efc	add example grafana dashboard	2024-07-05 14:02:05 -07:00
Ishaan Jaff	166eb24c54	script to add new models	2024-07-04 20:52:58 -07:00
Ishaan Jaff	778b41cea5	fix - update migration script to ensure api_key in script	2024-05-22 12:22:23 -07:00
mogith-pn	723ef9963e	Clarifai - Added streaming and async completion support	2024-05-03 14:03:38 +00:00
mogith-pn	d770df2259	Merge branch 'main' into main	2024-04-30 22:48:52 +05:30
mogith-pn	318b4813f2	Clarifai-LiteLLM integration (#1) ... * intg v1 clarifai-litellm * Added more community models and testcase * Clarifai-updated markdown docs	2024-04-30 22:38:33 +05:30
Simon Sanchez Viloria	72cbe369be	(docs) updated watsonx cookbook	2024-04-24 17:19:02 +02:00
Simon Sanchez Viloria	f9a7456eaa	(docs) updated cookbook	2024-04-23 16:22:41 +02:00
Simon Sanchez Viloria	e64aceea91	(feat) Update WatsonX credentials and variable names	2024-04-23 12:16:04 +02:00
Simon Sanchez Viloria	7cbe9835c9	(docs) updated litellm watsonx cookbook	2024-04-23 12:01:13 +02:00
Simon Sanchez Viloria	ca0807d8ab	(docs) added watsonx cookbook	2024-04-20 20:52:25 +02:00
Krrish Dholakia	a06a0e7b81	docs(cookbook/proxy_batch_users.ipynb): update cookbook with better instructions	2024-04-13 10:34:00 -07:00
Krrish Dholakia	ae7230cf71	docs(cookbook/proxy_batch_users.ipynb): cookbook for batch creating users on proxy with keys + max budgets	2024-04-13 10:31:39 -07:00
Ishaan Jaff	9465288e9e	migration script	2024-04-11 09:55:14 -07:00
Ishaan Jaff	240aaf7af8	fix - show api_base in migration script	2024-04-11 09:26:13 -07:00
Ishaan Jaff	1c1b0f929f	fix - migration script for /model/new	2024-04-11 07:34:00 -07:00
Ishaan Jaff	a36c2f8e92	feat - migration script to hosted proxy	2024-04-10 18:21:57 -07:00
lucca	be265fbb15	initial	2024-04-04 16:58:51 -03:00
Vince Loewe	7c38f992dc	Merge branch 'main' into main	2024-03-11 12:36:41 +09:00
ishaan-jaff	4b717810ec	(feat) endpoint router	2024-03-09 16:10:04 -08:00
Vince Loewe	6707ddefa5	remove keys	2024-02-28 22:30:10 -08:00
Vince Loewe	40eebc6bea	support templates	2024-02-28 22:18:39 -08:00
Vince Loewe	a9648613dc	feat: LLMonitor is now Lunary	2024-02-27 22:07:13 -08:00
ishaan-jaff	c591b3d9f3	(feat) insert clickhouse logs	2024-02-26 16:39:32 -08:00
ishaan-jaff	78c847ec5e	(misc) clickhouse cookbook	2024-02-26 07:37:44 -08:00
ishaan-jaff	13f1d7b96f	v0 clickhouse	2024-02-24 17:40:39 -08:00
Vivek Aditya	9837aaa7e1	added athina in readme.md	2024-02-23 22:05:29 +05:30
ishaan-jaff	c59021d090	(cookbook) load test litellm router	2024-02-08 07:24:28 -08:00