Commit graph

532 commits

Author SHA1 Message Date
Ishaan Jaff
6aaa7a75cd add cerebras api 2024-08-31 08:35:23 -07:00
Ishaan Jaff
ea12519b98 fix map input_type to task_type for vertex ai 2024-08-30 12:09:07 -07:00
Ishaan Jaff
dbdbf3d9a2 use correct vtx ai21 pricing 2024-08-29 19:04:05 -07:00
Ishaan Jaff
da43356242 Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff
f4f325953c add fireworks_ai_models 2024-08-29 09:23:11 -07:00
Krish Dholakia
996c028127 Merge pull request #5393 from BerriAI/litellm_gemini_embedding_support
feat(vertex_ai_and_google_ai_studio): Support Google AI Studio Embedding Endpoint
2024-08-28 13:46:28 -07:00
Krrish Dholakia
947801d3ac fix(__init__.py): fix import 2024-08-27 19:35:03 -07:00
Krrish Dholakia
882ae8ac2c fix: initial commit 2024-08-27 17:35:56 -07:00
Ishaan Jaff
f9d2c0c40f add basic cohere rerank 2024-08-27 15:55:43 -07:00
Ishaan Jaff
5f61539e90 refactor partner models to include ai21 2024-08-27 13:35:22 -07:00
Krrish Dholakia
df4dc24962 fix: fix imports 2024-08-26 22:24:30 -07:00
Krrish Dholakia
074e30fa10 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 22:19:01 -07:00
Krish Dholakia
a33b3b2f24 Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix
fix(sagemaker.py): support streaming for messages api
2024-08-26 21:36:10 -07:00
Krrish Dholakia
b989762bb0 fix(sagemaker.py): support streaming for messages api
Fixes https://github.com/BerriAI/litellm/issues/5372
2024-08-26 15:08:08 -07:00
Ishaan Jaff
5c1ebb6ac2 use common folder for cohere 2024-08-26 14:28:50 -07:00
Krish Dholakia
bc2a96b2a5 Merge branch 'main' into litellm_vertex_migration 2024-08-24 18:24:19 -07:00
Krish Dholakia
5eba49c112 Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
feat(sagemaker.py): add sagemaker messages api support
2024-08-23 21:00:00 -07:00
Krish Dholakia
6592de3ef9 Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
2024-08-23 20:42:35 -07:00
Krrish Dholakia
f7aa787fe6 feat(sagemaker.py): add sagemaker messages api support
Closes https://github.com/BerriAI/litellm/issues/2641

 Closes https://github.com/BerriAI/litellm/pull/5178
2024-08-23 10:31:35 -07:00
Krrish Dholakia
a9b5d5271f feat(batches): add azure openai batches endpoint support
Closes https://github.com/BerriAI/litellm/issues/5073
2024-08-22 14:46:51 -07:00
Krrish Dholakia
d87e8f5b30 feat(utils.py): support global vertex ai safety settings param 2024-08-21 17:37:50 -07:00
Ognjen Francuski
f9093a6432 Update handling of 'litellm.ssl_verify' in HTTP handlers to allow for custom, self-signed certificates. 2024-08-20 10:16:03 +02:00
Krrish Dholakia
83ed174059 fix(__init__.py): fix models_by_provider to include cohere_chat models
Fixes https://github.com/BerriAI/litellm/issues/5201
2024-08-16 11:33:23 -07:00
Ishaan Jaff
c5515513a9 feat allow controlling logged tags on langfuse 2024-08-13 12:24:01 -07:00
Krrish Dholakia
f4c984878d fix(utils.py): Break out of infinite streaming loop
Fixes https://github.com/BerriAI/litellm/issues/5158
2024-08-12 14:00:43 -07:00
Ishaan Jaff
8e90139377 refactor prometheus to be a customLogger class 2024-08-10 09:28:46 -07:00
Ishaan Jaff
e82656d59a init bedrock_tool_name_mappings 2024-08-09 17:09:19 -07:00
Krrish Dholakia
36c37bcc8b fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 13:05:03 -07:00
Krish Dholakia
7d28b6ebc3 Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia
182d63853b fix: use more descriptive flag 2024-08-07 18:59:46 -07:00
Krrish Dholakia
8b028d41aa feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Krrish Dholakia
adec69ef2f fix(__init__.py): bump default allowed fails 2024-08-05 16:50:26 -07:00
Krrish Dholakia
b5e22bde06 fix: bump default allowed_fails + reduce default db pool limit
Fixes issues with running proxy server in production
2024-08-05 15:07:46 -07:00
Ishaan Jaff
c9856d91c7 fix linting errors 2024-08-05 08:54:04 -07:00
Ishaan Jaff
4604233408 add ALL_LITELLM_RESPONSE_TYPES 2024-08-05 08:41:13 -07:00
Krrish Dholakia
acbc2917b8 feat(utils.py): Add github as a provider
Closes https://github.com/BerriAI/litellm/issues/4922#issuecomment-2266564469
2024-08-03 09:11:22 -07:00
Ishaan Jaff
e3cf86702a init gcs using gcs_bucket 2024-08-01 15:25:19 -07:00
Ishaan Jaff
866519b659 use itellm.forward_traceparent_to_llm_provider 2024-08-01 09:05:13 -07:00
Ishaan Jaff
77389ac577 add create_fine_tuning 2024-07-29 18:57:29 -07:00
Krish Dholakia
0525fb75f3 Merge branch 'main' into litellm_vertex_migration 2024-07-27 20:25:12 -07:00
Krrish Dholakia
ce7257ec5e feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
bf23aac11d feat(utils.py): support sync streaming for custom llm provider 2024-07-25 16:47:32 -07:00
Krrish Dholakia
54e1ca29b7 feat(custom_llm.py): initial working commit for writing your own custom LLM handler
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
2024-07-25 15:33:05 -07:00
Ishaan Jaff
2dc6367dc9 feat use UnsupportedParamsError as litellm error type 2024-07-24 12:19:10 -07:00
Krrish Dholakia
fe8b22ee9d fix(__init__.py): update init 2024-07-23 17:55:28 -07:00
Krrish Dholakia
23a3be184b build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krish Dholakia
7cf9620b12 Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krrish Dholakia
8c005d8134 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Krrish Dholakia
d4c72f913c feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Ishaan Jaff
c7c65696fd set _known_custom_logger_compatible_callbacks in _init 2024-07-22 15:38:46 -07:00