forked from phoenix/litellm-mirror
11f9df923a
* refactor(vertex_ai_partner_models/anthropic): refactor anthropic to use partner model logic * fix(vertex_ai/): support passing custom api base to partner models Fixes https://github.com/BerriAI/litellm/issues/4317 * fix(proxy_server.py): Fix prometheus premium user check logic * docs(prometheus.md): update quick start docs * fix(custom_llm.py): support passing dynamic api key + api base * fix(realtime_api/main.py): Add request/response logging for realtime api endpoints Closes https://github.com/BerriAI/litellm/issues/6081 * feat(openai/realtime): add openai realtime api logging Closes https://github.com/BerriAI/litellm/issues/6081 * fix(realtime_streaming.py): fix linting errors * fix(realtime_streaming.py): fix linting errors * fix: fix linting errors * fix pattern match router * Add literalai in the sidebar observability category (#6163) * fix: add literalai in the sidebar * fix: typo * update (#6160) * Feat: Add Langtrace integration (#5341) * Feat: Add Langtrace integration * add langtrace service name * fix timestamps for traces * add tests * Discard Callback + use existing otel logger * cleanup * remove print statments * remove callback * add docs * docs * add logging docs * format logging * remove emoji and add litellm proxy example * format logging * format `logging.md` * add langtrace docs to logging.md * sync conflict * docs fix * (perf) move s3 logging to Batch logging + async [94% faster perf under 100 RPS on 1 litellm instance] (#6165) * fix move s3 to use customLogger * add basic s3 logging test * add s3 to custom logger compatible * use batch logger for s3 * s3 set flush interval and batch size * fix s3 logging * add notes on s3 logging * fix s3 logging * add basic s3 logging test * fix s3 type errors * add test for sync logging on s3 * fix: fix to debug log --------- Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com> Co-authored-by: Willy Douhard <willy.douhard@gmail.com> Co-authored-by: yujonglee <yujonglee.dev@gmail.com> Co-authored-by: Ali Waleed <ali@scale3labs.com> |
||
|---|---|---|
| .. | ||
| AI21 | ||
| anthropic | ||
| azure_ai | ||
| AzureOpenAI | ||
| bedrock | ||
| cerebras | ||
| cohere | ||
| custom_httpx | ||
| databricks | ||
| files_apis | ||
| fine_tuning_apis | ||
| fireworks_ai | ||
| groq | ||
| hosted_vllm/chat | ||
| huggingface_llms_metadata | ||
| mistral | ||
| nvidia_nim | ||
| OpenAI | ||
| prompt_templates | ||
| sagemaker | ||
| sambanova | ||
| together_ai | ||
| tokenizers | ||
| vertex_ai_and_google_ai_studio | ||
| __init__.py | ||
| aleph_alpha.py | ||
| azure_text.py | ||
| base.py | ||
| base_aws_llm.py | ||
| baseten.py | ||
| clarifai.py | ||
| cloudflare.py | ||
| custom_llm.py | ||
| gemini.py | ||
| huggingface_restapi.py | ||
| maritalk.py | ||
| nlp_cloud.py | ||
| ollama.py | ||
| ollama_chat.py | ||
| oobabooga.py | ||
| openrouter.py | ||
| palm.py | ||
| petals.py | ||
| predibase.py | ||
| README.md | ||
| replicate.py | ||
| text_completion_codestral.py | ||
| triton.py | ||
| vllm.py | ||
| volcengine.py | ||
| watsonx.py | ||
File Structure
August 27th, 2024
To make it easy to see how calls are transformed for each model/provider:
we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.
Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.
E.g. cohere/, bedrock/.