phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(feat) add XAI ChatCompletion Support (#6373)

Browse source 
* init commit for XAI

* add full logic for xai chat completion

* test_completion_xai

* docs xAI

* add xai/grok-beta

* test_xai_chat_config_get_openai_compatible_provider_info

* test_xai_chat_config_map_openai_params

* add xai streaming test
This commit is contained in:
Ishaan Jaff 2024-11-01 20:37:09 +05:30 • committed by GitHub
parent 9545b0e5cd
commit 5652c375b3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
9 changed files with 400 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

11
model_prices_and_context_window.json
View file

@ -1502,6 +1502,17 @@
"mode": "completion",
"source": "https://docs.mistral.ai/capabilities/code_generation/"
},
"xai/grok-beta": {
"max_tokens": 131072,
"max_input_tokens": 131072,
"max_output_tokens": 131072,
"input_cost_per_token": 0.000005,
"output_cost_per_token": 0.000015,
"litellm_provider": "xai",
"mode": "chat",
"supports_function_calling": true,
"supports_vision": true
},
"deepseek-coder": {
"max_tokens": 4096,
"max_input_tokens": 128000,