remove model lookup class

This commit is contained in:
Dinesh Yeduguru 2024-11-12 20:00:48 -08:00
parent 606df220f5
commit 1bb01f9346
2 changed files with 5 additions and 19 deletions

View file

@ -538,7 +538,7 @@ Once the server is set up, we can test it with a client to verify it's working c
$ curl http://localhost:5000/inference/chat_completion \
-H "Content-Type: application/json" \
-d '{
"model": "Llama3.1-8B-Instruct",
"model_id": "Llama3.1-8B-Instruct",
"messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Write me a 2 sentence poem about the moon"}