Unable to serve mistralai/Mistral-7B-Instruct-v0.3 using vllm

#117
by AbdulQadeer09 - opened

While tring to serve the model using the commnad # Load and run the model:
vllm serve "mistralai/Mistral-7B-Instruct-v0.3", facing an error.

TypeError: unsupported operand type(s) for *: 'int' and 'NoneType'

Haha sad bro

Sign up or log in to comment