Unable to serve mistralai/Mistral-7B-Instruct-v0.3 using vllm
#117
by
AbdulQadeer09
- opened
While tring to serve the model using the commnad # Load and run the model:
vllm serve "mistralai/Mistral-7B-Instruct-v0.3", facing an error.
TypeError: unsupported operand type(s) for *: 'int' and 'NoneType'
Haha sad bro