lmsys

/

vicuna-7b-v1.1

like 75

Follow

Large Model Systems Organization 483

Hi,

I'm trying to deploy this on SageMaker, but the deployment code uses the "ml.g5.2xlarge" instance type for the endpoint. Is this the minimum instance type required? Can I use a smaller instance type like g4dn?