| license: apache-2.0 | |
| tags: | |
| - mistral | |
| - pruned | |
| A Mistral-7B pruned50 | |
| Please see my tutorial to execute this model: | |
| https://vilsonrodrigues.medium.com/sparse-quantize-and-serving-llms-with-neuralmagic-autogptq-and-vllm-03961b72ec3a |
| license: apache-2.0 | |
| tags: | |
| - mistral | |
| - pruned | |
| A Mistral-7B pruned50 | |
| Please see my tutorial to execute this model: | |
| https://vilsonrodrigues.medium.com/sparse-quantize-and-serving-llms-with-neuralmagic-autogptq-and-vllm-03961b72ec3a |