Update modeling_mpt.py

#32

by ybelkada - opened May 31, 2023

←

May 31, 2023

This PR adds accelerate support for MPT models, so that any user could load MPT models in 4bit / 8bit

abhi-mosaic changed pull request status to merged May 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment