Spaces:

thepowerfuldeez
/

Arxiv-summarizer

Runtime error

thepowerfuldeez commited on Jun 20

Commit

72f626d

•

1 Parent(s): 7789aee

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -10,7 +10,7 @@ def get_model(model_url="thepowerfuldeez/Qwen2-1.5B-Summarize", use_cpu=False):
         model = AutoModelForCausalLM.from_pretrained(
             model_url,
             device_map="cpu",
-            load_in_4bit=True,
             attn_implementation="flash_attention_2",
         )
     else:

         model = AutoModelForCausalLM.from_pretrained(
             model_url,
             device_map="cpu",
+            # load_in_4bit=True,
             attn_implementation="flash_attention_2",
         )
     else: