Spaces:

zetavg
/

LLaMA-LoRA-Tuner-UI-Demo

Runtime error

zetavg commited on Apr 23, 2023

Commit

b6c4b29

•

1 Parent(s): bfd75de

finetune_ui: set default for load_in_8bit

Files changed (1) hide show

llama_lora/ui/finetune/finetune_ui.py CHANGED Viewed

@@ -1035,7 +1035,7 @@ def finetune_ui():
                 with gr.Accordion("Advanced Options", open=False, elem_id="finetune_advance_options_accordion"):
                     with gr.Row(elem_id="finetune_advanced_options_checkboxes"):
-                        load_in_8bit = gr.Checkbox(label="8bit", value=False)
                         fp16 = gr.Checkbox(label="FP16", value=True)
                         bf16 = gr.Checkbox(label="BF16", value=False)
                         gradient_checkpointing = gr.Checkbox(

                 with gr.Accordion("Advanced Options", open=False, elem_id="finetune_advance_options_accordion"):
                     with gr.Row(elem_id="finetune_advanced_options_checkboxes"):
+                        load_in_8bit = gr.Checkbox(label="8bit", value=Config.load_8bit)
                         fp16 = gr.Checkbox(label="FP16", value=True)
                         bf16 = gr.Checkbox(label="BF16", value=False)
                         gradient_checkpointing = gr.Checkbox(