又可用的 baichuan.cpp 借用avx2运行的吗，我看都是 csm家族的模型呢

#19

by redauzhang - opened Jul 2, 2023

Jul 2, 2023

rt: 正如 llama/bloomz 都有对应的cpu运行加速方法。

J22

Jul 3, 2023

llama.cpp 已支持 baichuan-7b.

redauzhang changed discussion status to closed Jul 24, 2023

Sep 1, 2023

chatglm.cpp 已支持 Baichuan-13B 和 Baichuan-13B-Chat 了

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment