<|im_start|>system {System}<|im_end|> <|im_start|>user {User}<|im_end|> <|im_start|>assistant {Assistant}
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Base model