MaziyarPanahi

/

rank_zephyr_7b_v1_full-GGUF

like 4

Model used: Q4_M
I used llama-cpp-python, and the prompt used in the ArXiv paper, but the the model outputs an empty string instead of the orderings of received passages.
Also, which stop token to use?