classification probability

#14
by Gerald001 - opened

hi,

is it possible to output a probability for safe and unsafe - in order to understand how confident the classification as safe is?

Thanks,
Gerald

cc @jfchi

Gerald001 changed discussion title from probability for safe and unsafe to classification probability
Meta Llama org

Can you try the approach listed here for obtaining log probabilities: https://discuss.huggingface.co/t/announcement-generation-get-probabilities-for-generated-output/30075

hi @litesaber do you refer to compute_transition_scores - how to get final probabilities? could you please give example?

Yeah I agree, is there an example of how we could get the probability score using a HuggingFace Inference Endpoint?

Sign up or log in to comment