Spaces:
Running
Running
Flag mistake not working
#4
by
egrace479
- opened
The Flag Mistake
button is not functioning properly.
Agreed that we will remove the flag button until it can be made functional to record the predictions and the user-input correct classification (at a minimum).
The demo has been updated to disable the button for flagging Zero-Shot and Open-Ended predictions. Next steps involve decisions on how flagged mistakes can be used to provide the most research value as well as handle licenses appropriately for submitted images.
Notes from discussions on flagging:
- When an image is submitted and the user believes a prediction to be incorrect, they may wish to flag the error. To use the image, the user will need to answer whether the image is their IP and that they grant us permission to use it. If it is not theirs, they should be prompted to provide the original license and source URL or public domain indication.
- Even if we cannot use the image for whatever licensing reason, we may still benefit from knowing the flagged prediction(s), the user's suggested correct classification, and a trait-based description of why the user believes the prediction to be incorrect vs. their proposed classification.
- To prompt high-quality flagging responses, we should provide a description of how the flagged responses will be used to make improvements.