metadata
datasets:
- alinet/balanced_qg
model-index:
- name: alinet/bart-base-balanced-ra-qg
results:
- task:
type: text2text-generation
name: Question Generation
dataset:
name: MRQA
type: mrqa
metrics:
- type: bertscore
value: 0.6536068921497561
name: BERTScore F1
- type: bertscore
value: 0.6491253387475042
name: BERTScore Precision
- type: bertscore
value: 0.6618921563478661
name: BERTScore Recall
- task:
type: text2text-generation
name: Question Generation
dataset:
name: Spoken-SQuAD
type: alinet/spoken_squad
metrics:
- type: bertscore
value: 0.6280233523142774
name: BERTScore F1
- type: bertscore
value: 0.6270323888350072
name: BERTScore Precision
- type: bertscore
value: 0.6320889797976309
name: BERTScore Recall
A question generation model trained on alinet/balanced_qg dataset (resolved_augmented subset).
Example usage:
from transformers import BartConfig, BartForConditionalGeneration, BartTokenizer
model_name = "alinet/bart-base-balanced-ra-qg"
tokenizer = BartTokenizer.from_pretrained(model_name)
model = BartForConditionalGeneration.from_pretrained(model_name)
def run_model(input_string, **generator_args):
input_ids = tokenizer.encode(input_string, return_tensors="pt")
res = model.generate(input_ids, **generator_args)
output = tokenizer.batch_decode(res, skip_special_tokens=True)
print(output)
run_model("Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable.", max_length=32, num_beams=4)
# ['What is the term for a reading comprehension dataset consisting of questions posed by crowdworkers?']