Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
SebOchs
/
xtremedistil-l6-h256-uncased-squad
like
0
Question Answering
Transformers
PyTorch
SQuAD
English
bert
Inference Endpoints
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Edit model card
Test model for DL4NLP 2022 HW06
Hyper parameters
Metric results on the dev set
Test model for DL4NLP 2022 HW06
xtremedistil-l6-h256-uncased trained on SQuAD
Hyper parameters
learning rate: 1e-5
weight decay: 0.01
warm up steps: 0
learning rate scheduler: linear
epochs: 1
Metric results on the dev set
F1: 65.48
EM: 51.67
Downloads last month
7
Inference Examples
Question Answering
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to
Inference Endpoints (dedicated)
instead.