Edit model card

microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:

epochs: 1
lr: 1e-5
train batch sie: 16
optimizer: adamW
lr_scheduler: linear
num warming steps: 0
max_length: 512

Results on the dev set:

'exact_match': 62.66792809839168
'f1': 74.99490608582015

Downloads last month: 11

Inference Examples

Question Answering

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train haritzpuerto/xtremedistil-l6-h256-uncased-squad_1.1

Evaluation results

SQuAD EM on SQuAD
validation set self-reported

62.668
SQuAD F1 on SQuAD
validation set self-reported

74.995

View on Papers With Code