helene-rousset's picture
Upload README.md with huggingface_hub
2d3fac7 verified
metadata
{}

Model Card

We are training an encoder model in order to classify the repayment outcome of a merchant. The input of the model is a structured credit report and the output is a binary prediction.

Model Details

  • Base Model: allenai/longformer-large-4096
  • Dataset: cloudwalk-kickass/lending_semantic
  • Dataset size: 64681
  • Revision: 4e5c258

Training

This model was fine-tuned using the following hyperparameters:

  • Learning rate: 1e-05
  • Batch size: 8
  • Max epochs: 5
  • Weight decay: 0.01