MLMvsCLM

/

610m-clm-11k-mlm40-22k

like 0

Follow

MLMvsCLM 6

This PR adds a comprehensive model card for the encoder model.

The updated model card includes:

• A link to the paper Should We Still Pretrain Encoders with Masked Language Modeling?
• The relevant pipeline_tag: feature-extraction, ensuring the model is discoverable on the Hugging Face Hub (e.g., at https://huggingface.co/models?pipeline_tag=feature-extraction).
• The library_name: transformers to indicate compatibility with the Hugging Face Transformers library.
• The license: apache-2.0.
• Links to the project page and the associated GitHub repository for further details and code.
• A concise description of the model and its research context.
• A minimal usage example for feature extraction.