metadata
library_name: transformers
license: mit
Model Card for GERM-NT1
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: Haozheng Luo, ChengHao Qiu
- License: MIT
Model Sources
- Repository: https://github.com/MAGICS-LAB/GERM
- Paper: https://arxiv.org/abs/2505.00598
Uses
Direct Use
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("magicslabnu/GERM-NT-2.5B-multi", trust_remote_code=True)
model = AutoModelForMaskedLM.from_pretrained("magicslabnu/GERM-NT-2.5B-multi", trust_remote_code=True)
Training Details
Training Data
GLUE
BibTeX:
@misc{luo2025fastlowcostgenomicfoundation,
title={Fast and Low-Cost Genomic Foundation Models via Outlier Removal},
author={Haozheng Luo and Chenghao Qiu and Maojiang Su and Zhihan Zhou and Zoe Mehta and Guo Ye and Jerry Yao-Chieh Hu and Han Liu},
year={2025},
eprint={2505.00598},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2505.00598},
}