yarongef commited on
Commit
533d37e
·
1 Parent(s): 0fd1cdd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -10,7 +10,8 @@ datasets:
10
  # DistilProtBert
11
 
12
  Distilled version of [ProtBert-UniRef100](https://huggingface.co/Rostlab/prot_bert) model.
13
- In addition to cross entropy and cosine teacher-student losses, DistilProtBert was pretrained on a masked language modeling (MLM) objective and it only works with capital letter amino acids. [Git](https://github.com/yarongef/DistilProtBert) repository.
 
14
 
15
  # Model details
16
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
 
10
  # DistilProtBert
11
 
12
  Distilled version of [ProtBert-UniRef100](https://huggingface.co/Rostlab/prot_bert) model.
13
+ In addition to cross entropy and cosine teacher-student losses, DistilProtBert was pretrained on a masked language modeling (MLM) objective and it only works with capital letter amino acids.
14
+ [Git](https://github.com/yarongef/DistilProtBert) repository.
15
 
16
  # Model details
17
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |