Hugging Face's logo

yarongef
/
DistilProtBert

Fill-Mask
Transformers
PyTorch
bert
protein language model
Model card Files Community
1
yarongef commited on
Commit
ec6857f
·
1 Parent(s): b573649

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ In addition to cross entropy and cosine teacher-student losses, DistilProtBert w
17
  # Model details
18
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
19
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
20
- | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB Tpus |
21
  | DistilProtBert | 230M | 15 | UniRef50 | 43M | 5 v100 32GB GPUs |
22
 
23
  ## Intended uses & limitations
 
17
  # Model details
18
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
19
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
20
+ | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB TPUs |
21
  | DistilProtBert | 230M | 15 | UniRef50 | 43M | 5 v100 32GB GPUs |
22
 
23
  ## Intended uses & limitations