File size: 182 Bytes
5fc39e3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: apache-2.0
datasets:
- wmt/wmt14
language:
- en
- de
---
```python
from tokenizers import Tokenizer
tok = Tokenizer.from_pretrained("llm-scratch/wmt-14-en-de-tok")
``` |