tokenizer_fineweb / bpe_32k.model
khalidalt's picture
add tokenizer files
c2598b6
This file is stored with LFS . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
584ca031372f6c0dee4ad3275cf3104145b28a0979357087d7023cf830515292
Pointer size:
131 Bytes
·
Size of remote file:
829 kB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.