TokenBender
/

navarna_hindi_merged

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

navarna_hindi_merged / added_tokens.json

TokenBender's picture

Upload tokenizer

e0ffdcb verified 10 months ago

history blame contribute delete

51 Bytes

	{
	"<\|im_end\|>": 32000,
	"<\|im_start\|>": 32001
	}