Hugging Face's logo

Datasets:
hf-internal-testing
/
tokenizers-test-data

Modalities:
Text
Formats:
text
Size:
< 1K
Libraries:
Datasets
Dataset card Data Studio Files
xet
 Community
11
tokenizers-test-data / models
98.7 MB
  • 4 contributors
 History: 1 commit
lysandre's picture
lysandre HF Staff
Add reproducible tokbench v1 model inputs
1214884 verified