Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Data-Selection
/
data_scorer
like
0
Follow
Data Selection
8
togethercomputer/RedPajama-Data-1T
English
arxiv:
2410.07064
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
data_scorer
251 MB
1 contributor
History:
4 commits
t1101675
Update README.md
d9b2b78
verified
12 months ago
.gitattributes
1.52 kB
initial commit
12 months ago
README.md
968 Bytes
Update README.md
12 months ago
config.json
97 Bytes
Upload folder using huggingface_hub
12 months ago
data_scorer_model.pt
247 MB
xet
Upload folder using huggingface_hub
12 months ago
merges.txt
456 kB
Upload folder using huggingface_hub
12 months ago
special_tokens_map.json
694 Bytes
Upload folder using huggingface_hub
12 months ago
tokenizer.json
2.11 MB
Upload folder using huggingface_hub
12 months ago
tokenizer_config.json
1.23 kB
Upload folder using huggingface_hub
12 months ago
vocab.json
798 kB
Upload folder using huggingface_hub
12 months ago