SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs
Paper
•
2412.08347
•
Published
•
4
Sultan Alrashed PRO
SultanR
AI & ML interests
Smol language modelling!
Recent Activity
updated
a dataset
about 5 hours ago
AdaMLLab/AraMix
updated
a dataset
5 days ago
AdaMLLab/mlqa_repaired
published
a dataset
5 days ago
AdaMLLab/mlqa_repaired
Organizations
authored
4
papers
about 1 year ago
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Paper
•
2402.01781
•
Published
•
4
Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models
Paper
•
2411.06402
•
Published
•
2
ALLaM: Large Language Models for Arabic and English
Paper
•
2407.15390
•
Published
•
3