Base Model for TransMLA
mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
updated a dataset about 1 month ago
fxmeng/UltraData-SFT-2605-no-think-8k-32k updated a dataset about 1 month ago
fxmeng/UltraData-SFT-2605-no-think-32k-200k published a dataset about 1 month ago
fxmeng/UltraData-SFT-2605-no-think-32k-200kOrganizations
None yet
models 53
fxmeng/TransMLA-llama3-8b-32k
8B • Updated • 14
fxmeng/TransMLA-llama3-8b-8k
8B • Updated • 32
fxmeng/PiSSA-llama-7b-commonsense-148k
7B • Updated • 6
fxmeng/PiSSA-Llama-3-8b-commonsense-148k
8B • Updated • 11
fxmeng/PiSSA-Llama-2-7b-commonsense-148k
7B • Updated • 8
fxmeng/PiSSA-llama-13b-commonsense-148k
13B • Updated • 5
fxmeng/CLOVER-llama-3-8b-commonsense-148k
8B • Updated • 4
fxmeng/CLOVER-llama-2-7b-commonsense-148k
7B • Updated • 5
fxmeng/CLOVER-llama-13b-commonsense-148k
13B • Updated • 4
fxmeng/CLOVER-llama-7b-commonsense-148k
7B • Updated • 6
datasets 14
fxmeng/UltraData-SFT-2605-no-think-8k-32k
Viewer • Updated • 947k • 574
fxmeng/UltraData-SFT-2605-no-think-32k-200k
Viewer • Updated • 17.6k • 414
fxmeng/transmla_pretrain_100m_tokens
Viewer • Updated • 100k • 17
fxmeng/transmla_pretrain_1B_tokens
Viewer • Updated • 1.14M • 59
fxmeng/transmla_pretrain_6B_tokens
Viewer • Updated • 5.94M • 329
fxmeng/pissa-dataset
Viewer • Updated • 844k • 1.15k • 3
fxmeng/big-bench-hard-continue-finetuning
Viewer • Updated • 10.3k • 95 • 1
fxmeng/commonsense_filtered
Viewer • Updated • 170k • 217 • 1
fxmeng/MetaMath-GSM240K
Viewer • Updated • 240k • 36 • 1
fxmeng/MetaMath-MATH155K
Viewer • Updated • 155k • 28