🤝 Open to Collab

R PRO

juiceb0xc0de

·

https://github.com/JuiceB0xC0de

AI & ML interests

Mechanistic interpretation SAE weight training Novel architecture exploration Brain atlas builds

Recent Activity

repliedto Bc-AI's post about 2 hours ago

SmilyAI Weekly Update Hello everyone, I have some unfortunate news to share with everyone. My earlier estimate for the launch of G1 in late October was inaccurate. We sincerely apologise for any inconvenience this may cause, but with our current compute resources, pretraining a 20B MoE model is not realistically possible within two months. G1-MINI will also be postponed, but not for nearly as long — only by a few extra months. This is disappointing, as I know I was excited to launch G1, and I know many people were also watching the model and looking forward to it. However in my view, I would rather be honest about our limitations than be overly optimistic about something we currently cannot guarantee. G1 is not cancelled but uh it will be postponed indefinitely until I have the resources needed to train it. This could be next month, or it could take years. For now, I don't want to give another estimated launch date until I know we have the resources to actually make it happen. In the meantime, SmilyAI will continue developing AI and experimenting with new ideas, and we will provide updates as we go. Thank you for sticking with us and supporting SmilyAI. We will continue working towards better models in the future. Also, if you do have the hardware, to run it aka 8xH200s or better, my codebase is fully open under my very permissive license: i-have-no-idea-just-use-this. Basically, do whatever just mention me. https://huggingface.co/datasets/Bc-AI/train-g1/edit/main/train.py — Bc-AI, on behalf of SmilyAI-Labs

repliedto Bc-AI's post about 7 hours ago

SmilyAI Weekly Update Hello everyone, I have some unfortunate news to share with everyone. My earlier estimate for the launch of G1 in late October was inaccurate. We sincerely apologise for any inconvenience this may cause, but with our current compute resources, pretraining a 20B MoE model is not realistically possible within two months. G1-MINI will also be postponed, but not for nearly as long — only by a few extra months. This is disappointing, as I know I was excited to launch G1, and I know many people were also watching the model and looking forward to it. However in my view, I would rather be honest about our limitations than be overly optimistic about something we currently cannot guarantee. G1 is not cancelled but uh it will be postponed indefinitely until I have the resources needed to train it. This could be next month, or it could take years. For now, I don't want to give another estimated launch date until I know we have the resources to actually make it happen. In the meantime, SmilyAI will continue developing AI and experimenting with new ideas, and we will provide updates as we go. Thank you for sticking with us and supporting SmilyAI. We will continue working towards better models in the future. Also, if you do have the hardware, to run it aka 8xH200s or better, my codebase is fully open under my very permissive license: i-have-no-idea-just-use-this. Basically, do whatever just mention me. https://huggingface.co/datasets/Bc-AI/train-g1/edit/main/train.py — Bc-AI, on behalf of SmilyAI-Labs

repliedto Bc-AI's post about 7 hours ago

SmilyAI Weekly Update Hello everyone, I have some unfortunate news to share with everyone. My earlier estimate for the launch of G1 in late October was inaccurate. We sincerely apologise for any inconvenience this may cause, but with our current compute resources, pretraining a 20B MoE model is not realistically possible within two months. G1-MINI will also be postponed, but not for nearly as long — only by a few extra months. This is disappointing, as I know I was excited to launch G1, and I know many people were also watching the model and looking forward to it. However in my view, I would rather be honest about our limitations than be overly optimistic about something we currently cannot guarantee. G1 is not cancelled but uh it will be postponed indefinitely until I have the resources needed to train it. This could be next month, or it could take years. For now, I don't want to give another estimated launch date until I know we have the resources to actually make it happen. In the meantime, SmilyAI will continue developing AI and experimenting with new ideas, and we will provide updates as we go. Thank you for sticking with us and supporting SmilyAI. We will continue working towards better models in the future. Also, if you do have the hardware, to run it aka 8xH200s or better, my codebase is fully open under my very permissive license: i-have-no-idea-just-use-this. Basically, do whatever just mention me. https://huggingface.co/datasets/Bc-AI/train-g1/edit/main/train.py — Bc-AI, on behalf of SmilyAI-Labs

View all activity

Organizations

juiceb0xc0de 's collections 8