VIDRAFT AI Media
📰
17
Open models, self-improving AI and decision AI, measured
seawolf PRO
seawolf2357
AI & ML interests
None yet
Recent Activity
liked a Space 3 days ago
VIDraft/ai-media liked a model 3 days ago
FINAL-Bench/VKORE-46M-NPU reacted to SeaWolf-AI's post with 🚀 3 days ago
🚀 We pretrained a language model from scratch on an inference-only NPU, with real backpropagation.
🤗 Model: https://huggingface.co/FINAL-Bench/VKORE-46M-NPU 📝 Technical write-up: https://huggingface.co/blog/FINAL-Bench/backpropagation-on-an-inference-only-npu-pretraini
"NPUs are inference-only, you can't train on them." We built a counterexample: VKORE-46M-NPU, trained from scratch on a first-gen (2025) inference NPU, 32 chips, no pretrained weights. A 46M decoder-only model (RoPE · SwiGLU · RMSNorm · GQA), char-level, TinyStories.
📏 Why trust it: a falling-loss curve proves nothing. So we trained the same model under identical init, data, and schedule on the NPU and on a GPU reference. · Loss trajectories correlate at 0.99 · Throughput converged to a comparable level The NPU backward pass and optimizer updates do numerically the same work as the GPU, not an approximation that merely trends down.
🧩 One accelerator now covers pretraining · LoRA · inference · quantization. We call this layer VKORE: "CUDA for NPUs."
⚖️ Public: weights, model card, NPU-vs-GPU comparison. Private (patent-pending, paper to follow): the core training technique. 46M char-level is toy scale on purpose: it proves the training path, not model quality. Larger models and real data are next.
Feedback from folks working on custom autograd backends and low-precision training kernels on non-GPU accelerators is very welcome. 🙌Organizations
liked a
Space 3 days ago
liked a
model 3 days ago
reacted to SeaWolf-AI's post with 🚀 3 days ago
Post
2,719
🚀 We pretrained a language model from scratch on an inference-only NPU, with real backpropagation.
🤗 Model: FINAL-Bench/VKORE-46M-NPU 📝 Technical write-up: https://huggingface.co/blog/FINAL-Bench/backpropagation-on-an-inference-only-npu-pretraini
"NPUs are inference-only, you can't train on them." We built a counterexample: VKORE-46M-NPU, trained from scratch on a first-gen (2025) inference NPU, 32 chips, no pretrained weights. A 46M decoder-only model (RoPE · SwiGLU · RMSNorm · GQA), char-level, TinyStories.
📏 Why trust it: a falling-loss curve proves nothing. So we trained the same model under identical init, data, and schedule on the NPU and on a GPU reference. · Loss trajectories correlate at 0.99 · Throughput converged to a comparable level The NPU backward pass and optimizer updates do numerically the same work as the GPU, not an approximation that merely trends down.
🧩 One accelerator now covers pretraining · LoRA · inference · quantization. We call this layer VKORE: "CUDA for NPUs."
⚖️ Public: weights, model card, NPU-vs-GPU comparison. Private (patent-pending, paper to follow): the core training technique. 46M char-level is toy scale on purpose: it proves the training path, not model quality. Larger models and real data are next.
Feedback from folks working on custom autograd backends and low-precision training kernels on non-GPU accelerators is very welcome. 🙌
🤗 Model: FINAL-Bench/VKORE-46M-NPU 📝 Technical write-up: https://huggingface.co/blog/FINAL-Bench/backpropagation-on-an-inference-only-npu-pretraini
"NPUs are inference-only, you can't train on them." We built a counterexample: VKORE-46M-NPU, trained from scratch on a first-gen (2025) inference NPU, 32 chips, no pretrained weights. A 46M decoder-only model (RoPE · SwiGLU · RMSNorm · GQA), char-level, TinyStories.
📏 Why trust it: a falling-loss curve proves nothing. So we trained the same model under identical init, data, and schedule on the NPU and on a GPU reference. · Loss trajectories correlate at 0.99 · Throughput converged to a comparable level The NPU backward pass and optimizer updates do numerically the same work as the GPU, not an approximation that merely trends down.
🧩 One accelerator now covers pretraining · LoRA · inference · quantization. We call this layer VKORE: "CUDA for NPUs."
⚖️ Public: weights, model card, NPU-vs-GPU comparison. Private (patent-pending, paper to follow): the core training technique. 46M char-level is toy scale on purpose: it proves the training path, not model quality. Larger models and real data are next.
Feedback from folks working on custom autograd backends and low-precision training kernels on non-GPU accelerators is very welcome. 🙌
- 10 replies
liked 2
Spaces 6 days ago
liked a
dataset 6 days ago
liked a
Space 6 days ago
reacted to SeaWolf-AI's post with 👍 6 days ago
Post
4,623
⚛️ The Open Quantum Challenge is live. Both seasons open today.
Quantum computers are expensive, queued, and reachable by only a few. So we removed the barrier. With a single GPU and a public harness, anyone can contribute to core quantum-computing problems with no quantum hardware at all. That is the point of this challenge: to move quantum research from a handful of labs to everyone.
• Season 1, Quantum simulation: reproduce a target quantum system on a GPU.
• Season 2, QEC decoder: correct errors on coded quantum states.
Answers are held privately and every submission is auto-scored against a frozen ground truth, so the ranking is reproducible and hardware-independent.
🏆 Prize: 2,000 USD total (1,000 USD per season, 🥇600 / 🥈300 / 🥉100)
Getting started takes one step: copy the participation guide from the Space and paste it into Codex or Claude Code, then submit against the harness.
📄 Read the article: https://huggingface.co/blog/FINAL-Bench/the-open-quantum-challenge-quantum-simulation-and
👉 Challenge: FINAL-Bench/open-quantum-challenge
Quantum computers are expensive, queued, and reachable by only a few. So we removed the barrier. With a single GPU and a public harness, anyone can contribute to core quantum-computing problems with no quantum hardware at all. That is the point of this challenge: to move quantum research from a handful of labs to everyone.
• Season 1, Quantum simulation: reproduce a target quantum system on a GPU.
• Season 2, QEC decoder: correct errors on coded quantum states.
Answers are held privately and every submission is auto-scored against a frozen ground truth, so the ranking is reproducible and hardware-independent.
🏆 Prize: 2,000 USD total (1,000 USD per season, 🥇600 / 🥈300 / 🥉100)
Getting started takes one step: copy the participation guide from the Space and paste it into Codex or Claude Code, then submit against the harness.
📄 Read the article: https://huggingface.co/blog/FINAL-Bench/the-open-quantum-challenge-quantum-simulation-and
👉 Challenge: FINAL-Bench/open-quantum-challenge
liked a
Space 7 days ago
liked a
model 8 days ago
liked a
dataset 9 days ago
liked a
model 11 days ago
liked a
Space 12 days ago
liked a
Space 18 days ago
reacted to SeaWolf-AI's post with ❤️👍 19 days ago
Post
6,200
🧬 Darwin-180B-RSI — an AI that learns from itself and knows when it's right
👉 FINAL-Bench/Darwin-180B-RSI
🧬 Darwin — crossbreed and evolve the parent
Darwin diagnoses strong parent models like an MRI, inherits only their best parts, and evolves the weak spots — producing a child stronger than its parents.
Father model: Qwen3.8-Flash-Next (180B MoE).
🔧 Rewired paths
🔹 12 full-attention layers · 🔹 36 linear-attention layers · 🔹 48 shared-expert layers — precision-strengthened
🔒 512 routed experts · router · vision encoder — untouched
→ Only 0.02% of the weights changed.
🔁 RSI × 🏛️ ZTC
RSI (recursive self-improvement): solve → verify against real answers → learn only the correct reasoning → repeat.
ZTC (Zero-Token Confidence): reads the model's internal state once, before answering, and returns the probability the answer is right — zero extra tokens. Returns answer + confidence as JSON.
{"answer": "...", "confidence": 0.97, "truncated": false}
✨ Synergy: ZTC finds where the model wavers → RSI learns exactly there → confidence gets sharper. Low confidence = stop, so agents don't act on wrong answers.
⚡ Same accuracy, 11% shorter reasoning — faster and cheaper.
📄 https://arxiv.org/abs/2605.14386
🤗 FINAL-Bench/Darwin-180B-RSI
🏛️ https://huggingface.co/collections/FINAL-Bench/ztc-models-jev-ecosystems
🏆 The result — #1 on five Hugging Face official leaderboards
🥇 AIME 2026 100% (first perfect score on the board)
🥇 HMMT Feb 2026 100% (first perfect score on the board)
🥇 GPQA Diamond 94.44%
🥇 MMLU-Pro 88.12%
🥇 MMMU-Pro 79.48%
📏 131K-token thinking budget · bf16 · samples per benchmark listed on the model card. 🚀
#Darwin #RSI #ZTC #AIME #HMMT #GPQA #MMLUPro #MMMUPro #OpenSource
👉 FINAL-Bench/Darwin-180B-RSI
🧬 Darwin — crossbreed and evolve the parent
Darwin diagnoses strong parent models like an MRI, inherits only their best parts, and evolves the weak spots — producing a child stronger than its parents.
Father model: Qwen3.8-Flash-Next (180B MoE).
🔧 Rewired paths
🔹 12 full-attention layers · 🔹 36 linear-attention layers · 🔹 48 shared-expert layers — precision-strengthened
🔒 512 routed experts · router · vision encoder — untouched
→ Only 0.02% of the weights changed.
🔁 RSI × 🏛️ ZTC
RSI (recursive self-improvement): solve → verify against real answers → learn only the correct reasoning → repeat.
ZTC (Zero-Token Confidence): reads the model's internal state once, before answering, and returns the probability the answer is right — zero extra tokens. Returns answer + confidence as JSON.
{"answer": "...", "confidence": 0.97, "truncated": false}
✨ Synergy: ZTC finds where the model wavers → RSI learns exactly there → confidence gets sharper. Low confidence = stop, so agents don't act on wrong answers.
⚡ Same accuracy, 11% shorter reasoning — faster and cheaper.
📄 https://arxiv.org/abs/2605.14386
🤗 FINAL-Bench/Darwin-180B-RSI
🏛️ https://huggingface.co/collections/FINAL-Bench/ztc-models-jev-ecosystems
🏆 The result — #1 on five Hugging Face official leaderboards
🥇 AIME 2026 100% (first perfect score on the board)
🥇 HMMT Feb 2026 100% (first perfect score on the board)
🥇 GPQA Diamond 94.44%
🥇 MMLU-Pro 88.12%
🥇 MMMU-Pro 79.48%
📏 131K-token thinking budget · bf16 · samples per benchmark listed on the model card. 🚀
#Darwin #RSI #ZTC #AIME #HMMT #GPQA #MMLUPro #MMMUPro #OpenSource
liked a
model 19 days ago
liked a
model 22 days ago
liked a
Space 22 days ago
liked a
model 22 days ago