Update README.md

README.md

@@ -141,35 +141,24 @@ The benchmarks and corresponding scores listed in the table below are taken dire
 
 |Benchmark|Metric|Gemma 3 1B|Gemma 3 4B|Motif 2.6B|Improvement(over 1B)|Improvement(over 4B)|
 |---|---|---|---|---|---|---|
-|MMLU-Pro|5-shot|14.7|43.6|-|-|-|
-|LiveCodeBench*|-|1.9|12.6|-|-|-|
-|Bird-SQL(dev)\*|-|6.4|36.3|-|-|-|
-|GPQA Diamond|5-shot|19.2|30.8|31.81|+65.68%|+3.28%|
-|SimpleQA*|-|2.2|4|-|-|-|
-|FACTS Grounding*|-|36.4|70.1|-|-|-|
-|MATH|4-shot|48|75.6|40.2|-16.25%|-46.83%|
-|HiddenMath*|-|15.8|43|-|-|-|
-|MMLU(val)|5-shot|-|48.8|57.93|-|+18.71%|
-|||||**Average**|**+24.71%**|**-8.28%**|
-
-\*: We were unable to find an evaluation framework for this benchmark.
-
-Given that the benchmark set in the Gemma 3 technical report seemed somewhat non-standard, we also compared its results with the Gemma 3 scores from the Qwen3 technical report, which were independently evaluated by the Qwen3 team.
-
-The benchmarks and corresponding scores listed in the table below are taken directly from the [Qwen3 technical report](https://arxiv.org/abs/2505.09388).
-
-|Benchmark|Metric|Gemma 3 1B|Gemma 3 4B|Motif 2.6B|Improvement(over 1B)|Improvement(over 4B)|
-|---|---|---|---|---|---|---|
-|MMLU|5-shot|51.81|59.51|57.93|+9.70%|-2.66%|
-|MMLU-Redux|5-shot|51.26|56.91|59.54|+16.15%|+4.62%|
-|MMLU-Pro|5-shot, CoT|24.74|29.23|-|-|-|
-|SuperGPQA|5-shot, CoT|15.03|17.68|-|-|-|
-|BBH|3-shot, CoT|41.47|51.7|48.56|+17.10%|-6.07%|
-|GPQA|5-shot, CoT|26.77|24.24|26.78|+0.04%|+10.48%|
-|GSM8K|4-shot, CoT|59.59|43.97|76.49|+28.36%|+73.96%|
-|MATH||4-shot, CoT|32.44|26.1|40.2|+23.92%|54.02%|
-|EvalPlus|0-shot|36.23|43.23|59.57|+64.42%|37.80%|
-|MultiPL-E|0-shot|24.58|28.06|-|-|-|
-|MBPP|3-shot|36.6|46.4|60.3|+64.75%|+29.96%|
-|CRUX-O|1-shot|27|34|28.1|+4.07%|-17.35%|
-|||||**Average**|**+25.39%**|**+20.53%**|
+|HellaS|10-shot|62.3|77.2|69.89|+12.18%|-9.47%|
+|BoolQ|0-shot|63.2|72.3|67.76|+7.22%|-6.28%|
+|PIQA|0-shot|73.8|79.6|75.59|+2.43%|-5.04%|
+|SIQA|0-shot|48.9|51.9|61.97|+26.73%|+19.40%|
+|TQA|5-shot|39.8|65.8|54.97|+38.12%|-16.46%|
+|NQ|5-shot|9.48|20|10.91|+15.08%|-45.45%|
+|ARC-C|25-shot|38.4|56.2|75.08|+95.52%|+33.59%|
+|ARC-E|0-shot|73|82.4|87.21|+19.47%|+5.84%|
+|WinoG|5-shot|58.2|64.7|67.09|+15.27%|+3.69%|
+|BBH|few-shot, CoT|28.4|50.9|48.56|+70.99%|-4.60%|
+|Drop|1-shot, F1|42.4|60.1|29.33|-30.83%|-51.20%|
+|MMLU|5-shot|-|59.6|57.93|-|-2.80%|
+|MMLUpro|5-shot, CoT|-|29.2|-|-|-|
+|AGIE|3-5-shot|-|42.1|-|-|-|
+|MATH|4-shot, CoT|-|24.2|40.2|-|+66.12%|
+|GSM8K|8-shot, CoT|-|38.4|77.71|-|+102.37%|
+|GPQA Diamond|5-shot, CoT|-|15|31.81|-|+112.07%|
+|MBPP|3-shot|-|46|60.3|-|+31.09%|
+|HumanE|0-shot|-|36|68.3|-|+89.72%|
+|IFEval|-|80.2|90.2|74.02|-7.71%|-17.94%|
+|||||**Average**|**+22.04%**|**+16.93%**|