Update README.md

README.md

@@ -106,5 +106,27 @@ The benchmarks and metrics used are identical to those in the [Phi-3 technical r
 |MT Bench|2R. Avg.|8.38|8.7|-|6.77|-19.21%|-22.18%|-|
 ||||||**Average**|**-10.09%**|**-13.45%**|**+10.18%**|
 
-
 \*: We were unable to find an evaluation framework for this benchmark.
+
+### Comparsion to Gemma
+
+#### Gemma 1 & 2
+The benchmarks and metrics used are identical to those in the [Gemma 2 technical report](https://arxiv.org/abs/2408.00118).
+
+#### Gemma 3
+The benchmarks and metrics used are identical to those in the [Gemma 3 technical report](https://arxiv.org/abs/2503.19786).
+
+|Benchmark|Metric|Gemma 3 1B|Gemma 3 4B|Motif 2.6B|Improvement(over 1B)|Improvement(over 4B)|
+|---|---|---|---|---|---|---|
+|MMLU-Pro|5-shot|14.7|43.6|-|-|-|
+|LiveCodeBench*|-|1.9|12.6|-|-|-|
+|Bird-SQL(dev)\*|-|6.4|36.3|-|-|-|
+|GPQA Diamond|5-shot|19.2|30.8|31.81|+65.68%|+3.28%|
+|SimpleQA*|-|2.2|4|-|-|-|
+|FACTS Grounding*|-|36.4|70.1|-|-|-|
+|MATH|4-shot|48|75.6|40.2|-16.25%|-46.83%|
+|HiddenMath*|-|15.8|43|-|-|-|
+|MMLU(val)|5-shot|-|48.8|57.93|-|+18.71%|
+|||||**Average**|+24.71%|-8.28%|
+
+\*: We were unable to find an evaluation framework for this benchmark.