Hugging Face's logo
Kamie Yin's picture
22 3 1

Kamie Yin

ItzPingCat
·

AI & ML interests

None yet

Recent Activity

reacted to SeaWolf-AI's post with 🔥 16 days ago
🧬 Introducing Darwin-9B-NEG — the first model with Native Entropy Gating (NEG) 🔗 Try it now: https://huggingface.co/FINAL-Bench/Darwin-9B-NEG 🔗 Q4 bit : https://huggingface.co/FINAL-Bench/Darwin-9B-MFP4 We're thrilled to release Darwin-9B-NEG, a 9B-parameter reasoning model that embeds an architecturally-internalised sense of self-confidence directly into the transformer — our proprietary Native Entropy Gating (NEG) technology. 📊 GPQA Diamond (198 PhD-level questions): ▸ Baseline Darwin-9B (no NEG) → 51.01 % ▸ Pure NEG (greedy · 1× cost) → 63.64 % 🔥 +12.63 %p ▸ + Permutation (4× cost) → 76.26 % ▸ + Ensemble Refinement (~20×) → 84.34 % 🏆 With only 9 billion parameters and 1× inference cost, Pure NEG jumps +12.63 %p over the same model without NEG. Going all-in with ensemble refinement pushes it to 84.34 % — surpassing the published Qwen3.5-9B leaderboard score (81.7 %) by +2.64 %p. 🔬 What makes NEG different from Multi-Turn Iteration (MTI)? Classical MTI needs 3-8× extra inference passes. NEG instead lives INSIDE the single decoding loop. Two tiny modules ride with the transformer: NEG-Head predicts per-token entropy from the last hidden state, and NEG-Gate conditionally restricts the top-k choice when confidence is low. The gate activates in only 4.36 % of tokens — essentially free at inference time. ✨ Key differentiators • Architecturally internalised — model file *is* the feature • 1× inference cost (vs. 3-8× for MTI) • Drop-in with vLLM / SGLang / TGI / transformers — no extra engine • +12.63 %p reasoning at zero latency overhead • Single-file deployment, Apache 2.0 licensed 🧬 Lineage Qwen/Qwen3.5-9B → Darwin-9B-Opus (V7 evolutionary merge) → Darwin-9B-NEG (V8 + NEG training) #Darwin #NEG #NativeEntropyGating #GPQA #Reasoning #LLM #OpenSource #Apache2
liked a model 22 days ago
kabachuha/ltx23-pop
new activity 25 days ago
Nebsh/Inflatedballoon:What
View all activity

Organizations

None yet