Text Generation
GGUF
English
gpt_oss
gpt-oss
openai
mxfp4
programming
code generation
code
coding
coder
chat
reasoning
thinking
r1
cot
deepseek
128k context
general usage
problem solving
brainstorming
solve riddles
uncensored
abliterated
Neo
MOE
Mixture of Experts
24 experts
NEO Imatrix
Imatrix
DI-Matrix
Tri-Matrix
imatrix
conversational
Ollama & Langchain issue with roles , always result . . . . .<|end|><|start|>assistant<|channel|>final<|message|> not as expected
#11
by
BLOOD-IRON
- opened
Ollama & Langchain API issue with roles , always result . . . . .<|end|><|start|>assistant<|channel|>final<|message|> not as expected
FROM ./OpenAI-20B-NEO-CODE2-Plus-Uncensored-IQ4_NL.gguf
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
PARAMETER top_p 0.9
PARAMETER top_k 50
PARAMETER repeat_penalty 1.1
TEMPLATE """
User: {{ .Prompt }}
Assistant:
"""
Suggest trying with Lmstudio to see if this resolves issue.
OPEN AI 20B, has a specialized template system called "Harmony" - if it not up to date/patched -> all kinds of odd issues.
Other possible:
Try Q5_0/1 Gguf.
IQ4_NL is odd sometimes.