Model suddenly writes absolute gibberish without changing anything.
As mentioned in the title, the model suddenly writes absolute gibberish without changing anything. The previous narrative style is completely broken and no longer makes any sense. I noticed this with several different models that I load in 4-bit. Any ideas? Ty for any help im still very new!
You might be using the wrong chat template. Make sure to use the Tekken version of Mistral chat. Using the non-Tekken variant will degrade performance.
You might be using the wrong chat template. Make sure to use the Tekken version of Mistral chat. Using the non-Tekken variant will degrade performance.
I will try later!, ty for the fast reply. Im in love with your models ! <3 especially: cydonia and Rocinante. Do you have other models that i can use with my 4090? Keep up the work!