📟 Relay v0.1 (Mistral Nemo 2407): 8-bit (bnb)

This model page includes the 8-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 6

Safetensors

Model size

12B params

Tensor type

F32

F16

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(4)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-8bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated Dec 13, 2024