Original model: https://huggingface.co/5CD-AI/Vintern-1B-v3_5
How to use this
Install llama.cpp
Then:
llama-server -hf ngxson/Vintern-1B-v3_5-GGUF --chat-template vicuna
- Downloads last month
- 284
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support