Llama.cpp
Build llama.cpp
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make
Convert Hugging Face Model to GGUF
pip install -r requirements.txt
欢迎来到Riguz的小站!这是一个私人wiki,用来记录一些我的笔记。
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make
pip install -r requirements.txt