Llama.cpp

来自WHY42

Build llama.cpp

[1] 

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make

Convert Hugging Face Model to GGUF

pip install -r requirements.txt
python convert_hf_to_gguf.py --help
  1. ↑ https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
取自“https://riguz.com/index.php?title=Llama.cpp&oldid=4328”