参考:
https://www.listera.top/ji-xu-zhe-teng-xia-chinese-llama-alpaca/
https://blog.csdn.net/qq_38238956/article/details/130113599
cmake windows安装参考:https://blog.csdn.net/weixin_42357472/article/details/131314105
llama.cpp下载编译
1、下载:
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
2、编译
mkdir build
cd build
cmake ..
cmake --build . --config Release
3、测试运行
cd bin\Release
./main -h
运行LLaMA-7B模型测试
参考:
https://zhuanlan.zhihu.com/p/638427280
模型下载:
https://huggingface.co/nyanko7/LLaMA-7B/tree/main
下载下来后在llama.cpp-master\mode