当前位置:AIGC资讯 > AIGC > 正文

llama.cpp LLM模型 windows cpu安装部署;运行LLaMA2模型测试

参考:
https://www.listera.top/ji-xu-zhe-teng-xia-chinese-llama-alpaca/
https://blog.csdn.net/qq_38238956/article/details/130113599

cmake windows安装参考:https://blog.csdn.net/weixin_42357472/article/details/131314105

llama.cpp下载编译

1、下载:

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp

2、编译

mkdir build
cd build
cmake ..
cmake --build . --config Release

3、测试运行

cd bin\Release
./main -h

运行LLaMA-7B模型测试

参考:
https://zhuanlan.zhihu.com/p/638427280

模型下载:
https://huggingface.co/nyanko7/LLaMA-7B/tree/main
下载下来后在llama.cpp-master\mode

更新时间 2023-12-28