decapoda-research/llama-7b-hf 的踩坑记录

蓝天采集器-开源免费无限制云端爬虫系统

使用transformers加载decapoda-research/llama-7b-hf的踩坑记录。

ValueError: Tokenizer class LLaMATokenizer does not exist or is not currently imported.
解决办法：
https://github.com/huggingface/transformers/issues/22222
将tokenizer_config.json中LLaMATokenizer改为LlamaTokenizer。

RecursionError: maximum recursion depth exceeded while getting the str of an object.
解决办法：
https://github.com/huggingface/transformers/issues/22762
使用tokenizer_config.json替换原本的tokenizer_config.json

来源：https://blog.csdn.net/qq_35166730/article/details/133998343

蓝天采集器-开源免费无限制云端爬虫系统