使用transformers加载decapoda-research/llama-7b-hf的踩坑记录。
ValueError: Tokenizer class LLaMATokenizer does not exist or is not currently imported.
解决办法:
https://github.com/huggingface/transformers/issues/22222
将tokenizer_config.json中LLaMATokenizer改为LlamaTokenizer。
RecursionError: maximum recursion depth exceeded while getting the str of an object.
解决办法:
https://github.com/huggingface/transformers/issues/22762
使用tokenizer_config.json替换原本的tokenizer_config.json