LLaVA部署报错:ImportError: cannot import name ‘LlavaLlamaForCausalLM‘ from ‘llava.model‘

报错:
ImportError: cannot import name ‘LlavaLlamaForCausalLM’ from ‘llava.model’

方法一:
更换llava.__init__中的代码:

# from .model import LlavaLlamaForCausalLM
from .model.language_model.llava_llama import LlavaLlamaForCausalLM

有可能会报下一个错误:
ImportError: /home/linjl/anaconda3/envs/sd/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so:
undefined symbol:_ZN3c105ErrorC2ENS_14SourceLocationENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

那么就再用以下博客的方法:
http://t.csdnimg.cn/2QM6t

不行的话可以再参考该链接中的方法:
https://github.com/haotian-liu/LLaVA/issues/1101

作者:同屿Firmirin

物联沃分享整理
物联沃-IOTWORD物联网 » LLaVA部署报错:ImportError: cannot import name ‘LlavaLlamaForCausalLM‘ from ‘llava.model‘

发表回复