解决Python中VLLM报错的方法指南

python vllm报错解决方法

报错内容

  File "<string>", line 1, in <module>
  File "/home/xxxx/miniconda3/envs/vllm/lib/python3.12/site-packages/torch/__init__.py", line 367, in <module>
    from torch._C import *  # noqa: F403
    ^^^^^^^^^^^^^^^^^^^^^^
ImportError: /home/xxxx/miniconda3/envs/vllm/lib/python3.12/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12

解决方法

命令行中添加临时环境变量, 注意路径要找自己的python环境路径.
export LD_LIBRARY_PATH=/home/xxx/miniconda3/envs/vllm/lib/python3.12/site-packages/nvidia/nvjitlink/lib:$LD_LIBRARY_PATH

因为是临时的环境变量,打开新的命令行窗口就失效了.
可以将其写入~/.bashrc 文件中
sudo nano ~/.bashrc

作者：qq_39364337