300I DUO 部署 Qwen2-VL-7B-Instruct 报错_MindIE_昇腾论坛

# 300I DUO 部署 Qwen2-VL-7B-Instruct 报错_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0267186911762870089-1-1.html

**生成时间**: 2025-08-27 10:33:59

---

## 问题描述

步骤 1启动容器将本地的模型挂载到容器中 本地 /data/model 挂载 容器 /models export IMAGE=swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-300I-Duo-py311-openeuler24.03-lts docker run -d \ --shm-size 500g \ --name qwen-vl \ --device /dev/davinci4 \ --device /dev/davinci5 \ --device /dev/davinci6 \ --device /dev/davinci7 \ --device /dev/davinci_manager \ --device /dev/devmm_svm \ --device /dev/hisi_hdc \ -v /usr/local/dcmi:/usr/local/dcmi \ -v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \ -v /usr/local/Ascend/driver/lib64/:/usr/local/Ascend/driver/lib64/ \ -v /usr/local/Ascend/driver/version.info:/usr/local/Ascend/driver/version.info \ -v /etc/ascend_install.info:/etc/ascend_install.info \ -v /data/model:/models:ro \ -p 9025:1025 \ -e VLLM_USE_MODELSCOPE=True \ -e PYTORCH_NPU_ALLOC_CONF=max_split_size_mb:256 \ $IMAGE sleep infinity 2安装atb对应qwen2_vl依赖 pip install -r /usr/local/Ascend/atb-models/requirements/models/requirements_qwen2_vl.txt 3配置修改 修改模型里面conf.json torch_type 为 float16 修改mindie配置 3启动mindie服...

## 相关代码

### 代码示例 1

```
pip install -r /usr/local/Ascend/atb-models/requirements/models/requirements_qwen2_vl.txt
```

## 相关图片

### 图片 1

![cke_107193.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/da4/a62/a5f/c545fa7f27da4a62a5fa61870c090381.20250703075414.59911306877529345726586871381123:20250827021742:2400:6289CDAD231773A813692700A23350BFEAADB8D553282FE0E289BD15C3A009D1.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/da4/a62/a5f/c545fa7f27da4a62a5fa61870c090381.20250703075414.59911306877529345726586871381123:20250827021742:2400:6289CDAD231773A813692700A23350BFEAADB8D553282FE0E289BD15C3A009D1.png

**图片描述**: cke_107193.png

## 完整内容

步骤 1启动容器将本地的模型挂载到容器中 本地 /data/model 挂载 容器 /models export IMAGE=swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-300I-Duo-py311-openeuler24.03-lts docker run -d \ --shm-size 500g \ --name qwen-vl \ --device /dev/davinci4 \ --device /dev/davinci5 \ --device /dev/davinci6 \ --device /dev/davinci7 \ --device /dev/davinci_manager \ --device /dev/devmm_svm \ --device /dev/hisi_hdc \ -v /usr/local/dcmi:/usr/local/dcmi \ -v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \ -v /usr/local/Ascend/driver/lib64/:/usr/local/Ascend/driver/lib64/ \ -v /usr/local/Ascend/driver/version.info:/usr/local/Ascend/driver/version.info \ -v /etc/ascend_install.info:/etc/ascend_install.info \ -v /data/model:/models:ro \ -p 9025:1025 \ -e VLLM_USE_MODELSCOPE=True \ -e PYTORCH_NPU_ALLOC_CONF=max_split_size_mb:256 \ $IMAGE sleep infinity 2安装atb对应qwen2_vl依赖 pip install -r /usr/local/Ascend/atb-models/requirements/models/requirements_qwen2_vl.txt 3配置修改 修改模型里面conf.json torch_type 为 float16 修改mindie配置 3启动mindie服务 cd $MIES_INSTALL_PATH ./bin/mindieservice_daemon 启动日志 Log default log dir is ~/mindie/log, your can use env MINDIE_LOG_PATH to change log saving dir. [msservice_profiler] [PID:22719] [DEBUG] [ReadEnable:344] profile enable_: false [msservice_profiler] [PID:22719] [DEBUG] [ReadAclTaskTime:372] profile enableAclTaskTime_: false You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. You are using a model of type qwen2_vl to instantiate a model of type . This is not supported for all configurations of models and can yield errors. Daemon start success! 请求接口 /v1/chat/completions控制台立即收到报错如下 File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_vl_vit_atb.py", line 937, in forward vision_features = self.encoder(  File "/usr/local/lib64/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl return self._call_impl(*args, **kwargs)  File "/usr/local/lib64/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl return forward_call(*args, **kwargs)  File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_vl_vit_atb.py", line 847, in forward hidden_states = self.graph.forward(self.graph_inputs, self.graph_outputs, self.graph_param)  RuntimeError: The Inner error is reported as above. The process exits for this inner error, and the current working operator name is Qwen2VL_VIT_graph. Since the operator is called asynchronously, the stacktrace may be inaccurate. If you want to get the accurate stacktrace, pleace set the environment variable ASCEND_LAUNCH_BLOCKING=1. Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging. [ERROR] 2025-07-03-15:49:28 (PID:22828, Device:1, RankID:-1) ERR00100 PTA call acl api failed. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib64/python3.11/threading.py", line 1045, in _bootstrap_inner self.run() File "/usr/lib64/python3.11/threading.py", line 982, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 163, in do_inference responses = self.execute(requests, config_map)  File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 74, in execute return self.python_model.execute(requests, config_map)  File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 187, in execute _print_component_error_log(e) File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 55, in _print_component_error_log raise RuntimeError(f"CANN execute error, Exception: {e}") from e RuntimeError: CANN execute error, Exception: The Inner error is reported as above. The process exits for this inner error, and the current working operator name is Qwen2VL_VIT_graph. Since the operator is called asynchronously, the stacktrace may be inaccurate. If you want to get the accurate stacktrace, pleace set the environment variable ASCEND_LAUNCH_BLOCKING=1. Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging. [ERROR] 2025-07-03-15:49:28 (PID:22828, Device:1, RankID:-1) ERR00100 PTA call acl api failed. 看下日志吧这个报错信息是没有用的

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 错误处理
2. **涉及技术**: PyTorch, NPU, Docker, MindIE, 昇腾, CANN, AI
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*