部署qwen2.5vl-32b时，报错 Exception:call aclnnArange failed, detail:EZ9999: Inner Error!_MindIE_昇腾论坛

# 部署qwen2.5vl-32b时，报错 Exception:call aclnnArange failed, detail:EZ9999: Inner Error!_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0270188707324170253-1-1.html

**生成时间**: 2025-08-27 10:33:57

---

## 问题描述

使用910b卡部署qwen2.5vl-32b时无法拉起mindie服务 环境是 部署过程为 https://modelers.cn/models/Models_Ecosystem/Qwen2.5-VL-32B-Instruct 拉起服务化时报 [2025-07-24 10:23:27.677619+08:00] [32534] [32535] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32733 exit, Please check the service log or python log. 2025-07-24 10:23:28,226 [ERROR] model.py:39 - [Model] >>> Exception:call aclnnArange failed, detail:EZ9999: Inner Error! EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail. TraceBack (most recent call last): AclOpKernelInit failed opType ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed. [ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize return self.python_model.initialize(config)  File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 146, in initialize self.generator =...

## 相关代码

### 代码示例 1

```
[2025-07-24 10:23:27.677619+08:00] [32534] [32535] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32733 exit, Please check the service log or python log.
2025-07-24 10:23:28,226 [ERROR] model.py:39 - [Model]   >>> Exception:call aclnnArange failed, detail:EZ9999: Inner Error!
EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail.
TraceBack (most recent call last):
AclOpKernelInit failed opType
ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed.

[ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize
return self.python_model.initialize(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 146, in initialize
self.generator = Generator(
^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py", line 79, in __init__
self.generator_backend = get_generator_backend(model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/__init__.py", line 26, in get_generator_backend
return generator_cls(model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 96, in __init__
super().__init__(model_config)
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 107, in __init__
self.model_wrapper = get_model_wrapper(model_config, backend_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 15, in get_model_wrapper
return wrapper_cls(**model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 46, in __init__
self.model_runner.load_weights()
File "/usr/local/Ascend/atb-models/atb_llm/runner/model_runner.py", line 180, in load_weights
self.model = self.model_cls(self.config,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 79, in __init__
super().__init__(config, weights, **kwargs)
File "/usr/local/Ascend/atb-models/atb_llm/models/base/flash_causal_multimodal.py", line 184, in __init__
self.init_vit()
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 88, in init_vit
self.vision_tower = Qwen25VisionTransformerPretrainedModelATB(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_5_vl_vit_atb.py", line 769, in __init__
self.rotary_pos_emb = VisionRotaryEmbedding(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_vl_vit_atb.py", line 70, in __init__
t = torch.arange(seqlen, device=device, dtype=torch.float)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: call aclnnArange failed, detail:EZ9999: Inner Error!
EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail.
TraceBack (most recent call last):
AclOpKernelInit failed opType
ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed.

[ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed
2025-07-24 10:23:28,315 [ERROR] model.py:42 - [Model]   >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
[2025-07-24 10:23:28,395] [32735] [281458429915488] [llmmodels] [INFO] [dist.py-81] : initialize_distributed has been Set
[2025-07-24 10:23:28.425558+08:00] [32534] [32534] [server] [WARN] [llm_daemon.cpp:64] : [Daemon] received exit signal[17]
[2025-07-24 10:23:28.425692+08:00] [32534] [32534] [server] [INFO] [llm_daemon.cpp:69] : Daemon wait pid with 32742, status 9
[2025-07-24 10:23:28.425703+08:00] [32534] [32534] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32742 exit, Please check the service log or python log.
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
Process ForkServerProcess-4:
Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod
conn = self._tls.connection
^^^^^^^^^^^^^^^^^^^^
AttributeError: 'ForkAwareLocal' object has no attribute 'connection'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/process.py", line 314, in _bootstrap
self.run()
File "/usr/lib64/python3.11/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 71, in wrapper
raise exp
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 63, in wrapper
func(*args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 264, in task_distribute
resource_proxy[SUB_PROCESS_STATE].append(True)
File "<string>", line 2, in append
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 818, in _callmethod
self._connect()
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 805, in _connect
conn = self._Client(self._token.address, authkey=self._authkey)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib64/python3.11/multiprocessing/connection.py", line 518, in Client
c = SocketClient(address)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib64/python3.11/multiprocessing/connection.py", line 646, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
Process ForkServerProcess-3:
Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod
conn = self._tls.connection
^^^^^^^^^^^^^^^^^^^^
AttributeError: 'ForkAwareLocal' object has no attribute 'connection'
复制
```

### 代码示例 2

```
[2025-07-24 10:23:27.677619+08:00] [32534] [32535] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32733 exit, Please check the service log or python log.
2025-07-24 10:23:28,226 [ERROR] model.py:39 - [Model]   >>> Exception:call aclnnArange failed, detail:EZ9999: Inner Error!
EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail.
TraceBack (most recent call last):
AclOpKernelInit failed opType
ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed.

[ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize
return self.python_model.initialize(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 146, in initialize
self.generator = Generator(
^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py", line 79, in __init__
self.generator_backend = get_generator_backend(model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/__init__.py", line 26, in get_generator_backend
return generator_cls(model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 96, in __init__
super().__init__(model_config)
File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 107, in __init__
self.model_wrapper = get_model_wrapper(model_config, backend_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 15, in get_model_wrapper
return wrapper_cls(**model_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 46, in __init__
self.model_runner.load_weights()
File "/usr/local/Ascend/atb-models/atb_llm/runner/model_runner.py", line 180, in load_weights
self.model = self.model_cls(self.config,
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 79, in __init__
super().__init__(config, weights, **kwargs)
File "/usr/local/Ascend/atb-models/atb_llm/models/base/flash_causal_multimodal.py", line 184, in __init__
self.init_vit()
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 88, in init_vit
self.vision_tower = Qwen25VisionTransformerPretrainedModelATB(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_5_vl_vit_atb.py", line 769, in __init__
self.rotary_pos_emb = VisionRotaryEmbedding(
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_vl_vit_atb.py", line 70, in __init__
t = torch.arange(seqlen, device=device, dtype=torch.float)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: call aclnnArange failed, detail:EZ9999: Inner Error!
EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail.
TraceBack (most recent call last):
AclOpKernelInit failed opType
ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed.

[ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed
2025-07-24 10:23:28,315 [ERROR] model.py:42 - [Model]   >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'}
[2025-07-24 10:23:28,395] [32735] [281458429915488] [llmmodels] [INFO] [dist.py-81] : initialize_distributed has been Set
[2025-07-24 10:23:28.425558+08:00] [32534] [32534] [server] [WARN] [llm_daemon.cpp:64] : [Daemon] received exit signal[17]
[2025-07-24 10:23:28.425692+08:00] [32534] [32534] [server] [INFO] [llm_daemon.cpp:69] : Daemon wait pid with 32742, status 9
[2025-07-24 10:23:28.425703+08:00] [32534] [32534] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32742 exit, Please check the service log or python log.
[ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared!
Process ForkServerProcess-4:
Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod
conn = self._tls.connection
^^^^^^^^^^^^^^^^^^^^
AttributeError: 'ForkAwareLocal' object has no attribute 'connection'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/process.py", line 314, in _bootstrap
self.run()
File "/usr/lib64/python3.11/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 71, in wrapper
raise exp
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 63, in wrapper
func(*args, **kwargs)
File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 264, in task_distribute
resource_proxy[SUB_PROCESS_STATE].append(True)
File "<string>", line 2, in append
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 818, in _callmethod
self._connect()
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 805, in _connect
conn = self._Client(self._token.address, authkey=self._authkey)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib64/python3.11/multiprocessing/connection.py", line 518, in Client
c = SocketClient(address)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib64/python3.11/multiprocessing/connection.py", line 646, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
Process ForkServerProcess-3:
Traceback (most recent call last):
File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod
conn = self._tls.connection
^^^^^^^^^^^^^^^^^^^^
AttributeError: 'ForkAwareLocal' object has no attribute 'connection'
```

## 完整内容

使用910b卡部署qwen2.5vl-32b时无法拉起mindie服务 环境是 部署过程为 https://modelers.cn/models/Models_Ecosystem/Qwen2.5-VL-32B-Instruct 拉起服务化时报 [2025-07-24 10:23:27.677619+08:00] [32534] [32535] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32733 exit, Please check the service log or python log. 2025-07-24 10:23:28,226 [ERROR] model.py:39 - [Model] >>> Exception:call aclnnArange failed, detail:EZ9999: Inner Error! EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail. TraceBack (most recent call last): AclOpKernelInit failed opType ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed. [ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/model_wrapper/model.py", line 37, in initialize return self.python_model.initialize(config)  File "/usr/local/lib/python3.11/site-packages/model_wrapper/standard_model.py", line 146, in initialize self.generator = Generator(  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/generator.py", line 79, in __init__ self.generator_backend = get_generator_backend(model_config)  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/__init__.py", line 26, in get_generator_backend return generator_cls(model_config)  File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_torch.py", line 96, in __init__ super().__init__(model_config) File "/usr/local/lib/python3.11/site-packages/mindie_llm/text_generator/adapter/generator_backend.py", line 107, in __init__ self.model_wrapper = get_model_wrapper(model_config, backend_type)  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py", line 15, in get_model_wrapper return wrapper_cls(**model_config)  File "/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_model_wrapper.py", line 46, in __init__ self.model_runner.load_weights() File "/usr/local/Ascend/atb-models/atb_llm/runner/model_runner.py", line 180, in load_weights self.model = self.model_cls(self.config,  File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 79, in __init__ super().__init__(config, weights, **kwargs) File "/usr/local/Ascend/atb-models/atb_llm/models/base/flash_causal_multimodal.py", line 184, in __init__ self.init_vit() File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/flash_causal_qwen2_vl.py", line 88, in init_vit self.vision_tower = Qwen25VisionTransformerPretrainedModelATB(  File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_5_vl_vit_atb.py", line 769, in __init__ self.rotary_pos_emb = VisionRotaryEmbedding(  File "/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/modeling_qwen2_vl_vit_atb.py", line 70, in __init__ t = torch.arange(seqlen, device=device, dtype=torch.float)  RuntimeError: call aclnnArange failed, detail:EZ9999: Inner Error! EZ9999: [PID: 32742] 2025-07-24-10:23:28.197.611 Parse dynamic kernel config fail. TraceBack (most recent call last): AclOpKernelInit failed opType ArangeAiCore ADD_TO_LAUNCHER_LIST_AICORE failed. [ERROR] 2025-07-24-10:23:28 (PID:32742, Device:5, RankID:-1) ERR01100 OPS call acl api failed 2025-07-24 10:23:28,315 [ERROR] model.py:42 - [Model] >>> return initialize error result: {'status': 'error', 'npuBlockNum': '0', 'cpuBlockNum': '0'} [2025-07-24 10:23:28,395] [32735] [281458429915488] [llmmodels] [INFO] [dist.py-81] : initialize_distributed has been Set [2025-07-24 10:23:28.425558+08:00] [32534] [32534] [server] [WARN] [llm_daemon.cpp:64] : [Daemon] received exit signal[17] [2025-07-24 10:23:28.425692+08:00] [32534] [32534] [server] [INFO] [llm_daemon.cpp:69] : Daemon wait pid with 32742, status 9 [2025-07-24 10:23:28.425703+08:00] [32534] [32534] [server] [ERROR] [llm_daemon.cpp:74] : ERR: Daemon wait pid with 32742 exit, Please check the service log or python log. [ERROR] TBE Subprocess[task_distribute] raise error[], main process disappeared! Process ForkServerProcess-4: Traceback (most recent call last): File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod conn = self._tls.connection  AttributeError: 'ForkAwareLocal' object has no attribute 'connection' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib64/python3.11/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib64/python3.11/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 71, in wrapper raise exp File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 63, in wrapper func(*args, **kwargs) File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 264, in task_distribute resource_proxy[SUB_PROCESS_STATE].append(True) File "<string>", line 2, in append File "/usr/lib64/python3.11/multiprocessing/managers.py", line 818, in _callmethod self._connect() File "/usr/lib64/python3.11/multiprocessing/managers.py", line 805, in _connect conn = self._Client(self._token.address, authkey=self._authkey)  File "/usr/lib64/python3.11/multiprocessing/connection.py", line 518, in Client c = SocketClient(address)  File "/usr/lib64/python3.11/multiprocessing/connection.py", line 646, in SocketClient s.connect(address) ConnectionRefusedError: [Errno 111] Connection refused Process ForkServerProcess-3: Traceback (most recent call last): File "/usr/lib64/python3.11/multiprocessing/managers.py", line 814, in _callmethod conn = self._tls.connection  AttributeError: 'ForkAwareLocal' object has no attribute 'connection' 复制 请问是什么问题有什么解决的方法

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 错误处理
2. **涉及技术**: HTTPS, NPU, MindIE, 昇腾, AI
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*