本地部署和Qwen3 32B求助_MindIE_昇腾论坛

# 本地部署和Qwen3 32B求助_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0279186176638616028-1-1.html

**生成时间**: 2025-08-27 10:34:00

---

## 问题描述

硬件2Kunpeng 920 CPU + 8张Atlas 300I DUO 96GB显存 + 512GB DDR4内存硬盘2块1.96T的固态本地部署和Qwen3 32B用的2.0.RC2-300I-Duo-py311-openeuler24.03-lts镜像MindIE 服务启动失败的核心原因是 Qwen3-32B 模型未被 ATB 框架原生支持求助怎么解决 [root@localhost bin]# cd /usr/local/Ascend/mindie/latest/mindie-service/bin ./mindieservice_daemon The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be ...

## 完整内容

硬件2Kunpeng 920 CPU + 8张Atlas 300I DUO 96GB显存 + 512GB DDR4内存硬盘2块1.96T的固态本地部署和Qwen3 32B用的2.0.RC2-300I-Duo-py311-openeuler24.03-lts镜像MindIE 服务启动失败的核心原因是 Qwen3-32B 模型未被 ATB 框架原生支持求助怎么解决 [root@localhost bin]# cd /usr/local/Ascend/mindie/latest/mindie-service/bin ./mindieservice_daemon The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible. The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. 2025-06-25 03:33:39.884 1103 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg [2025-06-25 03:33:39.884] [1101] [281472814079968] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success! [2025-06-25 03:33:39.885] [1101] [281472814079968] [llm] [DEBUG] [model_deploy_config.cpp:80] ModelDeployConfig::pySonamelibpython3.11.so [2025-06-25 03:33:44.550] [1101] [281472814079968] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: NotImplementedError: unsupported model type: qwen3请确认atb_llm.models路径下是否存在名为qwen3的文件夹 At: /usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper [2025-06-25 03:33:44.550] [1101] [281472814079968] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: NotImplementedError: unsupported model type: qwen3请确认atb_llm.models路径下是否存在名为qwen3的文件夹 At: /usr/local/Ascend/atb-models/atb_llm/models/__init__.py(94): get_model /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper [2025-06-25 03:33:44.551+08:00] [1101] [1103] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail! LLMInferEngine failed to init LLMInferModels [2025-06-25 03:33:44.551+08:00] [1101] [1103] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed [2025-06-25 03:33:44.551+08:00] [1101] [1103] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details [2025-06-25 03:33:44.551+08:00] [1101] [localhost.localdomain] [system] [server] [Start engine(mindieservice_llm_engine)] [fail] [2025-06-25 03:33:44.551+08:00] [1101] [1103] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine [2025-06-25 03:33:44.551+08:00] [1101] [1103] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output. [2025-06-25 03:33:44.551+08:00] [1101] [localhost.localdomain] [system] [server] [Start mindie server] [fail] Killed [root@localhost bin]# 2.0.RC2不支持qwen3,可以参考https://www.hiascend.com/forum/thread-0255182144444158080-1-1.html?postId=03108182164470859284 通过嫁接的方式实现 千问3的发布时间和我们mindie 2.0 的发布时间你这边看一下呢 可以用vllm部署qwen3

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 错误处理
2. **涉及技术**: HTTPS, Atlas, MindIE, 昇腾, AI
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*