Atlas 300i Duo上部署qwen3-32b后启动失败_MindIE_昇腾论坛

# Atlas 300i Duo上部署qwen3-32b后启动失败_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0250190625262964283-1-1.html

**生成时间**: 2025-08-27 10:33:56

---

## 问题描述

更新过驱动固件和mindie2.1.RC1-300I-Duo-py311能正常运行deepseek-r1-32b没找到原因希望大佬指点 报错内容 LLMInferEngine failed to init LLMInferModels Killed 容器创建 docker run -it -d --net=host --shm-size=500g --privileged --name Qwen3 --device=/dev/davinci_manager --device=/dev/hisi_hdc --device=/dev/devmm_svm -v /usr/local/Ascend/driver:/usr/local/Ascend/driver:ro -v /usr/local/sbin:/usr/local/sbin:ro -v /ubuntu/models/Qwen3:/Qwen3 29635b767eda bash 容器内映射模型的位置与内容 qwen3 config的修改 容器config文件的修改 以上就是我大部分配置内容了 顺便问一句现在官方文档这个微推理的意思式以后启动模型不在需要mindie了吗 有人在300i Duo上部署QwQ-32b和gpt-oss-20b了吗感谢~ 300i-96G-4卡部署成功qwen3-32B你可以看看"transformers_version": "4.51.0"你docker内的版本是否大于等于这个 另外我在部署过程中试过多个版本的驱动和Firmware Version的版本现在跑qwen3-32B只有5Token/s太慢了你现在速度能跑到多少 1"torch_dtype": "float16", 你漏了个 l 2你这个错误以前是说目录权限问题不过只要root大部分也问题不大可以关注下 3另外我之前用论坛大佬给的ATB版本运行qwen3-32B 是没问题的

## 相关图片

### 图片 1

![%E6%8A%A5%E9%94%99%E5%86%85%E5%AE%B9.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071416.13301719679905380224346591469661:20250827014037:2400:22439F5BB894CE32FED285095421BE80975164972E4B45D98CD2906A59A37D1B.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071416.13301719679905380224346591469661:20250827014037:2400:22439F5BB894CE32FED285095421BE80975164972E4B45D98CD2906A59A37D1B.png

**图片描述**: %E6%8A%A5%E9%94%99%E5%86%85%E5%AE%B9.png

### 图片 2

![qwen3%E6%A8%A1%E5%9E%8B%E4%BD%8D%E7%BD%AE.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071708.44542132279461191230587381351104:20250827014037:2400:FD80D06B066E370FA0925122AC170748B235ADE629D23A47EC9E3FA59CBD0E00.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071708.44542132279461191230587381351104:20250827014037:2400:FD80D06B066E370FA0925122AC170748B235ADE629D23A47EC9E3FA59CBD0E00.png

**图片描述**: qwen3%E6%A8%A1%E5%9E%8B%E4%BD%8D%E7%BD%AE.png

### 图片 3

![qwen3config%E6%B5%AE%E7%82%B916%E9%85%8D%E7%BD%AE.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071749.24146555910887792149869171567267:20250827014037:2400:5543209487C3ABE78509233C64902A83F67AD7E45640E632B3BB48C8D75A2F1B.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071749.24146555910887792149869171567267:20250827014037:2400:5543209487C3ABE78509233C64902A83F67AD7E45640E632B3BB48C8D75A2F1B.png

**图片描述**: qwen3config%E6%B5%AE%E7%82%B916%E9%85%8D%E7%BD%AE.png

### 图片 4

![%E5%AE%B9%E5%99%A8config%E9%85%8D%E7%BD%AE01.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071900.75267423280084571746509784885325:20250827014037:2400:D984320BF216D679B9AD288877827525CB287C8257051CF171BC070440DDFC4A.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071900.75267423280084571746509784885325:20250827014037:2400:D984320BF216D679B9AD288877827525CB287C8257051CF171BC070440DDFC4A.png

**图片描述**: %E5%AE%B9%E5%99%A8config%E9%85%8D%E7%BD%AE01.png

### 图片 5

![%E5%AE%B9%E5%99%A8config%E9%85%8D%E7%BD%AE02.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071921.53333065583869386228675937823288:20250827014037:2400:DA2FBB26A455AF2C565CDFED3046636CD4940A6A7C0411F592934F6822BE94BD.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815071921.53333065583869386228675937823288:20250827014037:2400:DA2FBB26A455AF2C565CDFED3046636CD4940A6A7C0411F592934F6822BE94BD.png

**图片描述**: %E5%AE%B9%E5%99%A8config%E9%85%8D%E7%BD%AE02.png

### 图片 6

![%E5%BE%AE%E6%8E%A8%E7%90%86.png](https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815072206.76951737711374411910262509264858:20250827014037:2400:A29E30C3E82EAD59898CBDF5CB2BD9B7B3B88002EB3383519E93C9BF22D21421.png)

**图片地址**: https://fileserver.developer.huaweicloud.com/FileServer/getFile/cmtybbs/334/a28/8f9/5b38cb361a334a288f9a771d9d18c803.20250815072206.76951737711374411910262509264858:20250827014037:2400:A29E30C3E82EAD59898CBDF5CB2BD9B7B3B88002EB3383519E93C9BF22D21421.png

**图片描述**: %E5%BE%AE%E6%8E%A8%E7%90%86.png

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 错误处理
2. **涉及技术**: MindIE, Docker, Atlas, 昇腾, AI
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*