MindIE双机部署Qwen3-235B-A22B-Instruct-2507模型报错：Failed to get vocab size from tokenizer wrapper with exception_MindIE_昇腾论坛

# MindIE双机部署Qwen3-235B-A22B-Instruct-2507模型报错：Failed to get vocab size from tokenizer wrapper with exception_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0270189254867268407-1-1.html

**生成时间**: 2025-08-27 10:33:57

---

## 问题描述

报错信息如下 [2025-07-30 17:45:47.519] [82510] [281473796337632] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. At: /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper /usr/local/Ascend/atb-models/atb_llm/models/qwen2_moe/router_qwen2_moe.py(19): get_tokenizer /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(156): tokenizer /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(25): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_...

## 完整内容

报错信息如下 [2025-07-30 17:45:47.519] [82510] [281473796337632] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. At: /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper /usr/local/Ascend/atb-models/atb_llm/models/qwen2_moe/router_qwen2_moe.py(19): get_tokenizer /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(156): tokenizer /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(25): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper [2025-07-30 17:45:47.519] [82510] [281473796337632] [llm] [ERROR] [llm_manager_impl.cpp:785] Config manager init exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. At: /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper /usr/local/Ascend/atb-models/atb_llm/models/qwen2_moe/router_qwen2_moe.py(19): get_tokenizer /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(156): tokenizer /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(25): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper LLMInferEngine failed to init LLMInferModels 解决方案transformers版本升级至4.46.3解决 pip install transformers==4.46.3

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 错误处理
2. **涉及技术**: 昇腾, NPU, AI, MindIE
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*