- 简介
- 目录大纲
- 最新文档
- 文集下载
qwen 单卡推理
2、单卡推理时，执行命令：export ASCEND_VISIBLE_DEVICES=0，指定运行在id=0的逻辑卡上 3、重新运行推理，仍旧报错，报错信息如下： [2025-03-31 11:55:22.679578] [error] [19353] [runner.cpp:115] PluginRunner_55_0_0:1 Execute Failed. st: 12 [2025-03-3………
yg9538 - May 21, 2025, 10:48 a.m.
mindie 下载地址
https://www.hiascend.com/developer/download/community/result?module=ie%2Bpt%2Bcann
yg9538 - May 21, 2025, 10:47 a.m.
模型推理标准api
https://github.com/labring/FastGPT/blob/main/plugins/model/rerank-bge/bge-reranker-v2-m3/app.py
yg9538 - April 22, 2025, 10:09 a.m.