deepseekR1模型的性能需要怎么优化_MindIE_昇腾论坛

# deepseekR1模型的性能需要怎么优化_MindIE_昇腾论坛

## 概述

本文档基于昇腾社区论坛帖子生成的技术教程。

**原始链接**: https://www.hiascend.com/forum/thread-0259191470263719341-1-1.html

**生成时间**: 2025-08-27 10:33:55

---

## 问题描述

设备配置 +------------------------------------------------------------------------------------------------+ | npu-smi 24.1.rc2 Version: 24.1.rc2 | +---------------------------+---------------+----------------------------------------------------+ | NPU Name | Health | Power(W) Temp(C) Hugepages-Usage(page)| | Chip | Bus-Id | AICore(%) Memory-Usage(MB) HBM-Usage(MB) | +===========================+===============+====================================================+ | 0 910B4 | OK | 88.9 53 0 / 0 | | 0 | 0000:C1:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 1 910B4 | OK | 89.9 54 0 / 0 | | 0 | 0000:C2:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 2 910B4 | OK | 87.2 53 0 / 0 | | 0 | 0000:81:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 3 910B...

## 相关代码

### 代码示例 1

```
+------------------------------------------------------------------------------------------------+
| npu-smi 24.1.rc2                 Version: 24.1.rc2                                             |
+---------------------------+---------------+----------------------------------------------------+
| NPU   Name                | Health        | Power(W)    Temp(C)           Hugepages-Usage(page)|
| Chip                      | Bus-Id        | AICore(%)   Memory-Usage(MB)  HBM-Usage(MB)        |
+===========================+===============+====================================================+
| 0     910B4               | OK            | 88.9        53                0    / 0             |
| 0                         | 0000:C1:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 1     910B4               | OK            | 89.9        54                0    / 0             |
| 0                         | 0000:C2:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 2     910B4               | OK            | 87.2        53                0    / 0             |
| 0                         | 0000:81:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 3     910B4               | OK            | 90.7        54                0    / 0             |
| 0                         | 0000:82:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 4     910B4               | OK            | 87.4        56                0    / 0             |
| 0                         | 0000:01:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 5     910B4               | OK            | 93.4        55                0    / 0             |
| 0                         | 0000:02:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 6     910B4               | OK            | 91.8        54                0    / 0             |
| 0                         | 0000:41:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 7     910B4               | OK            | 86.1        55                0    / 0             |
| 0                         | 0000:42:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
+---------------------------+---------------+----------------------------------------------------+
| NPU     Chip              | Process id    | Process name             | Process memory(MB)      |
+===========================+===============+====================================================+
| 0       0                 | 37253         | llama-box-rpc-s          | 110                     |
| 0       0                 | 114619        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 1       0                 | 37268         | llama-box-rpc-s          | 110                     |
| 1       0                 | 114622        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 2       0                 | 114624        | mindie_llm_back          | 25592                   |
| 2       0                 | 37282         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 3       0                 | 114627        | mindie_llm_back          | 25593                   |
| 3       0                 | 37252         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 4       0                 | 37267         | llama-box-rpc-s          | 110                     |
| 4       0                 | 114629        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 5       0                 | 114633        | mindie_llm_back          | 25593                   |
| 5       0                 | 37263         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 6       0                 | 37271         | llama-box-rpc-s          | 110                     |
| 6       0                 | 114636        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 7       0                 | 114648        | mindie_llm_back          | 25593                   |
| 7       0                 | 37248         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
复制
```

### 代码示例 2

```
+------------------------------------------------------------------------------------------------+
| npu-smi 24.1.rc2                 Version: 24.1.rc2                                             |
+---------------------------+---------------+----------------------------------------------------+
| NPU   Name                | Health        | Power(W)    Temp(C)           Hugepages-Usage(page)|
| Chip                      | Bus-Id        | AICore(%)   Memory-Usage(MB)  HBM-Usage(MB)        |
+===========================+===============+====================================================+
| 0     910B4               | OK            | 88.9        53                0    / 0             |
| 0                         | 0000:C1:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 1     910B4               | OK            | 89.9        54                0    / 0             |
| 0                         | 0000:C2:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 2     910B4               | OK            | 87.2        53                0    / 0             |
| 0                         | 0000:81:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 3     910B4               | OK            | 90.7        54                0    / 0             |
| 0                         | 0000:82:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 4     910B4               | OK            | 87.4        56                0    / 0             |
| 0                         | 0000:01:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 5     910B4               | OK            | 93.4        55                0    / 0             |
| 0                         | 0000:02:00.0  | 0           0    / 0          28556/ 32768         |
+===========================+===============+====================================================+
| 6     910B4               | OK            | 91.8        54                0    / 0             |
| 0                         | 0000:41:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
| 7     910B4               | OK            | 86.1        55                0    / 0             |
| 0                         | 0000:42:00.0  | 0           0    / 0          28557/ 32768         |
+===========================+===============+====================================================+
+---------------------------+---------------+----------------------------------------------------+
| NPU     Chip              | Process id    | Process name             | Process memory(MB)      |
+===========================+===============+====================================================+
| 0       0                 | 37253         | llama-box-rpc-s          | 110                     |
| 0       0                 | 114619        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 1       0                 | 37268         | llama-box-rpc-s          | 110                     |
| 1       0                 | 114622        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 2       0                 | 114624        | mindie_llm_back          | 25592                   |
| 2       0                 | 37282         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 3       0                 | 114627        | mindie_llm_back          | 25593                   |
| 3       0                 | 37252         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 4       0                 | 37267         | llama-box-rpc-s          | 110                     |
| 4       0                 | 114629        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 5       0                 | 114633        | mindie_llm_back          | 25593                   |
| 5       0                 | 37263         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
| 6       0                 | 37271         | llama-box-rpc-s          | 110                     |
| 6       0                 | 114636        | mindie_llm_back          | 25593                   |
+===========================+===============+====================================================+
| 7       0                 | 114648        | mindie_llm_back          | 25593                   |
| 7       0                 | 37248         | llama-box-rpc-s          | 110                     |
+===========================+===============+====================================================+
```

### 代码示例 3

```
{
"Version" : "1.1.0",
"LogConfig" :
{
"logLevel" : "Info",
"logFileSize" : 20,
"logFileNum" : 20,
"logPath" : "logs/mindservice.log"
},

"ServerConfig" :
{
"ipAddress" : "127.0.0.1",
"managementIpAddress" : "127.0.0.1",
"port" : 1025,
"managementPort" : 1026,
"metricsPort" : 1027,
"allowAllZeroIpListening" : false,
"maxLinkNum" : 1000,
"httpsEnabled" : false,
"fullTextEnabled" : false,
"tlsCaPath" : "security/ca/",
"tlsCaFile" : ["ca.pem"],
"tlsCert" : "security/certs/server.pem",
"tlsPk" : "security/keys/server.key.pem",
"tlsPkPwd" : "security/pass/key_pwd.txt",
"tlsCrlPath" : "security/certs/",
"tlsCrlFiles" : ["server_crl.pem"],
"managementTlsCaFile" : ["management_ca.pem"],
"managementTlsCert" : "security/certs/management/server.pem",
"managementTlsPk" : "security/keys/management/server.key.pem",
"managementTlsPkPwd" : "security/pass/management/key_pwd.txt",
"managementTlsCrlPath" : "security/management/certs/",
"managementTlsCrlFiles" : ["server_crl.pem"],
"kmcKsfMaster" : "tools/pmt/master/ksfa",
"kmcKsfStandby" : "tools/pmt/standby/ksfb",
"inferMode" : "standard",
"interCommTLSEnabled" : true,
"interCommPort" : 1121,
"interCommTlsCaPath" : "security/grpc/ca/",
"interCommTlsCaFiles" : ["ca.pem"],
"interCommTlsCert" : "security/grpc/certs/server.pem",
"interCommPk" : "security/grpc/keys/server.key.pem",
"interCommPkPwd" : "security/grpc/pass/key_pwd.txt",
"interCommTlsCrlPath" : "security/grpc/certs/",
"interCommTlsCrlFiles" : ["server_crl.pem"],
"openAiSupport" : "vllm"
},

"BackendConfig" : {
"backendName" : "mindieservice_llm_engine",
"modelInstanceNumber" : 1,
"npuDeviceIds" : [[0,1,2,3,4,5,6,7]],
"tokenizerProcessNumber" : 16,
"multiNodesInferEnabled" : false,
"multiNodesInferPort" : 1120,
"interNodeTLSEnabled" : true,
"interNodeTlsCaPath" : "security/grpc/ca/",
"interNodeTlsCaFiles" : ["ca.pem"],
"interNodeTlsCert" : "security/grpc/certs/server.pem",
"interNodeTlsPk" : "security/grpc/keys/server.key.pem",
"interNodeTlsPkPwd" : "security/grpc/pass/mindie_server_key_pwd.txt",
"interNodeTlsCrlPath" : "security/grpc/certs/",
"interNodeTlsCrlFiles" : ["server_crl.pem"],
"interNodeKmcKsfMaster" : "tools/pmt/master/ksfa",
"interNodeKmcKsfStandby" : "tools/pmt/standby/ksfb",
"ModelDeployConfig" :
{
"maxSeqLen" : 32768,
"maxInputTokenLen" : 32767,
"truncation" : false,
"ModelConfig" : [
{
"modelInstanceType" : "Standard",
"modelName" : "deepseek70b",
"modelWeightPath" : "/data/model",
"worldSize" : 8,
"cpuMemSize" : 5,
"npuMemSize" : -1,
"backendType" : "atb",
"trustRemoteCode" : false
}
]
},

"ScheduleConfig" :
{
"templateType" : "Standard",
"templateName" : "Standard_LLM",
"cacheBlockSize" : 128,

"maxPrefillBatchSize" : 50,
"maxPrefillTokens" : 32768,
"prefillTimeMsPerReq" : 150,
"prefillPolicyType" : 0,

"decodeTimeMsPerReq" : 50,
"decodePolicyType" : 0,

"maxBatchSize" : 200,
"maxIterTimes" : 32768,
"maxPreemptCount" : 0,
"supportSelectBatch" : false,
"maxQueueDelayMicroseconds" : 5000
}
}
}
复制
```

### 代码示例 4

```
{
"Version" : "1.1.0",
"LogConfig" :
{
"logLevel" : "Info",
"logFileSize" : 20,
"logFileNum" : 20,
"logPath" : "logs/mindservice.log"
},

"ServerConfig" :
{
"ipAddress" : "127.0.0.1",
"managementIpAddress" : "127.0.0.1",
"port" : 1025,
"managementPort" : 1026,
"metricsPort" : 1027,
"allowAllZeroIpListening" : false,
"maxLinkNum" : 1000,
"httpsEnabled" : false,
"fullTextEnabled" : false,
"tlsCaPath" : "security/ca/",
"tlsCaFile" : ["ca.pem"],
"tlsCert" : "security/certs/server.pem",
"tlsPk" : "security/keys/server.key.pem",
"tlsPkPwd" : "security/pass/key_pwd.txt",
"tlsCrlPath" : "security/certs/",
"tlsCrlFiles" : ["server_crl.pem"],
"managementTlsCaFile" : ["management_ca.pem"],
"managementTlsCert" : "security/certs/management/server.pem",
"managementTlsPk" : "security/keys/management/server.key.pem",
"managementTlsPkPwd" : "security/pass/management/key_pwd.txt",
"managementTlsCrlPath" : "security/management/certs/",
"managementTlsCrlFiles" : ["server_crl.pem"],
"kmcKsfMaster" : "tools/pmt/master/ksfa",
"kmcKsfStandby" : "tools/pmt/standby/ksfb",
"inferMode" : "standard",
"interCommTLSEnabled" : true,
"interCommPort" : 1121,
"interCommTlsCaPath" : "security/grpc/ca/",
"interCommTlsCaFiles" : ["ca.pem"],
"interCommTlsCert" : "security/grpc/certs/server.pem",
"interCommPk" : "security/grpc/keys/server.key.pem",
"interCommPkPwd" : "security/grpc/pass/key_pwd.txt",
"interCommTlsCrlPath" : "security/grpc/certs/",
"interCommTlsCrlFiles" : ["server_crl.pem"],
"openAiSupport" : "vllm"
},

"BackendConfig" : {
"backendName" : "mindieservice_llm_engine",
"modelInstanceNumber" : 1,
"npuDeviceIds" : [[0,1,2,3,4,5,6,7]],
"tokenizerProcessNumber" : 16,
"multiNodesInferEnabled" : false,
"multiNodesInferPort" : 1120,
"interNodeTLSEnabled" : true,
"interNodeTlsCaPath" : "security/grpc/ca/",
"interNodeTlsCaFiles" : ["ca.pem"],
"interNodeTlsCert" : "security/grpc/certs/server.pem",
"interNodeTlsPk" : "security/grpc/keys/server.key.pem",
"interNodeTlsPkPwd" : "security/grpc/pass/mindie_server_key_pwd.txt",
"interNodeTlsCrlPath" : "security/grpc/certs/",
"interNodeTlsCrlFiles" : ["server_crl.pem"],
"interNodeKmcKsfMaster" : "tools/pmt/master/ksfa",
"interNodeKmcKsfStandby" : "tools/pmt/standby/ksfb",
"ModelDeployConfig" :
{
"maxSeqLen" : 32768,
"maxInputTokenLen" : 32767,
"truncation" : false,
"ModelConfig" : [
{
"modelInstanceType" : "Standard",
"modelName" : "deepseek70b",
"modelWeightPath" : "/data/model",
"worldSize" : 8,
"cpuMemSize" : 5,
"npuMemSize" : -1,
"backendType" : "atb",
"trustRemoteCode" : false
}
]
},

"ScheduleConfig" :
{
"templateType" : "Standard",
"templateName" : "Standard_LLM",
"cacheBlockSize" : 128,

"maxPrefillBatchSize" : 50,
"maxPrefillTokens" : 32768,
"prefillTimeMsPerReq" : 150,
"prefillPolicyType" : 0,

"decodeTimeMsPerReq" : 50,
"decodePolicyType" : 0,

"maxBatchSize" : 200,
"maxIterTimes" : 32768,
"maxPreemptCount" : 0,
"supportSelectBatch" : false,
"maxQueueDelayMicroseconds" : 5000
}
}
}
```

## 完整内容

设备配置 +------------------------------------------------------------------------------------------------+ | npu-smi 24.1.rc2 Version: 24.1.rc2 | +---------------------------+---------------+----------------------------------------------------+ | NPU Name | Health | Power(W) Temp(C) Hugepages-Usage(page)| | Chip | Bus-Id | AICore(%) Memory-Usage(MB) HBM-Usage(MB) | +===========================+===============+====================================================+ | 0 910B4 | OK | 88.9 53 0 / 0 | | 0 | 0000:C1:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 1 910B4 | OK | 89.9 54 0 / 0 | | 0 | 0000:C2:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 2 910B4 | OK | 87.2 53 0 / 0 | | 0 | 0000:81:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 3 910B4 | OK | 90.7 54 0 / 0 | | 0 | 0000:82:00.0 | 0 0 / 0 28557/ 32768 | +===========================+===============+====================================================+ | 4 910B4 | OK | 87.4 56 0 / 0 | | 0 | 0000:01:00.0 | 0 0 / 0 28557/ 32768 | +===========================+===============+====================================================+ | 5 910B4 | OK | 93.4 55 0 / 0 | | 0 | 0000:02:00.0 | 0 0 / 0 28556/ 32768 | +===========================+===============+====================================================+ | 6 910B4 | OK | 91.8 54 0 / 0 | | 0 | 0000:41:00.0 | 0 0 / 0 28557/ 32768 | +===========================+===============+====================================================+ | 7 910B4 | OK | 86.1 55 0 / 0 | | 0 | 0000:42:00.0 | 0 0 / 0 28557/ 32768 | +===========================+===============+====================================================+ +---------------------------+---------------+----------------------------------------------------+ | NPU Chip | Process id | Process name | Process memory(MB) | +===========================+===============+====================================================+ | 0 0 | 37253 | llama-box-rpc-s | 110 | | 0 0 | 114619 | mindie_llm_back | 25593 | +===========================+===============+====================================================+ | 1 0 | 37268 | llama-box-rpc-s | 110 | | 1 0 | 114622 | mindie_llm_back | 25593 | +===========================+===============+====================================================+ | 2 0 | 114624 | mindie_llm_back | 25592 | | 2 0 | 37282 | llama-box-rpc-s | 110 | +===========================+===============+====================================================+ | 3 0 | 114627 | mindie_llm_back | 25593 | | 3 0 | 37252 | llama-box-rpc-s | 110 | +===========================+===============+====================================================+ | 4 0 | 37267 | llama-box-rpc-s | 110 | | 4 0 | 114629 | mindie_llm_back | 25593 | +===========================+===============+====================================================+ | 5 0 | 114633 | mindie_llm_back | 25593 | | 5 0 | 37263 | llama-box-rpc-s | 110 | +===========================+===============+====================================================+ | 6 0 | 37271 | llama-box-rpc-s | 110 | | 6 0 | 114636 | mindie_llm_back | 25593 | +===========================+===============+====================================================+ | 7 0 | 114648 | mindie_llm_back | 25593 | | 7 0 | 37248 | llama-box-rpc-s | 110 | +===========================+===============+====================================================+ 复制 模型配置 { "Version" : "1.1.0", "LogConfig" : { "logLevel" : "Info", "logFileSize" : 20, "logFileNum" : 20, "logPath" : "logs/mindservice.log" }, "ServerConfig" : { "ipAddress" : "127.0.0.1", "managementIpAddress" : "127.0.0.1", "port" : 1025, "managementPort" : 1026, "metricsPort" : 1027, "allowAllZeroIpListening" : false, "maxLinkNum" : 1000, "httpsEnabled" : false, "fullTextEnabled" : false, "tlsCaPath" : "security/ca/", "tlsCaFile" : ["ca.pem"], "tlsCert" : "security/certs/server.pem", "tlsPk" : "security/keys/server.key.pem", "tlsPkPwd" : "security/pass/key_pwd.txt", "tlsCrlPath" : "security/certs/", "tlsCrlFiles" : ["server_crl.pem"], "managementTlsCaFile" : ["management_ca.pem"], "managementTlsCert" : "security/certs/management/server.pem", "managementTlsPk" : "security/keys/management/server.key.pem", "managementTlsPkPwd" : "security/pass/management/key_pwd.txt", "managementTlsCrlPath" : "security/management/certs/", "managementTlsCrlFiles" : ["server_crl.pem"], "kmcKsfMaster" : "tools/pmt/master/ksfa", "kmcKsfStandby" : "tools/pmt/standby/ksfb", "inferMode" : "standard", "interCommTLSEnabled" : true, "interCommPort" : 1121, "interCommTlsCaPath" : "security/grpc/ca/", "interCommTlsCaFiles" : ["ca.pem"], "interCommTlsCert" : "security/grpc/certs/server.pem", "interCommPk" : "security/grpc/keys/server.key.pem", "interCommPkPwd" : "security/grpc/pass/key_pwd.txt", "interCommTlsCrlPath" : "security/grpc/certs/", "interCommTlsCrlFiles" : ["server_crl.pem"], "openAiSupport" : "vllm" }, "BackendConfig" : { "backendName" : "mindieservice_llm_engine", "modelInstanceNumber" : 1, "npuDeviceIds" : [[0,1,2,3,4,5,6,7]], "tokenizerProcessNumber" : 16, "multiNodesInferEnabled" : false, "multiNodesInferPort" : 1120, "interNodeTLSEnabled" : true, "interNodeTlsCaPath" : "security/grpc/ca/", "interNodeTlsCaFiles" : ["ca.pem"], "interNodeTlsCert" : "security/grpc/certs/server.pem", "interNodeTlsPk" : "security/grpc/keys/server.key.pem", "interNodeTlsPkPwd" : "security/grpc/pass/mindie_server_key_pwd.txt", "interNodeTlsCrlPath" : "security/grpc/certs/", "interNodeTlsCrlFiles" : ["server_crl.pem"], "interNodeKmcKsfMaster" : "tools/pmt/master/ksfa", "interNodeKmcKsfStandby" : "tools/pmt/standby/ksfb", "ModelDeployConfig" : { "maxSeqLen" : 32768, "maxInputTokenLen" : 32767, "truncation" : false, "ModelConfig" : [ { "modelInstanceType" : "Standard", "modelName" : "deepseek70b", "modelWeightPath" : "/data/model", "worldSize" : 8, "cpuMemSize" : 5, "npuMemSize" : -1, "backendType" : "atb", "trustRemoteCode" : false } ] }, "ScheduleConfig" : { "templateType" : "Standard", "templateName" : "Standard_LLM", "cacheBlockSize" : 128, "maxPrefillBatchSize" : 50, "maxPrefillTokens" : 32768, "prefillTimeMsPerReq" : 150, "prefillPolicyType" : 0, "decodeTimeMsPerReq" : 50, "decodePolicyType" : 0, "maxBatchSize" : 200, "maxIterTimes" : 32768, "maxPreemptCount" : 0, "supportSelectBatch" : false, "maxQueueDelayMicroseconds" : 5000 } } } 复制 使用dify连接模型测试 为什么我的tokens只有二十多怎么修改配置提升模型的速度 试试看这两个帖子 1.MindIEDeepSeek性能较差推理较慢问题定位总结持续更新~_MindIE_昇腾论坛 2. MindIE参数性能调优-如何使吞吐率最大?持续更新~_MindIE_昇腾论坛

---

## 技术要点总结

基于以上内容，主要技术要点包括：

1. **问题类型**: 部署安装
2. **涉及技术**: HTTPS, NPU, AI, MindIE
3. **解决方案**: 请参考完整内容中的解决方案

## 相关资源

- 昇腾社区: https://www.hiascend.com/
- 昇腾论坛: https://www.hiascend.com/forum/

---

*本文档由AI自动生成，仅供参考。如有疑问，请参考原始帖子。*