llama-cli启动程序报错The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null]
点赞0收藏0回复0
分享
举报
llama-cli启动程序报错The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null]
已解决
新人帖
发表于2024-09-11 21:28:30
0 查看
llama.cpp基于CANN-8.0编译好后，llama-cli启动千问模型失败，错误提示：
llm_load_print_meta: max token length = 256
CANN error: EE1001: [PID: 3164] 2024-09-11-21:18:31.855.316 The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null]
Solution: 1.Check the input parameter range of the function. 2.Check the function invocation relationship.
TraceBack (most recent call last):
Get Allocation Granularity failed, runtime result = 207000[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161]
ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:5244]
The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null]
current device: 0, in function ggml_cann_init at /usr/local/Own/llama.cpp/ggml/src/ggml-cann.cpp:182
aclrtMemGetAllocationGranularity( &prop, ACL_RT_MEM_ALLOC_GRANULARITY_RECOMMENDED, &info.devices[id].vmm_granularity)
/usr/local/Own/llama.cpp/ggml/src/ggml-cann.cpp:123: CANN error
/usr/local/Own/llama.cpp/build/ggml/src/libggml.so(+0x40464)[0xe7ffe70b0464]
有人遇到过这种情况吗？ 启动命令：
./llama.cpp/build/bin/llama-cli -m ./qwen/qwen2-72b-instruct-q4_0.gguf -p "Building a website can be done in 10 simple steps:" -n 400 -e -ngl 33 -sm none -mg 0
点赞
收藏
回复
分享
举报
已解决
llama.cpp基于CANN-8.0编译好后，llama-cli启动千问模型失败，错误提示：
llm_load_print_meta: max token length = 256 CANN error: EE1001: [PID: 3164] 2024-09-11-21:18:31.855.316 The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null] Solution: 1.Check the input parameter range of the function. 2.Check the function invocation relationship. TraceBack (most recent call last): Get Allocation Granularity failed, runtime result = 207000[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:5244] The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null] current device: 0, in function ggml_cann_init at /usr/local/Own/llama.cpp/ggml/src/ggml-cann.cpp:182 aclrtMemGetAllocationGranularity( &prop, ACL_RT_MEM_ALLOC_GRANULARITY_RECOMMENDED, &info.devices[id].vmm_granularity) /usr/local/Own/llama.cpp/ggml/src/ggml-cann.cpp:123: CANN error /usr/local/Own/llama.cpp/build/ggml/src/libggml.so(+0x40464)[0xe7ffe70b0464]有人遇到过这种情况吗？ 启动命令：