[DEBUG] start to ModelInference base_tensor 

[DEBUG] Create OutMemory i:0 name:p2o.Add.64:0:linear_99.tmp_1 size:5120 

[DEBUG] Create OutMemory i:1 name:p2o.Add.72:0:linear_101.tmp_1 size:5120 

[DEBUG] model execute success 

[DEBUG] model aclExec cost : 51.194000 

[DEBUG] get max dynamic batch size success 

[DEBUG] AddOutTensors name:p2o.Add.64:0:linear_99.tmp_1 index:0 len:5120 outdescsize:5120 shapesize:3 

[DEBUG] get max dynamic batch size success 

[DEBUG] AddOutTensors name:p2o.Add.72:0:linear_101.tmp_1 index:1 len:5120 outdescsize:5120 shapesize:3 

[DEBUG] destroy model input success 

127.0.0.1 - - [18/Oct/2023 16:35:35] "POST /predict HTTP/1.1" 200 - 

model:{'tokenizer': PretrainedTokenizer(name_or_path='', vocab_size=12000, model_max_len=512, padding_side='right', truncation_side='right', special_tokens={'unk_token': '[UNK]', 'sep_token': '[SEP]', 'pad_token': '[PAD]', 'cls_token': '[CLS]', 'mask_token': '[MASK]', 'additional_special_tokens': ['[PER]', '[PER]', '[PUNC]']}), 'mapping': {0: 'O', 1: 'PER', 2: 'ORG', 3: 'LOC', 4: 'TIME'}, 'session': <ais_bench.infer.interface.InferSession object at 0x7f3bf856a910>} 

model:{'tokenizer': PretrainedTokenizer(name_or_path='', vocab_size=12000, model_max_len=512, padding_side='right', truncation_side='right', special_tokens={'unk_token': '[UNK]', 'sep_token': '[SEP]', 'pad_token': '[PAD]', 'cls_token': '[CLS]', 'mask_token': '[MASK]', 'additional_special_tokens': ['[PER]', '[PER]', '[PUNC]']}), 'mapping': {0: 'O', 1: 'PER', 2: 'ORG', 3: 'LOC', 4: 'TIME'}, 'session': <ais_bench.infer.interface.InferSession object at 0x7f3bf856a910>} 

[DEBUG] start to ModelInference base_tensor 

EE1001: The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        Solution: 1.Check the input parameter range of the function. 2.Check the function invocation relationship. 

        TraceBack (most recent call last): 

        ctx is NULL![FUNC:DevMalloc][FILE:api_impl.cc][LINE:1215] 

        The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        alloc device memory failed, runtime result = 107002[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] 

        ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:4238] 

        The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null] 

 

[107002][Error code unknown] Malloc ptrData failed.[ERROR] MemoryHelper::MxbsMalloc failed device size:4096 ret:2 

EE1001: The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        Solution: 1.Check the input parameter range of the function. 2.Check the function invocation relationship. 

        TraceBack (most recent call last): 

        ctx is NULL![FUNC:DevMalloc][FILE:api_impl.cc][LINE:1215] 

        The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        alloc device memory failed, runtime result = 107002[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] 

        ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:4238] 

        The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null] 

 

EE1001: The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        Solution: 1.Check the input parameter range of the function. 2.Check the function invocation relationship. 

        TraceBack (most recent call last): 

        ctx is NULL![FUNC:DevMalloc][FILE:api_impl.cc][LINE:1215] 

        The argument is invalid.Reason: rtMalloc execute failed, reason=[context pointer null] 

        alloc device memory failed, runtime result = 107002[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] 

        ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:4238] 

        The argument is invalid.Reason: rtGetDevMsg execute failed, reason=[context pointer null] 

 

[107002][Error code unknown] Malloc ptrData failed.[ERROR] MemoryHelper::MxbsMalloc failed device size:4096 ret:2 

[ERROR] Check i:0 name:input_ids in size:2 needsize:4096 not match 

[ERROR] Check InVector failed ret:-1