直接使用https://www.hiascend.com/document/detail/zh/mindie/10RC3/mindiellm/llmdev/mindie_llm0290.html这种格式并不能初始化模型的权重
File "/usr/local/Ascend/llm_model/atb_llm/utils/adapter_manager.py", line 273, in concate_sorted_adapter
padded_lora_b = torch.cat(linear_lora_b_adapter_weights, dim=0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Sizes of tensors must match except in dimension 0. Expected size 14848 but got size 14784 for tensor number 1 in the list.
直接使用https://www.hiascend.com/document/detail/zh/mindie/10RC3/mindiellm/llmdev/mindie_llm0290.html这种格式并不能初始化模型的权重
File "/usr/local/Ascend/llm_model/atb_llm/utils/adapter_manager.py", line 273, in concate_sorted_adapter
padded_lora_b = torch.cat(linear_lora_b_adapter_weights, dim=0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Sizes of tensors must match except in dimension 0. Expected size 14848 but got size 14784 for tensor number 1 in the list.