Traceback (most recent call last):
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/cli.py", line 55, in <module>
    app()
  File "/usr/local/lib/python3.11/site-packages/typer/main.py", line 311, in __call__
    return get_command(self)(*args, **kwargs)
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.11/site-packages/typer/core.py", line 716, in main
    return _main(
  File "/usr/local/lib/python3.11/site-packages/typer/core.py", line 216, in _main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.11/site-packages/typer/main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/cli.py", line 51, in serve
    server.serve(model_path, dtype, uds_path, pool)
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/server.py", line 118, in serve
    asyncio.run(serve_inner(model_path, dtype))
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 637, in run_until_complete
    self.run_forever()
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 604, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 1909, in _run_once
    handle._run()
  File "/usr/local/lib/python3.11/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
> File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/server.py", line 83, in serve_inner
    model = get_model(model_path, dtype, pool)
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/__init__.py", line 102, in get_model
    return create_model(ClassificationModel, model_path, device, datatype)
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/__init__.py", line 43, in create_model
    model_handle = model_class(
  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/classification_model.py", line 27, in __init__
    model = model.to(dtype).to(device)
  File "/usr/local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3698, in to
    return super().to(*args, **kwargs)
  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 70, in to
    self.cast_weight(device)
  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 133, in cast_weight
    _format_cast(self, current_class)
  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 96, in _format_cast
    if torch.npu.is_jit_compile_false():
  File "/usr/local/lib/python3.11/site-packages/torch_npu/npu/npu_config.py", line 132, in is_jit_compile_false
    torch_npu.npu._lazy_init()
  File "/usr/local/lib/python3.11/site-packages/torch_npu/npu/__init__.py", line 222, in _lazy_init
    torch_npu._C._npu_init()
RuntimeError: Initialize:build/CMakeFiles/torch_npu.dir/compiler_depend.ts:221 NPU function error: c10_npu::SetDevice(device_id_), error code is 507033
[ERROR] 2026-04-27-01:54:49 (PID:1040, Device:-1, RankID:-1) ERR00100 PTA call acl api failed
[Error]: Failed to start the device. 
        Rectify the fault based on the error information in the ascend log.
[PID: 1040] 2026-04-27-01:54:47.860.602 Invalid_Argument(EL0003): The argument is invalid.
        Solution: Try again with a valid argument.
        TraceBack (most recent call last):
        Failed to open device, retCode=0x7020014, deviceId=0.[FUNC:InitRawDriver][FILE:raw_device.cc][LINE:207]
        Failed to init RawDriver, device_id=0, retCode=0x7020014[FUNC:Init][FILE:raw_device.cc][LINE:501]
        Check param failed, dev can not be NULL![FUNC:DeviceRetain][FILE:runtime.cc][LINE:3886]
        Check param failed, dev can not be NULL![FUNC:PrimaryContextRetain][FILE:runtime.cc][LINE:3509]
        Check param failed, ctx can not be NULL![FUNC:PrimaryContextRetain][FILE:runtime.cc][LINE:3540]
        Check param failed, context can not be null.[FUNC:NewDevice][FILE:api_impl.cc][LINE:3275]
        New device failed, retCode=0x7010006[FUNC:SetDevice][FILE:api_impl.cc][LINE:3299]
        rtSetDevice execution failed, reason=device retain error[FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:61]
        open device 0 failed, runtime result = 507033.[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:148]
        ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:6333]
        The argument is invalid.Reason: rtGetDevMsg execution failed, the context is a null pointer.

Traceback (most recent call last):

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/cli.py", line 55, in <module>
    app()

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/cli.py", line 51, in serve
    server.serve(model_path, dtype, uds_path, pool)

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/server.py", line 118, in serve
    asyncio.run(serve_inner(model_path, dtype))

  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 650, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/server.py", line 83, in serve_inner
    model = get_model(model_path, dtype, pool)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/__init__.py", line 102, in get_model
    return create_model(ClassificationModel, model_path, device, datatype)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/__init__.py", line 43, in create_model
    model_handle = model_class(
                   ^^^^^^^^^^^^

  File "/home/HwHiAiUser/text-embeddings-inference/backends/python/server/text_embeddings_server/models/classification_model.py", line 27, in __init__
    model = model.to(dtype).to(device)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3698, in to
    return super().to(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 70, in to
    self.cast_weight(device)

  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 133, in cast_weight
    _format_cast(self, current_class)

  File "/usr/local/lib/python3.11/site-packages/torch_npu/utils/_module.py", line 96, in _format_cast
    if torch.npu.is_jit_compile_false():
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.11/site-packages/torch_npu/npu/npu_config.py", line 132, in is_jit_compile_false
    torch_npu.npu._lazy_init()

  File "/usr/local/lib/python3.11/site-packages/torch_npu/npu/__init__.py", line 222, in _lazy_init
    torch_npu._C._npu_init()

RuntimeError: Initialize:build/CMakeFiles/torch_npu.dir/compiler_depend.ts:221 NPU function error: c10_npu::SetDevice(device_id_), error code is 507033
[ERROR] 2026-04-27-01:54:49 (PID:1040, Device:-1, RankID:-1) ERR00100 PTA call acl api failed
[Error]: Failed to start the device. 
        Rectify the fault based on the error information in the ascend log.
[PID: 1040] 2026-04-27-01:54:47.860.602 Invalid_Argument(EL0003): The argument is invalid.
        Solution: Try again with a valid argument.
        TraceBack (most recent call last):
        Failed to open device, retCode=0x7020014, deviceId=0.[FUNC:InitRawDriver][FILE:raw_device.cc][LINE:207]
        Failed to init RawDriver, device_id=0, retCode=0x7020014[FUNC:Init][FILE:raw_device.cc][LINE:501]
        Check param failed, dev can not be NULL![FUNC:DeviceRetain][FILE:runtime.cc][LINE:3886]
        Check param failed, dev can not be NULL![FUNC:PrimaryContextRetain][FILE:runtime.cc][LINE:3509]
        Check param failed, ctx can not be NULL![FUNC:PrimaryContextRetain][FILE:runtime.cc][LINE:3540]
        Check param failed, context can not be null.[FUNC:NewDevice][FILE:api_impl.cc][LINE:3275]
        New device failed, retCode=0x7010006[FUNC:SetDevice][FILE:api_impl.cc][LINE:3299]
        rtSetDevice execution failed, reason=device retain error[FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:61]
        open device 0 failed, runtime result = 507033.[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:148]
        ctx is NULL![FUNC:GetDevErrMsg][FILE:api_impl.cc][LINE:6333]
        The argument is invalid.Reason: rtGetDevMsg execution failed, the context is a null pointer.