kp_firmware_host_stream build file problems

YOUNGJUN YOOYOUNGJUN YOO
in KL630 related discussion

I follow instruction below


https://doc.kneron.com/docs/#plus_c/feature_guide/customized_api/create_kl630_single_model_example/#4-pre-process-and-post-process-development


and Compile in solution host_stream with path:

KLM5S3-V2.5.5/SDK/Software_Toolkit/sdk_v2.5.5/sdk/apps/vmf_nnm/solution/solution_host_stream

and

image.png

and Copy files ( kp_firmware_host_stream and my nef (models_630_3dcnn.nef) ) in Path:

KLM5S3-V2.5.5/SDK/Software_Toolkit/sdk_v2.5.5/sdk/apps/vmf_nnm/bin/kp_firmware/bin

to KL630.


Moreover, I modified Model_path, Model_Id, JobId, ImageWidth, ImageHeight, Fps in host_stream.ini (KL630 board)

image.png


However, I got following error when I run firmware in KL630.



Even though I built the kp_firmware_host_stream , I think it's strange that the image size is 2560x1920 instead of 1920x1080, and the built file doesn't seem to have been applied. I'd like to ask if there's something I did wrong.

image.png


Thank you.

Comments

  • Nick WangNick Wang

    Hi YOUNGJUN,

    According to the information you provided, please note the following points:

    1. Model IDs must be larger than 32767.
    2. The KL630 program is experiencing repeated execution. It automatically runs rc.local at startup. Renaming rc.local will prevent it from executing automatically.
    3. "ImageWidth: 2560 ImageHeight: 1920" This is the resolution of the stream to the NPU based on the settings in "host_stream.ini".
    host_stream.ini
...
[nnm]
InferenceStream = 1         # Inference stream index
...
[stream1]
Codec = 0                   .#VMF_VENC_CODEC_TYPE_H264
Width = 1280                #The image width of stream0
Height = 960                #The image height of stream0


  • YOUNGJUN YOOYOUNGJUN YOO

    Thank you Nick,

    1.Model IDs must be larger than 32767. I changed the model id = 35000 for nef generation and successfully converted to nef. with following code

    - km = ktc.ModelConfig(35000,"0001","630", onnx_path="optimized_3dcnn.onnx"

    image.png


    and build it with changing the my_kl630_sin_example_inf.h (Path: KLM5S3-V2.5.5/SDK/Software_Toolkit/sdk_v2.5.5/sdk/apps/vmf_nnm/solution/solution_host_stream/include)

    image.png


    and copy kp_firmware_host_stream (Path: KLM5S3-V2.5.5/SDK/Software_Toolkit/sdk_v2.5.5/sdk/apps/vmf_nnm/bin/kp_firmware/bin)

    to KL630 board.

    But I have following error


    3."ImageWidth: 2560 ImageHeight: 1920" This is the resolution of the stream to the NPU based on the settings in "host_stream.ini".

    (Path: mnt/flash/vienna/ini/host_stream.ini in KL630 board)

    I also, chagned the host_stream.ini like this picture

    image.png


    the "ImageWidth: 2560 ImageHeight: 1920 are not changed.


    I think I have modified wrong file or followed wrong processes, could you give me way to solve these problems?

  • Nick WangNick Wang

    Hi YOUNGJUN,

    I noticed that your KL630 firmware is old, please download the v2.5.5 version from our website.

    https://www.kneron.com/tw/support/developers/

    image.png

    "KL630_96board_firmware_for_kneron_plus_sdk2.5.5.zip" is for companion mode, you can also verify the model with this mode first.


    Also, according to the error log you provided, the program is still running repeatedly. Please confirm rc.loacl again.


    Thanks.

  • Nick WangNick Wang

    Hi YOUNGJUN,

    As a reminder, our recommended verification model process is as follows :

    1. Verify the E2E simulation of NEF on the toolchain docker.

    2. Confirm the results of KL630 companion mode.(python code)

    3. Confirm the results of KL630 companion mode.(C code)

    4. Move C code to KL630.

  • YOUNGJUN YOOYOUNGJUN YOO

    Dear Nick Wang,

    I think Process 1 is done.

    But, I'd like to check that following link is Process 2, 3, right?


    My model is custom model (video classification). Do I have to proceed building my model with companion mode? Could you explain about what is companion mode (KL630) ? 

  • YOUNGJUN YOOYOUNGJUN YOO

    I tried to proceed


    2. Confirm the results of KL630 companion mode.(python code)


    So, I connected KL630 via usb and

    refer Chapter 1.9 of the KL630_96board_User_Manual.

    image.png


    But, I can't find KL630 board with following error (putty)

    image.png


    and I also cannot find the device in DFUT KL 630

    image.png

    Please help me.


    Thank you.

  • Nick WangNick Wang

    Hi YOUNGJUN,

    Please provide me with the log from when the KL630 is turned on to when you run plus_usb_companion_init.sh and I will help you check if there are any problems.

    Thanks.

The discussion has been closed due to inactivity. To continue with the topic, please feel free to post a new discussion.

© Kneron, Inc.