Default Avatar

Andy Hsieh

Andy Hsieh

About

Username
Andy Hsieh
Joined
Visits
1,170
Last Active
Roles
Member, ModeratorsKL520, ModeratorsKL720, ModeratorsAIModel

Comments

  • @Vidhi Hi Vidhi, From your description, I’d like to clarify that you might be using the KL730 platform rather than KL720, because there is no “Leipzig SDK” for KL720. If you are indeed using the KL730 Leipzig SDK and encountered the error message “…
  • @Vidhi Hi Vidhi, Since you’ve raised the same question on the forum, I’ll provide a consolidated answer in your new discussion thread. I have moved the content to the following link: https://www.kneron.com/forum/discussion/511/kl720-sdk-v1-1-0-app…
  • @黃浩天 Hi 浩天, 以 onnx 模型結構來說 (from onnx2onnx_leakyRelu.zip) 您所提供的 onnx 是正確並且可在 KL720 上所使用。
  • @seongyunpark Hi seongyunpark, You are using two different models, each with its own application. Based on your error message, it seems that the issue might be caused by mixing up the usage of Generic Inference in Python. https://doc.kneron.com/doc…
  • @seongyunpark Hi seongyunpark, Since you’ve raised the same question on the forum, I’ll provide a consolidated answer in your new discussion thread. I have moved the content to the following link: https://www.kneron.com/forum/discussion/512/error-…
  • @林祈宏 Hi 祈宏, 此錯誤訊息的原因可能是因為您沒有安裝 Opencv。 請參考這邊進行安裝在進行 cmake 以及後續的編譯動作。 https://doc.kneron.com/docs/#plus_c/introduction/install_dependency/#23-opencv
  • @JIN QIAN Hi JIN QIAN, I think you should check whether the preprocessing during model training and when using the Kneron Toolchain for quantization is consistent with the preprocessing during inference. It should be consistent. https://www.kneron.c…
  • @陳柏錩 Hi 柏錩, 看到您的錯誤訊息是在 E2E 階段出了點問題。 您可以在調用 ktc.kneron_inference 的時候,確認一下您轉出來 onnx model input_names 是否為 "images"。 建議您參考連結 : https://doc.kneron.com/docs/#toolchain/appendix/app_flow_man…
  • @陳柏錩 Hi 柏錩, you can try to enter the base environment by typing the following command in the Docker environment: conda activate base Try yourself step after entering the base environment in Docker, as shown in the image below. https://www.kne…
  • @JIN QIAN Hi JIN QIAN, When you use onnx ktc.inference, you can try changing input_data to a list. This should solve your problem, as shown in the following example. https://www.kneron.com/forum/uploads/236/RJTWBIRWBYSU.png You may refer to these …
  • @JIN QIAN Hi JIN QIAN, There is now a v0.25.0_3 for v0.25.0 Kneron Toolchain hot fix version, you can try it. https://www.kneron.com/forum/uploads/527/55MB4VIFQ18U.png If you still encounter bugs, please provide us with the scripts, and provide us…
  • @sphuang Hi Sphuang, 方便的話,是否可以也請您提供一下 activation function 是 torch.sigmoid(x) 的 onnx 模型。 相關問題我這邊也一起幫您回報給相關公司同仁,一有消息再回復您。
  • @sphuang Hi Sphuang, 因為我們的 NPU 有 DRAM address 的限制,所以某些模型需要將 feature map 調小。 如果您覺得 feature map 可能會影響精度,您可以嘗試將一個模型拆分成兩個模型 (可嘗試從中間切一半) 分別去生成 nef 看看,並且在最後 Combine NEF。 Combine N…
  • @jackie Hi jackie, 以私訊您提供 e-mail 了,麻煩再幫忙看一下,感謝。
  • @jackie.chou@portwell.com.tw Hi jackie, 好的,可能需要請您提供檔案一下,可提供檔案的雲端位置,如果不方便可私訊我。 非常感謝!
  • @jackie.chou@portwell.com.tw Hi jackie, 可能也需要請您幫忙在 scrtips 裡面加上 print(kp.core.get_version()),用以確認 Kneron PLUS 的版本,然後確認一下您使用的 python 環境。 可以使用 python -V 與 pip -V 來確認 python 與 pip 是否相互對應,因為也怕您…
  • @jackie.chou@portwell.com.tw Hi jackie, 關於第二點,方便的話可能分別需要在 scripts FireDemo.py 裡面幫忙印出來。 目前這邊想看一下是否為 load 加密的模型造成的問題,因為您購買兩次分別綁定不同的 KL720 裝置,照理來說應該會有兩個檔案可以下載,那兩個下載…
  • @jackie.chou@portwell.com.tw Hi jackie, 您那邊是否可以幫我把兩個裝置全部再重新 update Kneron PLUS v2.0.1 的 FW 後再試試看。 更新完後,然後兩個裝置分別再執行一次 scripts (FireDemo.py),並在執行前,幫忙 print 一下 model_info,把結果貼上來。 關於 prin…
  • @jackie.chou@portwell.com.tw Hi jackie, 想跟您確認一下,關於您說明的第二點,您那邊有試過 M.2 KL720 (KL720 M.2 2242 B key compatible(KN:8B041B2C) ) 可以順利執行 Kneron PLUS v2.0.1的標準範例嗎? 2.有更新 KL720 FW, 已安裝Kneron PLUS v2.0.1, 跑過 Knero…
  • @jackie.chou@portwell.com.tw Hi jackie, 因為回傳 KP_FW_INFERENCE_TIMEOUT_103 原因有很多種,您有提到您是使用 "自己的程式",您可能要確保一下您的 Scrtips 在使用 APP-fire 時,input 是否符合模型所需要的。 或是也可以往另外一個方向去確認,您是否…
  • @Clarence Hi Clarence, I may need to confirm with you that the model you are using (onnx, nef) and the Scrtips, and was wondering if you could provide them. I'm guessing you're probably using the byte-tracing code you provided earlier in the contes…
  • @Clarence Hi Clarence, The reason for the error may be that your onnx model is missing "value_info" between layers. https://www.kneron.com/forum/uploads/567/YW233F9M5XO1.png You can try to run onnx's "shape_infernece" or "p…
  • @Temi Hi Temi, You don't have to remove it from pytorch, you can use Kneron Toolchain's Model Editor function or a third party model editor. Because KL520 doesn't support Sigmoid, it may cause your error problem. If you want to modify the onnx mode…
  • @Clarence Hi Clarence. I'm not sure which version of Kneron Toolchain you are using, would you mind letting us know. This should be a problem with the model conversion, in KL720, the main reason for this model error is because the value info of the …
  • @Temi Hi Temi, Seeing that you are using an .onnx model, I found that the reason for this is that your onnx model has Sigmoid operators at the end. (e.g. onnx::Sigmoid_442, onnx::Sigmoid_444, onnx::Sigmoid_446) When using KL520 platform you can re…
  • @Temi Hi Temi. Could you please provide us with the nef. model you ran and the onnx model before converting it to .nef model, if it's convenient for you?
  • @Temi Hi Temi, Sorry for the late reply. I saw your error message, it may be due to the fact that the image size of the input image does not match with the model you want to infer, you can check that your input image matches with the image size of …
  • @Temi Hi Temi, If convenient, you can also provide me your platform with a default example of how the nef model runs its reasoning after you have exported the nef model. For example, https://www.kneron.com/forum/uploads/284/Q3PSUKXB80AY.png
  • @Temi Hi Temi, This is because there are three possible causes for this problem. 1. a problem with the preprocess. 2. a problem with Inference. 3. post-process. You may need to provide more information, such as whether you are using Kneron PLUS v2…
  • @Aliaa Diab Hi Aliaa Diab, After looking at your model, there is a bug in Kneron Toolchain, but the bug has been reported and will be fixed in the next version of Kneron Toolchain. With this model, theoretically, the KL720 needs to be able to suppo…