Issue while compiling bie to nef
I have a model that was successfully optimized and maintain good performance after quantization.
When I try to compile it to NEF I use the following code:
km = ktc.ModelConfig(40000, '0001', 720, bie_path=path_to_bie_model)
model_list = [km]
compile_result = ktc.compile(model_list)
And I get the following error message:
[tool][info][batch_compile.cc:544][BatchCompile] compiling output.quan.wqbi.bie
terminate called after throwing an instance of 'InvalidProgramInput'
what(): Invalid program input: cpu mode of node [Add_184] from Knerex info [true] differs from compiler's [false]
I'm using Toolchain docker v0.16.0 on MacOS.
node[Add_184] is some arbitrary 'Add' node towards the end of my model
Please advice.
The discussion has been closed due to inactivity. To continue with the topic, please feel free to post a new discussion.
Comments
@liron
Hi liron,
Can you provide your onnx model so that we can troubleshoot this issue?
Sure
Also Attaching the toolchain python script I used for compilation
@liron
Hi liron,
Thank you for providing the .onnx model and toolchain python script.
We are still looking for the cause of the error message. If there is any new progress, we will report back to you at any time.
@liron
Hi liron,
Sorry for the late reply. The cause of the error message has been found, we will improve this problem in the next version of Kneron ToolChain.
Thanks!
Is the fix already included in toolchain V0.17.1?
@liron
Hi liron,
Apologies for the delay. You can already use toolchain v0.17.1 to successfully convert the model you provided to generate NEF.🙂