Issue while compiling bie to nef

liron

I have a model that was successfully optimized and maintain good performance after quantization.

When I try to compile it to NEF I use the following code:

km = ktc.ModelConfig(40000, '0001', 720, bie_path=path_to_bie_model)

model_list = [km]

compile_result = ktc.compile(model_list)

And I get the following error message:

[tool][info][batch_compile.cc:544][BatchCompile] compiling output.quan.wqbi.bie

terminate called after throwing an instance of 'InvalidProgramInput'

 what(): Invalid program input: cpu mode of node [Add_184] from Knerex info [true] differs from compiler's [false]

I'm using Toolchain docker v0.16.0 on MacOS.

node[Add_184] is some arbitrary 'Add' node towards the end of my model

Please advice.

Andy Hsieh

@liron

Hi liron,

Can you provide your onnx model so that we can troubleshoot this issue?

liron

Sure

combo_for_kneron.onnx.zip

Also Attaching the toolchain python script I used for compilation

flow.py.txt

Andy Hsieh

@liron

Hi liron,

Thank you for providing the .onnx model and toolchain python script.

We are still looking for the cause of the error message. If there is any new progress, we will report back to you at any time.

Andy Hsieh

@liron

Hi liron,

Sorry for the late reply. The cause of the error message has been found, we will improve this problem in the next version of Kneron ToolChain.

liron

Thanks!

Is the fix already included in toolchain V0.17.1?

Andy Hsieh

@liron

Hi liron,

Apologies for the delay. You can already use toolchain v0.17.1 to successfully convert the model you provided to generate NEF.🙂