Stereo Camera Porting Issues

Hi, I have several questions:

First, I am currently working on a project involving streaming with a stereo camera (MIPI) on the Kneo-pi. I would like to use the stereo camera for streaming. Right now, I am using the example_nnm_sensor from the kneopi-examples as a reference. So far, I can stream from each camera independently, but now I want to move on to dual-camera streaming.

What I did was copy the example_sensor_image_thread in input_sensor.cpp, then created new buffers and new handles to control the second sensor. However, the result is that both displays still show the first sensor’s preview. I suspect this might be due to resource binding issues. Do you have any examples for handling stereo cameras?

Second, it seems that both threads are using the same src_pin. Is there any documentation where I can find the pin definitions? Could this be the reason why I am seeing the same image from both cameras?

Below is a log showing that both threads are using the same pin:

D/[VBIND] VMF_BIND_Request() bUnregister 0, src status:3, is_request_resize:0, src_width:1920, src_height: 1080, src_stride: 1920, dwWidth: 1920, dwHeight: 1080, dwStride: 1920, dwOldResolutionWidth(0), dwOldResolutionHeight(0)

D/[VBIND] VMF_BIND_Request() req_w:1920, req_h:1080, req_st:1920 src_pin:vsrc_ssm_0 cr:0

D/[VBIND] VMF_BIND_Request() bUnregister 0, src status:3, is_request_resize:0, src_width:1920, src_height: 1080, src_stride: 1920, dwWidth: 1920, dwHeight: 1080, dwStride: 1920, dwOldResolutionWidth(0), dwOldResolutionHeight(0)

D/[VBIND] VMF_BIND_Request() req_w:1920, req_h:1080, req_st:1920 src_pin:vsrc_ssm__0 cr:0

Third, is there any documentation that explains how to use the VMF API and how to bring up the stereo camera in fusion mode? Also, is there documentation for the configuration definitions, such as those in imx219_1920x1080_ch0.cfg? Specifically, what parameters should I modify when I need to enable the second camera?

Thank you.

Sign In or Register to comment.