Scan stops halfway

[ForceConstant]

So things worked fine with openscan2 with same setup, but am trying out openscan3 and tried twice, once with 11.2, and 11.3 and both times scan stopped half-way through. I did see this in the log the second time.

This is a midi with IMX519, blackshield, and raspi 4GB.

What else can I do to debug?

Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,147 - DEBUG - [motors.py:_execute_movement] - Motor turntable moved -52.54 degrees.
Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,149 - DEBUG - [motors.py:move_to_point] - Moved to PolarPoint3D(theta=67.12431135454347, fi=159.3788759969732, r=1.0)
Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,149 - DEBUG - [scan_task.py:_capture_photos_at_position] - Capturing photo at position PolarPoint3D(theta=67.12431135454347, fi=159.37887>
Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,149 - DEBUG - [scan_task.py:_capture_photos_at_position] - Focus stacking enabled, capturing photo 1 / 5 with focus 5.0
Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,149 - DEBUG - [settings.py:__setattr__] - Trying to set 'manual_focus' to '5.0'
Apr 27 13:32:09 openscan3 openscan3[1142]: 2026-04-27 13:32:09,150 - DEBUG - [settings.py:__setattr__] - Set 'manual_focus' to '5.0'
Apr 27 13:32:09 openscan3 openscan3[1142]: [0:13:40.998656784] [1296]  WARN V4L2 v4l2_videodevice.cpp:2100 /dev/video0[41:cap]: Dequeue timer of 1000000.00us has expired!
Apr 27 13:32:09 openscan3 openscan3[1142]: [0:13:40.998793153] [1296] ERROR RPI pipeline_base.cpp:1418 Camera frontend has timed out!
Apr 27 13:32:09 openscan3 openscan3[1142]: [0:13:40.998824597] [1296] ERROR RPI pipeline_base.cpp:1419 Please check that your camera sensor connector is attached securely.
Apr 27 13:32:09 openscan3 openscan3[1142]: [0:13:40.998854115] [1296] ERROR RPI pipeline_base.cpp:1420 Alternatively, try another cable and/or sensor.
lines 1-22/22 (END)

[esto-openscan]

Thanks for the detailed log!

This looks like a low-level camera stack issue below OpenScan3 itself. The timeout is reported by libcamera / the Raspberry Pi kernel camera pipeline.

Since the same hardware worked with OpenScan2, I would currently suspect a compatibility/timing issue with the newer kernel/libcamera stack used by OpenScan3 rather than an obvious hardware fault. That said, marginal cable or power issues can still show up differently with a newer camera stack.

One interesting detail is that focus stacking was enabled and the timeout happened right after changing the IMX519 focus value. Could you try a few scans with autofocus or a fixed manual focus? That would help narrow down whether repeated focus changes/capture cycles are involved.

If possible, please also attach the relevant dmesg output after the failed scan.

Independent of the root cause, OpenScan3 should handle this more gracefully. I’ll add retry handling for failed captures and, if needed, a camera restart fallback before the whole scan task fails.

[ForceConstant]

Ok some more data now, as it seems to be having that same error at startup. But immediately after I can use rpicam-still (rpicam-still --camera 0 -t 5000 --lens-position 6.0 -o test.jpg) to take pics at 30fps and it doesn't complain. Does this mean anything?

Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'scan_task' (exclusive: True) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'external_trigger_run_task' (exclusive: True) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'focus_stacking_task' (exclusive: False) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'cloud_upload_task' (exclusive: False) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'cloud_download_task' (exclusive: False) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,343 - INFO - [task_manager.py:register_task] - Task 'qr_scan_task' (exclusive: False) registered successfully.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,344 - INFO - [task_manager.py:restore_tasks_from_persistence] - Restoring persisted tasks from data/tasks...
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,345 - INFO - [task_manager.py:restore_tasks_from_persistence] - Task loading complete. Loaded: 1, Interrupted: 0, Cleaned up: 0.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,345 - INFO - [firmware.py:load_firmware_settings] - Loaded firmware settings from /etc/openscan3/firmware/firmware_settings.json
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,388 - INFO - [main.py:_maybe_start_qr_wifi_scan] - Network is already connected (WiFi/LAN) – skipping QR WiFi scan auto-start.
Apr 28 10:12:00 openscan3 openscan3[57140]: 2026-04-28 10:12:00,390 - INFO - [on.py:startup] - Application startup complete.
Apr 28 10:12:02 openscan3 openscan3[57140]: 2026-04-28 10:12:02,690 - INFO - [websockets_impl.py:asgi_send] - 192.168.1.199:0 - "WebSocket /api/v0.9/ws/device" [accepted]
Apr 28 10:12:02 openscan3 openscan3[57140]: 2026-04-28 10:12:02,691 - DEBUG - [websocket.py:register] - Registered WebSocket for namespace device
Apr 28 10:12:02 openscan3 openscan3[57140]: 2026-04-28 10:12:02,692 - INFO - [server.py:handshake] - connection open
Apr 28 10:12:02 openscan3 openscan3[57140]: 2026-04-28 10:12:02,745 - INFO - [httptools_impl.py:send] - 192.168.1.199:0 - "GET /api/v0.9/device/info HTTP/1.1" 200
Apr 28 10:12:03 openscan3 openscan3[57140]: 2026-04-28 10:12:03,653 - INFO - [websockets_impl.py:asgi_send] - 192.168.1.199:0 - "WebSocket /api/v0.9/ws/tasks" [accepted]
Apr 28 10:12:03 openscan3 openscan3[57140]: 2026-04-28 10:12:03,654 - DEBUG - [websocket.py:register] - Registered WebSocket for namespace tasks
Apr 28 10:12:03 openscan3 openscan3[57140]: 2026-04-28 10:12:03,655 - INFO - [server.py:handshake] - connection open
Apr 28 10:13:32 openscan3 openscan3[57140]: [0:59:52.810107666] [57270]  WARN V4L2 v4l2_videodevice.cpp:2100 /dev/video0[30:cap]: Dequeue timer of 1000000.00us has expired!
Apr 28 10:13:32 openscan3 openscan3[57140]: [0:59:52.810227498] [57270] ERROR RPI pipeline_base.cpp:1418 Camera frontend has timed out!
Apr 28 10:13:32 openscan3 openscan3[57140]: [0:59:52.810254664] [57270] ERROR RPI pipeline_base.cpp:1419 Please check that your camera sensor connector is attached securely.
Apr 28 10:13:32 openscan3 openscan3[57140]: [0:59:52.810279405] [57270] ERROR RPI pipeline_base.cpp:1420 Alternatively, try another cable and/or sensor.

[1:13:15.448672270] [72780]  INFO Camera camera_manager.cpp:340 libcamera v0.7.0+rpt20260205+26-ea09c2c5-dirty (2026-02-09T01:41:24GMT)
[1:13:15.557709886] [72783]  INFO IPAProxy ipa_proxy.cpp:180 Using tuning file /usr/share/libcamera/ipa/rpi/vc4/imx519.json
[1:13:15.562935423] [72783]  INFO Camera camera_manager.cpp:223 Adding camera '/base/soc/i2c0mux/i2c@1/imx519@1a' for pipeline handler rpi/vc4
[1:13:15.563043735] [72783]  INFO RPI vc4.cpp:453 Registered camera /base/soc/i2c0mux/i2c@1/imx519@1a to Unicam device /dev/media0 and ISP device /dev/media2
[1:13:15.563082086] [72783]  INFO RPI pipeline_base.cpp:1156 Using configuration file '/usr/share/libcamera/pipeline/rpi/vc4/rpi_apps.yaml'
Made X/EGL preview window
Made DRM preview window
Preview window unavailable
Mode selection for 2328:1748:12:P
    SRGGB10_CSI2P,1280x720/0 - Score: 5319.24
    SRGGB10_CSI2P,1920x1080/0 - Score: 3319.24
    SRGGB10_CSI2P,2328x1748/0 - Score: 1000
    SRGGB10_CSI2P,3840x2160/0 - Score: 1648.24
    SRGGB10_CSI2P,4656x3496/0 - Score: 2019
Stream configuration adjusted
[1:13:15.609749246] [72780]  INFO Camera camera.cpp:1215 configuring streams: (0) 2328x1748-YUV420/sYCC (1) 2328x1748-SRGGB10_CSI2P/RAW
[1:13:15.610328509] [72783]  INFO RPI vc4.cpp:628 Sensor: /base/soc/i2c0mux/i2c@1/imx519@1a - Selected sensor format: 2328x1748-SRGGB10_1X10/RAW - Selected unicam format: 2328x1748-pRAA/RAW
#7 (0.00 fps) exp 32844.00 ag 7.82 dg 1.00
#8 (30.00 fps) exp 32844.00 ag 7.82 dg 1.00
#9 (30.00 fps) exp 32844.00 ag 7.82 dg 1.00

[esto-openscan]

Thanks, that is useful data!

The interesting part in this log is that the timeout happens shortly after startup, without an obvious OpenScan3 capture step directly before it. That makes me wonder whether this is related to the initial/preview camera pipeline rather than the scan task itself.

The fact that rpicam-still works immediately afterwards suggests that the camera is not completely dead or permanently unavailable. It does make me suspect the long-running OpenScan3/Picamera2 camera session more than the sensor itself. rpicam-still starts a fresh libcamera process and initializes the camera from scratch, while OpenScan3 keeps a camera pipeline alive through Picamera2 / the web UI / scan workflow with settings optimized for photogrammetry.

A few questions that would help narrow this down further:

• Was OpenScan3 still running when you ran rpicam-still, or did you stop the service first?
• Could you share the camera-related settings from /etc/openscan3/device/device_config.json?
• Does the timeout still happen if the Web UI preview is not opened after startup?

If it also happens without opening the preview, then the issue is probably in the initial camera setup. If it only happens after opening the preview or during scans, we can focus more on preview/capture/reconfigure handling.