A Raspberry Pi camera and Ouster OS0 produce a coloured point-cloud experiment. Checkerboard and manual matching improve selected static boundaries from about 13.5 to 4.2 pixels, but the person ghost remains unresolved.

Watch Episode 3 on YouTube ↗

Can GPT-6 Fix LiDAR / Camera Calibration? | The $5 Camera Experiment

The idea was simple: add camera colour to measured LiDAR geometry. The setup paired a cheap Raspberry Pi camera with an Ouster OS0 and an agent doing much of the programming and computer vision.

Manually matching a room feature between the camera image and LiDAR view.
EP03 · 1:28 · Recorded evidenceManually matching a room feature between the camera image and LiDAR view. Watch this moment ↗
Reusing the same physical room boundaries to check the projection.
EP03 · 2:34 · Recorded evidenceReusing the same physical room boundaries to check the projection. Watch this moment ↗

Checkerboard captures and manual matches helped selected static boundaries. Then I entered the scene, and foreground colours appeared on background wall points. Filtering removed geometry without reliably removing the problem. Four held poses, including a rocking horse, gave us harder cases to compare.

The selected static-boundary comparison improves from 13.5 to 4.2 pixels; this is not whole-system accuracy.
EP03 · 2:56 · Recorded evidenceThe selected static-boundary comparison improves from 13.5 to 4.2 pixels; this is not whole-system accuracy. Watch this moment ↗

The important distinction is between alignment, timing and visibility. The reported reduction from about 13.5 to 4.2 pixels applies to selected boundaries. It does not prove overall calibration, and the ghost remained unresolved. The longer field note preserves the unsuccessful fixes and subsequent checks.

Using a checkerboard displayed on a laptop as a calibration target in the real room.
EP03 · 1:06 · Recorded evidenceUsing a checkerboard displayed on a laptop as a calibration target in the real room. Watch this moment ↗
Four held poses used to investigate the remaining camera–LiDAR mismatch.
EP03 · 4:02 · Recorded evidenceFour held poses used to investigate the remaining camera–LiDAR mismatch. Watch this moment ↗

Read the detailed engineering field note →

Scope of this episode: Selected-boundary residual is not whole-system accuracy.

Based on the published episode and its production record. YouTube publication verified 22 October 2026. Stills are extracted from the released episode. Captions distinguish recorded evidence, reconstruction, simulation and illustrative material.