Camera Design

A 1920 x 1080 video at 30 fps with RGB8 (24 bits total) comes out to 1.5Gbits/s.

Correct the colors based on a color temperature assumption.

Sensor based color correction matrix that is generated at the factory using a color chart that solves for the error between actual and produced color charts.

Color space is not linear in reality, but the sensor perceives it as such. This will lead to images that have colors compressed other side of the range, and make it harder for us to distinguish between them. Gamma correcection corrects for the exponent of the non linear nature of light and color.

Camera sensors will exhibit noise over the pixel array.

There are multiple de-noising techniques, such as temporal denoising that uses a burst of frames to average out the random noise pattern.

This can also be done on a single frame use a spatial denoising technique, that looks at the values of neighboring pixels.

Final Pipeline example.

API for controlling a camera by Kari Pulli

You can share memory between forked processes using mmap. This gives you a pointer to shared memory.

Physically contiguous memory allocated in the kernal space.

Physically contiguous memory allocated in the kernal space. Initialized to zero.

Like malloc but initializes data requested to zeros.

sysfs is a virtual filesystem that is used to communicate information about the system to the user space.