Get depth from dual camera Android smartphone

Viewed 12974

There are many dual camera Android phones in the market which can take image with bokeh effect. Is it possible to create an Android app to make use of dual camera and get the depth of each pixel in image? Or accessing two camera at the same time to produce stereo image?

3 Answers

Android P will be supporting multicamera mode so that developers/users can access both physical cameras. Depth calculation from monochrome is not a problem because most algorithms use the stereo pictures after converting them to gtay scale. In current versions the difficulty is only getting access to both physical cameras. I am too waiting for this Android release.

This one is written in OpenCV python using grayscale image as input. https://docs.opencv.org/3.0-beta/doc/py_tutorials/py_calib3d/py_depthmap/py_depthmap.html

In certain Xiaomi phones, I have tested in Poco F1, it is possible to access the second depth sensing camera.

By tapping on the Kernel version multiple times, we can get to phone testing. There, we can access the second rear camera. The zoom level seems to be around 2X in my model and surprisingly it is a colour sensor. No autofocus though, but the depth is set at infinity so the photos aren't very bad.

The only way to save the pic seems to be taking a screenshot, unfortunately.

The modern dual-camera devices don't allow user control the way they use the lenses. I explained the situation also in an answer to Capturing a photo from only one lens, in dual-camera phones?. These devices have different cameras, e.g. color and mono (in case of Huawei P9), so reconstruction of stereo image would be difficult if not impossible even if you somehow get control of the two sensors.

On the other hand, the HTC Evo 3D phone comes with SDK that lets you do exactly this: work with the stereo picture.

Related