Simulated dataset for Lytro-like plenoptic camera configuration, i.e., unfocused plenoptic camera (UPC), associated to our IJCV’2022 paper! See https://github.com/comsee-research/plenoptic-datasets

Details

Download link

The dataset can be downloaded here.

Experimental setup

We used the Lytro Illum intrinsic parameters reported in Table 4 of Bok et al. (2017) as baseline for the simulation, corresponding to a main lens of aperture F/2 with a 9.9845 mm focal length. The camera is in unfocused internal configuration (i.e., f = d). The MLA organization is hexagonal row-aligned, and composed of 541 x 434 (width x height) micro-lenses of the same type (I = 1). The raw image resolution is 7728 x 5368 pixel, with a pixel size of s = 0.0014 mm and with micro-image of radius 7.172 pixel.

Dataset

The dataset is correspond to the focus distance configuration h = hyperfocal.

The dataset is composed of:

• white raw plenoptic images simulated at different apertures (N in {2, 4, 5.6}) for pre-calibration step,
• free-hand calibration targets simulated at various poses (in distance and orientation), separated into two subsets, one for the calibration process and the other for reprojection error evaluation,
• and calibration targets with known translation along the z-axis for quantitative evaluation.

We use a 9 x 5 of 26.25 mm side checkerboard.

Software and setup

All images has been generated using the libpleno and our raytracing simulator PRISM.

Applications

For instance, the datasets can be used with the following applications :

• COMPOTE (Calibration Of Multi-focus PlenOpTic camEra), a collection of tools to pre-calibrate and calibrate (multifocus) plenoptic cameras.
• PRISM (Plenoptic Raw Image Simulator), a collection of tools to generate and simulate raw images from (multifocus) plenoptic cameras.
• BLADE (BLur Aware Depth Estimation with a plenoptic camera), a collection of tools to estimate depth map from raw images obtained by (multifocus) plenoptic cameras.

Based on the libpleno, an open-source C++ computer-vision library for plenoptic cameras modeling and processing.

Citing

If you use our datasets, the libpleno, the COMPOTE tools, the PRISM tools or the BLADE tools in an academic context, please cite the following publication:

@inproceedings{labussiere2020blur,
  title 	=	{Blur Aware Calibration of Multi-Focus Plenoptic Camera},
  author	=	{Labussi{\`e}re, Mathieu and Teuli{\`e}re, C{\'e}line and Bernardin, Fr{\'e}d{\'e}ric and Ait-Aider, Omar},
  booktitle	=	{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  pages		=	{2545--2554},
  year		=	{2020}

or

@article{labussiere2022calibration
  title		=	{Leveraging blur information for plenoptic camera calibration},
  author	=	{Labussi{\`{e}}re, Mathieu and Teuli{\`{e}}re, C{\'{e}}line and Bernardin, Fr{\'{e}}d{\'{e}}ric and Ait-Aider, Omar},
  doi		=	{10.1007/s11263-022-01582-z},
  journal	=	{International Journal of Computer Vision},
  year		=	{2022},
  month		=	{may},
  number	=	{2012},
  pages		=	{1--23}
}

License

This work is licensed under the Creative Commons Attribution-NonCommercial 4.0 International License. Enjoy!

Note: if download links are broken, don’t hesitate to contact me!