Photo Detail
Added: Jan. 11, 2013, 3:46 p.m.
FOV: 49.831° (larger dimension)
Focal length: 1.435 × height
Scene: staircase
Scene correct: True
Whitebalanced: True
Scene label correct votes:
Scene label correct score:
Whitebalance votes:
Whitebalance score:
Flickr user: londonmatt
Flickr ID: 3290707206
License: Attribution 2.0 Generic (Credit: Matt Brown)
Material segmentations
Users were asked to draw around regions of a single type of material.
Vanishing points
Each color corresponds to one vanishing point. Hover over the points on the right to see the full lines.
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
- 1.047 (12.5 s)
- 2.424 (11.4 s)
- 2.138 (8.99 s)
- 2.822 (6.22 s)
- 1.102 (3.76 s)
- 2.596 (3.58 s)
Human reflectance judgements
Our user interface for collecting annotations shows the user an image and asks them, for a particular pair of pixels (indicated with crosshairs and labeled Points 1 and 2), which of the two points has a darker surface color. The user can then select one of three options: Point 1, Point 2, and About the same. We ask users to specify their confidence in their assessment as Guessing, Probably, or Definitely, as was done by [Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points and use the CUBAM machine learning model [Welinder et al. 2010] to model two forms of bias.
See our publication for more details.
Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer. Note that the reflectance layer is listed twice: color (left) and grayscale (center). Decompositions are ordered by error and then runtime (best on top). The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos. See our publication for more details.
Algorithm: zhao2012_nonlocal
Citation:
Qi Zhao, Ping Tan, Qiang Dai, Li Shen, Enhua Wu, Stephen Lin. "A Closed-form Solution to Retinex with Non-local Texture Constraints". IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI). http://www.ece.nus.edu.sg/stfpage/eletp/Papers/pami12_intrinsic.pdf.Parameters:
- chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
Result:
- Weighted human disagreement rate (WHDR): 12.4% (δ: 0.1)
- WHDR for equal edges only: 0.0465
- WHDR for inequalities only: 0.2352
- Runtime: 53.3 s
Algorithm: shen2011_optimization
Citation:
Jianbing Shen, Xiaoshan Yang, Yunde Jia, Xuelong Li. "Intrinsic Images Using Optimization". Proceedings of Computer Vision and Pattern Recognition (CVPR). http://cs.bit.edu.cn/~shenjianbing/cvpr11.htm.Parameters:
- rho: 1.9
- unmap srgb: False
- wd: 3
Result:
- Weighted human disagreement rate (WHDR): 12.9% (δ: 0.1)
- WHDR for equal edges only: 0.1659
- WHDR for inequalities only: 0.0752
- Runtime: 359.0 s
Algorithm: grosse2009_color_retinex
Citation:
Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman. "Ground truth dataset and baseline evaluations for intrinsic image algorithms". Proceedings of the International Conference on Computer Vision (ICCV). http://www.cs.toronto.edu/~rgrosse/intrinsic/.Parameters:
- L1: True
- threshold color: 0.7
- threshold gray: 0.5
Result:
- Weighted human disagreement rate (WHDR): 15.0% (δ: 0.1)
- WHDR for equal edges only: 0.2532
- WHDR for inequalities only: 0.0012
- Runtime: 171.7 s
Algorithm: grosse2009_grayscale_retinex
Citation:
Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman. "Ground truth dataset and baseline evaluations for intrinsic image algorithms". Proceedings of the International Conference on Computer Vision (ICCV). http://www.cs.toronto.edu/~rgrosse/intrinsic/.Parameters:
- L1: True
- threshold: 0.5
Result:
- Weighted human disagreement rate (WHDR): 16.5% (δ: 0.1)
- WHDR for equal edges only: 0.2784
- WHDR for inequalities only: 0.0012
- Runtime: 221.4 s
Algorithm: bell2014_densecrf
Citation:
Sean Bell, Kavita Bala, Noah Snavely. "Intrinsic Images in the Wild". ACM Transactions on Graphics (SIGGRAPH 2014). http://intrinsic.cs.cornell.edu.Parameters:
- abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
Result:
- Weighted human disagreement rate (WHDR): 18.5% (δ: 0.1)
- WHDR for equal edges only: 0.2446
- WHDR for inequalities only: 0.0995
- Runtime: 307.8 s
Algorithm: garces2012_clustering
Citation:
Elena Garces, Adolfo Munoz, Jorge Lopez-Moreno, Diego Gutierrez. "Intrinsic Images by Clustering". Computer Graphics Forum (Eurographics Symposium on Rendering). http://www-sop.inria.fr/reves/Basilic/2012/GMLG12/.Parameters:
- km k: 8
- remap gamma 2 2: False
Result:
- Weighted human disagreement rate (WHDR): 20.1% (δ: 0.1)
- WHDR for equal edges only: 0.2296
- WHDR for inequalities only: 0.1607
- Runtime: 11.3 s
Algorithm: baseline_shading
Parameters: None
Result:
- Weighted human disagreement rate (WHDR): 40.0% (δ: 0.1)
- WHDR for equal edges only: 0.6647
- WHDR for inequalities only: 0.0191
- Runtime: 0.1 s
Algorithm: baseline_reflectance
Parameters: None
Result:
- Weighted human disagreement rate (WHDR): 41.0% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s