Material segmentations
Users were asked to draw around regions of a single type of material.
Vanishing points
Each color corresponds to one vanishing point.  Hover over the points on the right to see the full lines.
- 0: [-0.053751, -0.778106, -0.625830]
- 1: [-0.619446, 0.350658, -0.702371]
- 2: [-0.867068, 0.334013, -0.369634]
- 3: [-0.071181, 0.481160, -0.873738]
- 4: [-0.112938, -0.449425, -0.886150]
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
Median chroma- 10.874 (18.3 s)
- 14.931 (17.4 s)
- 7.606 (15.7 s)
- 8.995 (12.3 s)
- 15.341 (10.3 s)
- 9.243 (6.29 s)
 Human reflectance judgements
Our user interface for collecting annotations shows the user
				an image and asks them, for a particular pair of pixels
				(indicated with crosshairs and labeled Points 1 and 2), which
				of the two points has a darker surface color. The user can then
				select one of three options: Point 1, Point 2, and About the
				same. We ask users to specify their confidence in their
				assessment as Guessing, Probably, or Definitely, as was done by
				[Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points
				and use the CUBAM machine learning model [Welinder et al. 2010]
				to model two forms of bias.
See our publication for more details.

Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer.  Note that the reflectance layer is listed twice: color (left) and grayscale (center).  Decompositions are ordered by error and then runtime (best on top).  The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos.  See our publication for more details.
- Algorithm: garces2012_clustering- Parameters:  - km k: 8
- remap gamma 2 2: False
 
- Result:
			 - Weighted human disagreement rate (WHDR): 19.4% (δ: 0.1)
- WHDR for equal edges only: 0.2125
- WHDR for inequalities only: 0.1441
- Runtime: 3.3 s
 
- Algorithm: shen2011_optimization- Parameters:  - rho: 1.9
- unmap srgb: False
- wd: 3
 
- Result:
			 - Weighted human disagreement rate (WHDR): 23.0% (δ: 0.1)
- WHDR for equal edges only: 0.1765
- WHDR for inequalities only: 0.3780
- Runtime: 596.7 s
 
- Algorithm: baseline_reflectance- Result:
			 - Weighted human disagreement rate (WHDR): 26.6% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s
 
- Algorithm: bell2014_densecrf- Parameters:  - abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
 
- Result:
			 - Weighted human disagreement rate (WHDR): 33.4% (δ: 0.1)
- WHDR for equal edges only: 0.2617
- WHDR for inequalities only: 0.5325
- Runtime: 155.8 s
 
- Algorithm: grosse2009_color_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Parameters:  - L1: True
- threshold color: 0.7
- threshold gray: 0.5
 
- Result:
			 - Weighted human disagreement rate (WHDR): 33.8% (δ: 0.1)
- WHDR for equal edges only: 0.2250
- WHDR for inequalities only: 0.6477
- Runtime: 193.5 s
 
- Algorithm: zhao2012_nonlocal- Parameters:  - chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
 
- Result:
			 - Weighted human disagreement rate (WHDR): 36.9% (δ: 0.1)
- WHDR for equal edges only: 0.2581
- WHDR for inequalities only: 0.6754
- Runtime: 18.9 s
 
- Algorithm: grosse2009_grayscale_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Result:
			 - Weighted human disagreement rate (WHDR): 47.2% (δ: 0.1)
- WHDR for equal edges only: 0.4088
- WHDR for inequalities only: 0.6477
- Runtime: 221.7 s
 
- Algorithm: baseline_shading- Result:
			 - Weighted human disagreement rate (WHDR): 57.2% (δ: 0.1)
- WHDR for equal edges only: 0.6962
- WHDR for inequalities only: 0.2303
- Runtime: 0.1 s