Added: Jan. 11, 2013, 8:10 p.m.
FOV: 49.134° (larger dimension)
Focal length: 1.458 × height
Scene: dining room
Scene correct: 
		
		True
		
	
Whitebalanced: 
		
		True
		
	
Scene label correct votes:
Scene label correct score:
Whitebalance votes:
Whitebalance score:
Flickr user: bonitalabanane
Flickr ID: 2292661988
License: Attribution 2.0 Generic
	
	(Credit: Bonita de Boer)
Material segmentations
Users were asked to draw around regions of a single type of material.
Vanishing points
Each color corresponds to one vanishing point.  Hover over the points on the right to see the full lines.
- 0: [-0.006809, -0.994545, -0.104090]
- 1: [0.822358, 0.061095, -0.565681]
- 2: [0.348841, 0.261922, -0.899837]
- 3: [-0.954624, -0.001131, -0.297811]
- 4: [0.052373, -0.277611, -0.959265]
- 5: [0.237034, -0.844015, -0.481097]
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
Median chroma- 11.921 (19.4 s)
- 5.805 (14.1 s)
- 2.048 (9.55 s)
- 15.357 (8.67 s)
- 32.686 (7.71 s)
- 26.196 (6.11 s)
 Human reflectance judgements
Our user interface for collecting annotations shows the user
				an image and asks them, for a particular pair of pixels
				(indicated with crosshairs and labeled Points 1 and 2), which
				of the two points has a darker surface color. The user can then
				select one of three options: Point 1, Point 2, and About the
				same. We ask users to specify their confidence in their
				assessment as Guessing, Probably, or Definitely, as was done by
				[Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points
				and use the CUBAM machine learning model [Welinder et al. 2010]
				to model two forms of bias.
See our publication for more details.

Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer.  Note that the reflectance layer is listed twice: color (left) and grayscale (center).  Decompositions are ordered by error and then runtime (best on top).  The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos.  See our publication for more details.
- Algorithm: bell2014_densecrf- Parameters:  - abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
 
- Result:
			 - Weighted human disagreement rate (WHDR): 33.0% (δ: 0.1)
- WHDR for equal edges only: 0.4224
- WHDR for inequalities only: 0.2197
- Runtime: 527.0 s
 
- Algorithm: garces2012_clustering- Parameters:  - km k: 8
- remap gamma 2 2: False
 
- Result:
			 - Weighted human disagreement rate (WHDR): 36.8% (δ: 0.1)
- WHDR for equal edges only: 0.4777
- WHDR for inequalities only: 0.2369
- Runtime: 9.2 s
 
- Algorithm: shen2011_optimization- Parameters:  - rho: 1.9
- unmap srgb: False
- wd: 3
 
- Result:
			 - Weighted human disagreement rate (WHDR): 38.2% (δ: 0.1)
- WHDR for equal edges only: 0.5556
- WHDR for inequalities only: 0.1758
- Runtime: 319.4 s
 
- Algorithm: zhao2012_nonlocal- Parameters:  - chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
 
- Result:
			 - Weighted human disagreement rate (WHDR): 41.7% (δ: 0.1)
- WHDR for equal edges only: 0.6620
- WHDR for inequalities only: 0.1269
- Runtime: 38.5 s
 
- Algorithm: baseline_reflectance- Result:
			 - Weighted human disagreement rate (WHDR): 45.7% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s
 
- Algorithm: grosse2009_color_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Parameters:  - L1: True
- threshold color: 0.7
- threshold gray: 0.5
 
- Result:
			 - Weighted human disagreement rate (WHDR): 46.7% (δ: 0.1)
- WHDR for equal edges only: 0.7406
- WHDR for inequalities only: 0.1430
- Runtime: 147.2 s
 
- Algorithm: grosse2009_grayscale_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Result:
			 - Weighted human disagreement rate (WHDR): 48.8% (δ: 0.1)
- WHDR for equal edges only: 0.7756
- WHDR for inequalities only: 0.1465
- Runtime: 126.7 s
 
- Algorithm: baseline_shading- Result:
			 - Weighted human disagreement rate (WHDR): 52.8% (δ: 0.1)
- WHDR for equal edges only: 0.8821
- WHDR for inequalities only: 0.1065
- Runtime: 0.1 s