Added: Jan. 13, 2013, 4:17 p.m.
FOV: 35.192° (larger dimension)
Focal length: 2.365 × height
Scene: living room
Scene correct: 
		
		True
		
	
Whitebalanced: 
		
		True
		
	
Scene label correct votes:
Scene label correct score:
Whitebalance votes:
Whitebalance score:
Flickr user: dennis
Flickr ID: 511007809
License: Attribution 2.0 Generic
	
	(Credit: Dennis Yang)
Material segmentations
Users were asked to draw around regions of a single type of material.
Vanishing points
Each color corresponds to one vanishing point.  Hover over the points on the right to see the full lines.
- 0: [0.034295, -0.973056, -0.228002]
- 1: [-0.084816, -0.599536, -0.795841]
- 2: [0.284643, 0.071134, -0.955991]
- 3: [-0.021836, 0.911606, -0.410486]
- 4: [-0.948193, 0.075014, -0.308710]
- 5: [-0.486062, -0.087348, -0.869548]
- 6: [-0.059263, 0.312401, -0.948100]
- 7: [-0.002494, -0.277145, -0.960825]
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
Median chroma- 5.164 (22.7 s)
- 12.596 (8.7 s)
- 12.860 (7.67 s)
- 9.045 (5.87 s)
- 10.841 (4.95 s)
- 11.299 (4.24 s)
 Human reflectance judgements
Our user interface for collecting annotations shows the user
				an image and asks them, for a particular pair of pixels
				(indicated with crosshairs and labeled Points 1 and 2), which
				of the two points has a darker surface color. The user can then
				select one of three options: Point 1, Point 2, and About the
				same. We ask users to specify their confidence in their
				assessment as Guessing, Probably, or Definitely, as was done by
				[Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points
				and use the CUBAM machine learning model [Welinder et al. 2010]
				to model two forms of bias.
See our publication for more details.

Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer.  Note that the reflectance layer is listed twice: color (left) and grayscale (center).  Decompositions are ordered by error and then runtime (best on top).  The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos.  See our publication for more details.
- Algorithm: bell2014_densecrf- Parameters:  - abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
 
- Result:
			 - Weighted human disagreement rate (WHDR): 30.0% (δ: 0.1)
- WHDR for equal edges only: 0.4150
- WHDR for inequalities only: 0.1667
- Runtime: 264.3 s
 
- Algorithm: grosse2009_grayscale_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Result:
			 - Weighted human disagreement rate (WHDR): 33.5% (δ: 0.1)
- WHDR for equal edges only: 0.5132
- WHDR for inequalities only: 0.1298
- Runtime: 237.2 s
 
- Algorithm: garces2012_clustering- Parameters:  - km k: 8
- remap gamma 2 2: False
 
- Result:
			 - Weighted human disagreement rate (WHDR): 34.2% (δ: 0.1)
- WHDR for equal edges only: 0.3999
- WHDR for inequalities only: 0.2751
- Runtime: 4.3 s
 
- Algorithm: grosse2009_color_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Parameters:  - L1: True
- threshold color: 0.7
- threshold gray: 0.5
 
- Result:
			 - Weighted human disagreement rate (WHDR): 35.7% (δ: 0.1)
- WHDR for equal edges only: 0.5634
- WHDR for inequalities only: 0.1203
- Runtime: 189.9 s
 
- Algorithm: zhao2012_nonlocal- Parameters:  - chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
 
- Result:
			 - Weighted human disagreement rate (WHDR): 38.1% (δ: 0.1)
- WHDR for equal edges only: 0.4722
- WHDR for inequalities only: 0.2759
- Runtime: 34.3 s
 
- Algorithm: shen2011_optimization- Parameters:  - rho: 1.9
- unmap srgb: False
- wd: 3
 
- Result:
			 - Weighted human disagreement rate (WHDR): 41.2% (δ: 0.1)
- WHDR for equal edges only: 0.5231
- WHDR for inequalities only: 0.2835
- Runtime: 262.0 s
 
- Algorithm: baseline_reflectance- Result:
			 - Weighted human disagreement rate (WHDR): 46.5% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s
 
- Algorithm: baseline_shading- Result:
			 - Weighted human disagreement rate (WHDR): 50.7% (δ: 0.1)
- WHDR for equal edges only: 0.8457
- WHDR for inequalities only: 0.1172
- Runtime: 0.1 s