Added: Jan. 11, 2013, 3:59 p.m.
FOV: 29.987° (larger dimension)
Focal length: 1.867 × height
Scene: staircase
Scene correct: 
		
		True
		
	
Whitebalanced: 
		
		True
		
	
Scene label correct votes:
Scene label correct score:
Whitebalance votes:
Whitebalance score:
Flickr user: edenpictures
Flickr ID: 4922614514
License: Attribution 2.0 Generic
	
	(Credit: Eden, Janine and Jim)
Material segmentations
Users were asked to draw around regions of a single type of material.
No items are available.
Vanishing points
Each color corresponds to one vanishing point.  Hover over the points on the right to see the full lines.
- 0: [0.024589, 0.792067, -0.609939]
- 1: [0.691605, 0.070230, -0.718853]
- 2: [-0.052352, 0.256780, -0.965051]
- 3: [-0.701357, -0.203497, -0.683145]
- 4: [0.001885, -0.872082, -0.489356]
- 5: [-0.014290, -0.248963, -0.968408]
- 6: [0.411422, -0.096745, -0.906296]
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
Median chroma- 5.730 (28.3 s)
- 6.319 (19.3 s)
- 6.076 (17.9 s)
- 12.513 (8.85 s)
- 11.006 (8.22 s)
 Human reflectance judgements
Our user interface for collecting annotations shows the user
				an image and asks them, for a particular pair of pixels
				(indicated with crosshairs and labeled Points 1 and 2), which
				of the two points has a darker surface color. The user can then
				select one of three options: Point 1, Point 2, and About the
				same. We ask users to specify their confidence in their
				assessment as Guessing, Probably, or Definitely, as was done by
				[Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points
				and use the CUBAM machine learning model [Welinder et al. 2010]
				to model two forms of bias.
See our publication for more details.

Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer.  Note that the reflectance layer is listed twice: color (left) and grayscale (center).  Decompositions are ordered by error and then runtime (best on top).  The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos.  See our publication for more details.
- Algorithm: shen2011_optimization- Parameters:  - rho: 1.9
- unmap srgb: False
- wd: 3
 
- Result:
			 - Weighted human disagreement rate (WHDR): 36.8% (δ: 0.1)
- WHDR for equal edges only: 0.4037
- WHDR for inequalities only: 0.3150
- Runtime: 313.0 s
 
- Algorithm: baseline_reflectance- Result:
			 - Weighted human disagreement rate (WHDR): 40.0% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s
 
- Algorithm: bell2014_densecrf- Parameters:  - abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
 
- Result:
			 - Weighted human disagreement rate (WHDR): 43.9% (δ: 0.1)
- WHDR for equal edges only: 0.5045
- WHDR for inequalities only: 0.3408
- Runtime: 470.7 s
 
- Algorithm: zhao2012_nonlocal- Parameters:  - chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
 
- Result:
			 - Weighted human disagreement rate (WHDR): 45.9% (δ: 0.1)
- WHDR for equal edges only: 0.4367
- WHDR for inequalities only: 0.4929
- Runtime: 48.7 s
 
- Algorithm: garces2012_clustering- Parameters:  - km k: 8
- remap gamma 2 2: False
 
- Result:
			 - Weighted human disagreement rate (WHDR): 47.0% (δ: 0.1)
- WHDR for equal edges only: 0.4580
- WHDR for inequalities only: 0.4877
- Runtime: 11.0 s
 
- Algorithm: grosse2009_color_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Parameters:  - L1: True
- threshold color: 0.7
- threshold gray: 0.5
 
- Result:
			 - Weighted human disagreement rate (WHDR): 49.3% (δ: 0.1)
- WHDR for equal edges only: 0.5974
- WHDR for inequalities only: 0.3368
- Runtime: 219.3 s
 
- Algorithm: grosse2009_grayscale_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Result:
			 - Weighted human disagreement rate (WHDR): 49.9% (δ: 0.1)
- WHDR for equal edges only: 0.5593
- WHDR for inequalities only: 0.4087
- Runtime: 236.9 s
 
- Algorithm: baseline_shading- Result:
			 - Weighted human disagreement rate (WHDR): 60.4% (δ: 0.1)
- WHDR for equal edges only: 0.8663
- WHDR for inequalities only: 0.2095
- Runtime: 0.1 s