Added: Jan. 11, 2013, 3:50 p.m.
FOV: 43.426° (larger dimension)
Focal length: 1.256 × height
Scene: staircase
Scene correct: 
		
		True
		
	
Whitebalanced: 
		
		True
		
	
Scene label correct votes:
Scene label correct score:
Whitebalance votes:
Whitebalance score:
Flickr user: chriswaits
Flickr ID: 5670764774
License: Attribution 2.0 Generic
	
	(Credit: Chris Waits)
Material segmentations
Users were asked to draw around regions of a single type of material.
No items are available.
Vanishing points
Each color corresponds to one vanishing point.  Hover over the points on the right to see the full lines.
- 0: [0.065108, -0.442678, -0.894314]
- 1: [-0.973938, 0.142383, -0.176556]
- 2: [0.156927, 0.350585, -0.923290]
- 3: [0.476085, 0.163893, -0.863992]
- 4: [-0.226520, 0.324467, -0.918373]
- 5: [-0.070756, 0.762630, -0.642954]
- 6: [-0.090199, -0.818657, -0.567155]
- 7: [-0.179193, -0.110711, -0.977565]
Whitebalance points
Users were asked to click on points that are white or gray.
Each color corresponds to one user.
Median chroma- 5.209 (13.9 s)
- 13.436 (10.8 s)
- 9.271 (9.92 s)
- 9.255 (9.51 s)
- 8.391 (4.4 s)
 Human reflectance judgements
Our user interface for collecting annotations shows the user
				an image and asks them, for a particular pair of pixels
				(indicated with crosshairs and labeled Points 1 and 2), which
				of the two points has a darker surface color. The user can then
				select one of three options: Point 1, Point 2, and About the
				same. We ask users to specify their confidence in their
				assessment as Guessing, Probably, or Definitely, as was done by
				[Branson et al. 2010].
We aggregate judgements from 5 users for each pair of points
				and use the CUBAM machine learning model [Welinder et al. 2010]
				to model two forms of bias.
See our publication for more details.

Our user interface
Intrinsic image decompositions
The input image is decomposed into a "reflectance" and "shading" layer.  Note that the reflectance layer is listed twice: color (left) and grayscale (center).  Decompositions are ordered by error and then runtime (best on top).  The parameters for each algorithm are the same for all photos; they are set to the values that produce lowest mean error (WHDR) for all photos.  See our publication for more details.
- Algorithm: baseline_reflectance- Result:
			 - Weighted human disagreement rate (WHDR): 39.3% (δ: 0.1)
- WHDR for equal edges only: 0.0000
- WHDR for inequalities only: 1.0000
- Runtime: 0.1 s
 
- Algorithm: zhao2012_nonlocal- Parameters:  - chrom thresh: 0.001
- gamma: False
- texture patch distance: 0.0003
- texture patch variance: 0.03
 
- Result:
			 - Weighted human disagreement rate (WHDR): 41.6% (δ: 0.1)
- WHDR for equal edges only: 0.4563
- WHDR for inequalities only: 0.3532
- Runtime: 33.2 s
 
- Algorithm: shen2011_optimization- Parameters:  - rho: 1.9
- unmap srgb: False
- wd: 3
 
- Result:
			 - Weighted human disagreement rate (WHDR): 43.5% (δ: 0.1)
- WHDR for equal edges only: 0.4899
- WHDR for inequalities only: 0.3489
- Runtime: 274.8 s
 
- Algorithm: bell2014_densecrf- Parameters:  - abs reflectance weight: 0
- abs shading gray point: 0.5
- abs shading weight: 500.0
- chromaticity weight: 0
- kmeans intensity scale: 0.5
- kmeans n clusters: 20
- n iters: 25
- pairwise intensity chromaticity: True
- pairwise weight: 104
- shading blur init method: none
- shading blur sigma: 0.1
- shading target norm: L2
- shading target weight: 20000.0
- split clusters: True
- theta c: 0.025
- theta l: 0.1
- theta p: 0.1
 
- Result:
			 - Weighted human disagreement rate (WHDR): 43.9% (δ: 0.1)
- WHDR for equal edges only: 0.5383
- WHDR for inequalities only: 0.2867
- Runtime: 343.5 s
 
- Algorithm: grosse2009_grayscale_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Result:
			 - Weighted human disagreement rate (WHDR): 44.2% (δ: 0.1)
- WHDR for equal edges only: 0.5592
- WHDR for inequalities only: 0.2600
- Runtime: 200.8 s
 
- Algorithm: garces2012_clustering- Parameters:  - km k: 8
- remap gamma 2 2: False
 
- Result:
			 - Weighted human disagreement rate (WHDR): 44.2% (δ: 0.1)
- WHDR for equal edges only: 0.4985
- WHDR for inequalities only: 0.3545
- Runtime: 4.6 s
 
- Algorithm: grosse2009_color_retinex- Citation: - Roger Grosse, Micah K. Johnson, Edward H. Adelson, William T. Freeman.  "Ground truth dataset and baseline evaluations for intrinsic image algorithms".   Proceedings of the International Conference on Computer Vision (ICCV)- .   http://www.cs.toronto.edu/~rgrosse/intrinsic/- . 
- Parameters:  - L1: True
- threshold color: 0.7
- threshold gray: 0.5
 
- Result:
			 - Weighted human disagreement rate (WHDR): 46.5% (δ: 0.1)
- WHDR for equal edges only: 0.6045
- WHDR for inequalities only: 0.2485
- Runtime: 215.2 s
 
- Algorithm: baseline_shading- Result:
			 - Weighted human disagreement rate (WHDR): 61.9% (δ: 0.1)
- WHDR for equal edges only: 0.8554
- WHDR for inequalities only: 0.2537
- Runtime: 0.1 s