Alpha Matting Evaluation Website
www.alphamatting.com
Hide Help
How to use this page?
  1. Please be patient until all images have loaded completely.
  2. Move the mouse over the numbers in the table to see the corresponding images.
  3. Drag the red rectangle in the leftmost image to change the location of the zoom.
  4. Press and hold any key to temporarily deactivate the links.

Image matting evaluation results      Competition:   Low resolution  High resolution  
Error type:  SAD   MSE   Gradient   Connectivity  
Sum of Absolute Differences overall
avg.
small
avg.
large
avg.
user
Troll
(Strongly Transparent)
Input  
Doll
(Strongly Transparent)
Input  
Donkey
(Medium Transparent)
Input  
Elephant
(Medium Transparent)
Input  
Plant
(Little Transparent)
Input  
Pineapple
(Little Transparent)
Input  
Plastic bag
(Highly Transparent)
Input  
Net
(Highly Transparent)
Input  
  rank rank rank rank small large user small large user small large user small large user small large user small large user small large user small large user
SIM2.72.923.38.3 1 8.7 1 9 1 4.8 10 4.8 7 6 9 2.2 1 2.2 1 2 1 0.9 5 0.9 2 1.1 1 4.7 2 5.1 1 6.3 2 2.2 1 2.3 1 2.5 1 15.9 1 16.3 1 16.3 5 17.8 2 18 2 20.9 6
PIIAMatting5.33.175.99.1 5 10 7 9.3 3 4.3 2 4.6 2 5.4 3 2.8 4 3.7 11 2.7 4 0.9 2 2.3 16 2 11 4.7 3 6.8 7 8.3 7 2.2 3 2.7 4 4.3 13 17.2 5 17.3 5 15.5 1 16.6 1 19.1 4 20.2 5
IamAlpha5.34.64.56.910.4 13 10.5 9 10.8 11 4.4 3 4.4 1 6.1 10 2.7 2 3 4 3.2 10 0.9 3 1.7 10 1.7 5 4.8 4 5.2 2 6.2 1 2.5 7 3.3 7 3.3 4 16.2 2 16.9 2 17.9 13 17.8 3 18 1 18 1
HDMatt6.68.45.16.39.5 7 10 5 10.7 10 4.7 6 4.8 5 5.8 7 2.9 7 3 3 2.6 2 1.1 10 1.2 7 1.3 2 5.2 7 5.9 3 6.7 3 2.4 4 2.6 2 3.1 2 17.3 7 17.3 3 17 9 21.5 19 22.4 13 23.2 15
AdaMatting8.57.47.510.610.2 11 11.1 13 10.8 12 4.9 12 5.4 11 6.6 14 3.6 13 3.4 7 3.4 16 0.9 1 0.9 1 1.8 6 4.7 1 6.8 5 9.3 15 2.2 2 2.6 3 3.3 3 19.2 15 19.8 17 18.7 17 17.8 4 19.1 3 18.6 2
Background Matting8.66.46.4139.3 6 10 6 10.1 7 4.5 5 5.1 9 6.7 15 2.9 6 3.3 5 2.9 6 1 8 1.2 6 2.2 17 5.2 6 6 4 7.8 5 2.8 10 3.4 9 4.3 12 16.4 3 17.3 4 16.4 6 19.5 7 20.9 8 27.9 36
SampleNet Matting8.878.311.39.1 4 9.7 4 9.8 6 4.3 1 4.8 4 5.1 2 3.4 12 3.7 12 3.2 13 0.9 4 1.1 4 2 9 5.1 5 6.8 6 9.7 18 2.5 6 4 13 3.7 6 18.6 14 19.3 14 19.1 20 20 10 21.6 9 23.2 16
GCA Matting9.910.9711.98.8 2 9.5 3 11.1 14 4.9 11 4.8 6 5.8 8 3.4 11 3.7 9 3.2 12 1.1 13 1.2 5 1.3 3 5.7 14 6.9 8 7.6 4 2.8 9 3.1 5 4.5 16 18.3 11 19.2 10 18.5 15 20.8 16 21.7 10 24.7 23
FE2E High-Quality Matting10.69.511.810.610.1 10 11.1 11 9.3 4 5.5 17 6.4 15 6.9 17 3.4 10 3.7 10 3.2 11 1 7 1.7 11 1.9 7 5.7 13 7.8 17 11 23 2.5 5 3.8 11 3.8 7 17.3 6 18.4 8 17.4 12 19.6 8 21.8 11 20.2 4
ATNet Matting11.312.89.811.39.7 9 10.2 8 9.6 5 4.5 4 4.8 3 4.4 1 3.7 14 3.9 13 3.4 17 1.7 23 1.9 13 2.2 15 5.9 19 7 10 9.3 14 2.9 11 3.3 8 3.9 9 19.8 17 20.6 18 20.7 26 19 5 19.2 5 20.1 3
VDRN Matting11.313.311.39.48.9 3 9.4 2 9.3 2 5.2 14 5.6 13 6.6 13 2.8 5 3.3 6 2.7 3 1.8 26 1.9 14 2 8 5.7 12 7.1 11 8.3 6 3 12 3.5 10 3.6 5 17.6 8 18.3 7 16.9 8 23.2 26 25.9 27 26.5 30
Deep Matting11.613.110.81110.7 15 11.2 15 11 13 4.8 9 5.8 14 5.6 5 2.8 3 2.9 2 2.9 5 1.1 9 1.1 3 2 10 6 24 7.1 12 8.9 10 2.7 8 3.2 6 3.9 8 19.2 16 19.6 16 18.7 16 21.8 21 23.9 18 24.1 21
Information-flow matting1415.114.612.110.3 12 11.2 14 12.5 17 5.6 21 7.3 19 7.3 20 3.8 15 4.1 15 3 8 1.4 14 2.3 15 2 13 5.9 21 7.1 13 8.6 8 3.6 16 5.7 16 4.6 17 18.3 10 19.3 13 15.8 3 20.2 12 22.2 12 22.3 11
IndexNet Matting14.917.513.613.612.6 31 13.4 17 11.4 15 4.8 8 4.9 8 5.7 6 3.3 9 4 14 3 7 1.1 11 1.5 9 1.6 4 6.4 28 7.5 16 8.9 11 3.4 13 4 12 4.1 10 18.6 13 19.1 9 18.5 14 23.4 27 25.1 24 29.3 42
DCNN Matting1617.914.116.112 25 14.1 19 14.5 23 5.3 15 6.4 16 6.8 16 3.9 17 4.5 17 3.4 15 1.6 20 2.5 17 2.2 18 6 23 6.9 9 9.1 12 4 19 6 17 5.3 19 19.9 18 19.2 12 19.1 19 19.4 6 20 6 21.2 7
AlphaGAN16.517.516.815.39.6 8 10.7 10 10.4 9 4.7 7 5.3 10 5.4 4 3.1 8 3.7 8 3.1 9 1.1 12 1.3 8 2 12 6.4 30 8.3 25 9.3 16 3.6 15 5 14 4.3 14 20.8 19 21.5 20 20.6 25 25.7 41 28.7 39 26.7 33
Context-aware Matting1923171710.4 14 11.1 12 10.1 8 6.4 31 7.4 22 7.1 18 4.1 18 4.5 18 3.8 23 2.3 41 3.1 19 3 34 7.1 37 8.2 23 9.1 13 3.5 14 5.5 15 4.1 11 18.3 12 19.2 11 16.5 7 21.1 17 23.3 16 24.6 22
Three-layer graph matting21.117.118.827.510.7 16 15.2 20 13.8 20 4.9 13 5.6 12 8.1 32 3.9 16 4.4 16 3.6 20 1 6 1.8 12 3 32 5.9 18 7.3 15 12.4 32 4.2 22 8 24 8.5 41 24.2 33 25.6 34 24.2 34 20.5 13 23.5 17 22.2 9
ATPM Matting23.526.825.917.814 42 17.8 27 13.4 18 5.5 16 6.4 17 7.3 21 5.4 49 6.4 44 4.3 37 1.7 24 3.3 24 2.3 21 6.8 34 8 20 8.7 9 4.2 20 7.5 21 5.5 20 17.2 4 17.6 6 15.7 2 22.6 25 37.3 48 22.8 14
Three Stages Matting24.524.124.624.911.7 24 13.9 18 13.9 21 5.6 18 7.4 21 7.9 26 4.6 30 5.5 31 4.2 32 2.2 37 4 31 3.1 37 6.5 31 11 42 11.9 27 4 17 6.5 18 4.5 15 23.3 27 23.2 29 22.3 29 19.6 9 20.8 7 22.4 12
CSC Matting2629.422.126.413.6 39 15.6 21 14.5 22 6.2 29 7.5 23 8.1 33 4.6 31 4.8 20 4.2 35 1.8 28 2.7 18 2.5 23 5.5 11 7.3 14 9.7 17 4.6 26 7.6 22 6.9 29 23.7 29 23 27 21 27 26.3 42 27.2 32 25.2 25
LNSP Matting2622.426.529.112.2 26 22.5 45 19.5 50 5.6 19 8.1 25 8.8 42 4.6 28 5.9 36 3.6 19 1.5 17 3.5 27 3.1 36 6.2 25 8.1 22 10.7 22 4 18 7.1 19 6.4 25 21.5 22 20.8 19 16.3 4 22.5 24 24.4 19 27.8 35
Graph-based sparse matting2727.527.825.612.6 32 20.5 37 14.8 27 5.7 23 7.3 18 6.4 12 4.5 26 5.3 27 3.7 21 1.4 16 3.3 25 2.3 20 6.3 27 7.9 18 11.1 24 4.2 21 8.3 27 6.4 24 28.7 46 31.3 47 27.1 43 23.6 29 25.1 23 27.3 34
KL-Divergence Based Sparse Sampling27.325.627.328.911.6 23 17.5 26 14.7 24 5.6 20 8.5 30 8 28 4.9 42 5.3 25 3.7 22 1.5 18 3.5 26 2.1 14 5.8 16 8.3 24 14.1 40 5.6 37 9.3 32 8 37 24.6 34 27.7 41 28.9 46 20.7 15 22.7 14 23.9 20
Patch-based Matting27.321.429.530.910.9 18 19 31 15.7 33 6 26 9.5 39 8.3 35 4.3 22 5.2 24 4.2 34 1.6 19 3.2 22 2.6 24 5.2 8 9 30 12.4 29 4.7 27 9.7 34 7 30 21.6 23 21.7 21 24.9 36 23.5 28 28.1 35 25.6 26
TSPS-RV Matting28.626.828.530.611.3 22 16.4 24 13.7 19 6.1 27 8.1 27 8.6 39 4.5 24 5.4 29 4.1 31 1.4 15 3.3 23 3.5 46 7.9 45 8.9 28 12.4 31 6.2 41 9 30 8.7 43 22.8 26 23.5 30 21.4 28 20.7 14 28.5 37 22.2 8
Iterative Transductive Matting29.330.429.528.113.1 36 17.2 25 15.6 32 5.7 22 8.6 32 7.8 25 5.1 45 5.5 30 3.9 24 1.9 29 5.8 42 2.6 25 6.6 32 8.5 26 13.8 39 5.4 32 10 35 7.4 34 25.5 36 24 31 23.8 33 20.1 11 22.7 15 22.7 13
Comprehensive sampling29.826.430.332.611.2 21 18.5 30 14.8 25 6.5 35 9.5 38 8.9 44 4.5 25 4.9 21 4.1 30 1.7 22 3.1 21 2.3 22 5.4 10 9.8 34 13.4 37 5.5 35 11.5 41 7.4 36 23.9 31 22 23 22.8 30 23.8 32 28 34 28.1 37
SVR Matting29.832.630.326.518.7 54 30.7 56 19.1 47 6.8 41 7.7 24 7.6 24 4.7 37 5 23 3.4 14 1.9 30 4.7 34 2.9 30 5.8 15 8.7 27 10.5 19 4.3 23 8 25 5.6 22 21.2 21 22.1 24 17.1 11 25.6 40 26.1 29 30.6 45
Comprehensive Weighted Color and Texture30.329.631.629.614.6 43 16 22 15.7 34 6.8 40 10 42 7.9 27 4.3 21 5 22 4.1 28 1.7 21 3.5 28 2.2 16 5.4 9 9.9 36 12.8 35 4.3 24 7.4 20 5.2 18 28.3 45 28.1 42 25.4 39 24 34 30.2 41 28.7 40
Sparse coded matting30.83431.626.613.7 40 25.8 52 14.8 28 6.4 32 8.2 28 6.2 11 4.7 32 5.4 28 4 26 1.8 27 3.1 20 2.3 19 5.9 20 8 21 10.6 20 4.5 25 8 23 5.5 21 30.3 48 33.1 50 29.2 47 27.7 48 27.2 31 29 41
LocalSamplingAndKnnClassification32.334.930.431.812.6 30 16 23 12.4 16 5.8 24 8.1 26 8 29 4.5 27 5.5 32 4.1 27 2.2 38 5.1 37 3.4 44 8.1 46 10.5 38 15.6 45 7.3 45 12.3 44 9.4 44 24.1 32 21.8 22 19.7 21 24.7 37 24.8 21 25.9 28
Weighted Color and Texture Matting3330.535.333.313.1 37 17.8 28 15.8 35 6.5 34 9.4 36 8.6 38 4.2 20 4.7 19 3.9 25 1.7 25 6 43 2.7 26 6.4 29 11 41 16.3 46 4.8 28 9.1 31 6.5 26 23.7 28 24.8 33 23.2 31 26.5 43 40.2 51 28.5 39
CCM33.336.433.330.413.8 41 20.8 38 16.9 43 6.4 33 8.9 34 8.2 34 4.7 33 5.9 37 3.6 18 2.5 43 4.3 32 3 31 7 36 9 29 10.6 21 4.9 29 8.1 26 5.7 23 25.6 37 27.5 40 24.5 35 25.4 39 26.4 30 28.2 38
LNCLM matting33.435.933.331.110.9 19 11.2 16 16.7 41 6.9 43 8.9 35 7.2 19 5.6 51 7 52 4.1 29 2.5 45 5.1 38 3.5 47 7.5 40 10 37 12 28 5.5 36 11.3 38 7.3 33 25.2 35 23 28 19.9 23 21.2 18 25 22 26.4 29
Shared Matting33.531.637.131.610.8 17 20.5 36 15 29 7.8 47 11.6 48 8.1 30 4.2 19 5.3 26 4.2 33 2.1 32 5.8 41 2.9 29 5.9 22 9.2 31 11.4 26 5 30 8.8 28 6.8 28 34.9 53 34.9 51 34.3 51 23.9 33 28.4 36 25.7 27
Global Sampling Matting35.932.538.636.510.9 20 22.7 46 15.4 30 6.3 30 9.5 40 9 45 4.7 34 6.4 46 4.3 39 2.2 39 5.6 40 3.4 43 6.9 35 9.6 33 12.9 36 6.3 42 12.5 45 8.6 42 25.8 38 27.5 39 25.3 38 22 22 24.4 20 23.7 19
SRLO Matting36.835.439.435.814.7 44 18 29 17.7 45 6.9 42 10.7 44 8.9 43 4.9 43 5.7 34 4.7 47 2.1 34 6.5 44 2.8 28 6.3 26 10.9 40 15.2 44 5.4 31 11.6 42 7 32 26.5 43 29.7 44 25.1 37 21.7 20 28.5 38 22.3 10
Segmentation-based matting37.137.936.337.312.8 35 23.5 48 16.6 40 6.6 36 8.3 29 7.3 22 4.8 41 6.1 40 4.3 40 2.1 33 3.9 30 3.1 35 6.7 33 8 19 13.4 38 6 40 8.8 29 8.2 38 31.6 49 35.6 52 38.8 53 24.5 36 32 43 26.7 32
Improved color matting38.338.537.638.814.9 45 24.5 50 20 51 6.7 38 9.5 37 8.5 37 4.6 29 6.1 41 4.3 41 2.6 47 5.4 39 3.4 45 7.5 41 9.9 35 12.5 33 6 38 10.1 36 8.4 40 26.1 39 26.7 38 23.6 32 23.8 31 25.6 25 26.7 31
Local Spline Regression (LSR)38.740.935.439.912.2 27 20 34 16.2 36 6.1 28 8.8 33 8.1 31 5.2 47 6.2 43 4.6 44 2.2 40 4.9 36 3.1 38 9.4 51 11.9 45 18.3 49 8.2 48 11.4 39 10.1 46 26.4 41 22.5 25 20.2 24 27 45 26 28 39.8 51
KNN Matting38.740.640.435.116.2 49 19.7 32 16.8 42 8 48 11 45 9 47 4.7 35 6.7 49 4.3 36 3 50 7.7 50 3.7 48 9.2 49 11.3 43 11.3 25 6 39 10.4 37 6.7 27 18.1 9 19.6 15 17 10 27.4 46 41 52 32.7 46
Global Sampling Matting (filter version)38.936.641.638.512.3 28 24.3 49 16.3 37 7.3 45 10.2 43 9.5 48 5.1 46 6.4 45 4.7 48 2.4 42 4.7 35 3.2 40 5.9 17 9.5 32 12.4 30 6.5 43 13.1 46 8.3 39 26.5 42 28.3 43 30 49 23.6 30 29.1 40 23.5 17
Learning Based Matting40.140.639.340.416 48 22 44 18.7 46 6.6 37 7.4 20 7.4 23 4.8 39 6.1 39 4.3 42 2.1 31 3.7 29 2.8 27 7.5 42 14.5 51 19.5 52 8.6 52 14.1 49 14.6 54 22.5 24 24.8 32 19.9 22 34.6 52 38.5 50 51.2 57
LMSPIR41.240.142.940.515.2 47 20 33 19.1 48 6.7 39 11.2 46 8.7 41 4.8 40 5.8 35 4.6 46 2.1 35 6.8 47 3 33 7.9 44 14.3 50 20.2 53 5.5 34 11.4 40 7 31 29.7 47 31 46 29.6 48 24 35 34.2 46 25 24
Shared Matting (Real Time)41.640.342.54212.4 29 21.6 40 16.3 38 9.5 51 13.5 50 9.9 49 4.4 23 5.6 33 4.4 43 2.5 46 6.8 48 3.2 41 7.1 38 10.8 39 12.6 34 5.4 33 9.7 33 7.4 35 35.5 55 35.8 53 35.5 52 27.6 47 33.4 44 29.8 44
Closed-Form Matting4240.639.645.912.7 33 21.9 43 17.2 44 5.9 25 8.5 31 8.6 40 4.7 36 6 38 4.3 38 2.2 36 4.6 33 3.3 42 9.3 50 12.1 46 19.3 51 8.3 49 14.9 51 13.4 53 34.2 52 32.4 49 27.4 44 26.5 44 25.7 26 48.3 55
Improving Sampling Criterion45.844.947.544.912.7 34 21.1 39 16.4 39 11.5 54 17 55 12.1 54 5.8 53 8.1 55 5.7 53 5.4 58 12.1 57 6.6 57 9.6 53 15.7 52 17.8 47 10.2 54 17 52 11.2 51 23.8 30 26.7 37 25.9 40 22.2 23 27.3 33 23.7 18
Cell-based matting Laplacian46.348.44545.415.1 46 21.7 41 15.6 31 7.6 46 11.4 47 9 46 5.7 52 6.7 50 5.2 51 3.1 51 6.7 45 4.5 51 8.6 47 11.4 44 14.9 42 8.5 51 13.5 48 11.1 49 27.7 44 26.2 36 27.6 45 32.4 50 37.6 49 37.9 48
Large Kernel Matting46.548.145.945.517.2 50 21.8 42 20.7 52 7.2 44 9.6 41 8.4 36 5.3 48 6.6 48 4.6 45 2.9 49 8.2 52 4.2 49 8.6 48 12.1 47 14.7 41 8 47 13.4 47 11.2 50 33 50 31.8 48 26.1 41 32.1 49 32 42 38.4 50
Robust Matting47.243.548.15017.3 51 28.4 54 21.1 53 10.1 52 16.9 54 11.4 52 4.8 38 6.5 47 5 50 2.8 48 7.3 49 4.4 50 7.3 39 14 49 18.1 48 6.8 44 14.6 50 10.6 48 22.7 25 26.1 35 32.1 50 34.4 51 37 47 38 49
SPS matting49.348.652.346.913.4 38 23 47 14.8 26 12.5 55 18.5 56 12.4 55 6.6 57 9.4 58 6.5 58 4.5 56 12.7 58 5.4 54 9.5 52 16.4 54 18.6 50 9.8 53 18.1 55 10.6 47 26.1 40 30.9 45 26.2 42 25 38 33.5 45 29.5 43
High-res matting50.248.851.550.418.6 53 25.8 51 24.6 55 8.6 49 14.1 51 11.1 51 5 44 6.2 42 4.8 49 2.5 44 8.3 53 3.2 39 7.8 43 14 48 21.4 54 8.5 50 18.1 56 12.2 52 35.3 54 38.1 55 42.6 56 38.7 53 54.6 56 36.8 47
Transfusive Weights50.750.850.550.923.2 55 26.7 53 22.4 54 9.2 50 11.9 49 10.4 50 6.1 55 8.1 54 5.9 55 3.8 54 8 51 5.3 53 12.9 56 21.4 56 37.6 60 13.1 59 22.8 58 18.3 59 20.9 20 22.9 26 19 18 59.5 57 65.7 57 72.8 58
Random Walk Matting53.955.551.554.817.9 52 20.3 35 19.4 49 11.3 53 15.6 52 11.8 53 5.8 54 7 51 6.3 57 3.4 52 6.7 46 4.6 52 13.1 58 22.1 57 27.4 56 12.3 58 18 54 15.7 57 44.1 59 43.5 58 41 55 75.1 58 81.8 59 80.6 59
Geodesic Matting55.15654.954.526.9 58 38.5 59 32.5 58 14.2 56 16.5 53 17.4 57 11.7 60 14 61 9.4 60 7.6 60 15.1 59 8.7 60 12.8 55 16.7 55 15.1 43 7.3 46 12.1 43 9.8 45 37.3 57 37.4 54 42.8 57 48.6 56 50 55 48.6 56
Iterative BP Matting56.255.556.15723.6 56 29.9 55 27.2 56 16.7 57 24.3 58 20.7 60 6.7 58 9 56 6.3 56 3.8 53 11.3 55 6.8 59 14.1 59 22.8 58 27.9 57 11.4 56 19 57 14.7 55 33.4 51 39.3 56 47.5 60 40.6 54 48.1 54 45.1 53
Easy Matting56.6575656.923.9 57 32.6 57 30 57 17.1 58 21.8 57 19.4 59 6.3 56 7.5 53 5.8 54 4.7 57 10.5 54 5.6 55 12.1 54 15.7 53 22.9 55 11.2 55