Alpha Matting Evaluation Website
www.alphamatting.com
Hide Help
How to use this page?
  1. Please be patient until all images have loaded completely.
  2. Move the mouse over the numbers in the table to see the corresponding images.
  3. Drag the red rectangle in the leftmost image to change the location of the zoom.
  4. Press and hold any key to temporarily deactivate the links.

Image matting evaluation results      Competition:   Low resolution  High resolution  
Error type:  SAD   MSE   Gradient   Connectivity  
Mean Squared Error overall
avg.
small
avg.
large
avg.
user
Troll
(Strongly Transparent)
Input  
Doll
(Strongly Transparent)
Input  
Donkey
(Medium Transparent)
Input  
Elephant
(Medium Transparent)
Input  
Plant
(Little Transparent)
Input  
Pineapple
(Little Transparent)
Input  
Plastic bag
(Highly Transparent)
Input  
Net
(Highly Transparent)
Input  
  rank rank rank rank small large user small large user small large user small large user small large user small large user small large user small large user
TransMatting2.31.92.42.60.2 3 0.2 2 0.2 1 0.1 1 0.1 1 0.2 4 0.1 2 0.1 3 0.1 1 0 2 0 3 0 2 0.2 1 0.3 2 0.4 2 0.1 2 0.1 2 0.1 1 0.8 2 0.8 5 0.9 9 0.5 2 0.4 1 0.4 1
TMFNet42.53.46.10.1 1 0.2 1 0.3 11 0.1 4 0.2 9 0.2 7 0.1 1 0.1 1 0.1 4 0 1 0 2 0.1 7 0.2 3 0.4 6 0.6 7 0.1 3 0.1 3 0.2 5 0.7 1 0.7 1 0.7 1 0.5 6 0.5 4 0.7 7
LFPNet4.142.95.50.2 2 0.2 3 0.3 3 0.2 7 0.1 2 0.2 6 0.1 8 0.1 6 0.1 6 0 3 0 1 0.1 8 0.2 2 0.2 1 0.4 1 0.1 1 0.1 1 0.1 2 0.9 6 1 7 1 15 0.5 3 0.5 2 0.5 3
IamAlpha4.864.540.2 4 0.2 4 0.2 2 0.2 9 0.2 4 0.2 3 0.1 5 0.1 4 0.1 7 0 7 0 5 0 1 0.3 8 0.3 4 0.5 4 0.1 9 0.2 8 0.2 6 0.8 5 0.8 4 0.8 7 0.5 1 0.5 3 0.5 2
TIMI-Net5.575.34.10.3 8 0.3 5 0.3 7 0.1 5 0.2 6 0.2 2 0.1 7 0.1 7 0.1 3 0 9 0 7 0.1 6 0.4 14 0.3 5 0.5 3 0.1 4 0.1 4 0.1 3 0.8 4 0.8 2 0.8 5 0.5 5 0.6 6 0.6 4
SIM6.37.34.86.90.3 9 0.3 6 0.3 6 0.2 12 0.2 8 0.3 14 0.1 3 0.1 2 0.1 2 0 8 0 6 0 3 0.3 9 0.3 3 0.5 5 0.1 7 0.1 5 0.2 4 0.8 3 0.8 3 0.9 8 0.6 7 0.6 5 0.9 13
HDMatt10.312.59.39.10.3 14 0.3 12 0.4 14 0.2 10 0.2 10 0.3 13 0.1 4 0.1 5 0.1 5 0 14 0 11 0 4 0.4 21 0.4 7 0.6 6 0.1 10 0.2 9 0.2 7 0.9 7 0.9 6 0.9 12 0.8 20 0.8 14 0.8 12
PIIAMatting11.36.314.413.30.3 7 0.3 11 0.3 9 0.1 3 0.2 13 0.3 10 0.1 6 0.2 15 0.1 9 0 5 0.1 22 0.2 28 0.3 7 0.6 32 0.8 21 0.1 6 0.1 6 0.3 17 1.1 12 1 8 0.8 6 0.5 4 0.6 8 0.6 6
AdaMatting12.810.511.816.10.3 16 0.4 16 0.4 12 0.2 8 0.2 7 0.3 17 0.2 13 0.2 9 0.2 16 0 4 0 4 0.1 13 0.4 13 0.6 25 1 33 0.1 5 0.2 7 0.3 13 1.1 17 1.2 19 1.1 20 0.6 8 0.6 7 0.6 5
SampleNet Matting13.29.613.516.40.3 6 0.3 7 0.3 5 0.1 2 0.2 3 0.2 5 0.2 17 0.2 16 0.2 15 0 6 0 9 0.1 20 0.4 15 0.6 31 1.2 42 0.1 8 0.3 15 0.3 10 1.1 13 1.1 14 1.2 25 0.7 10 0.8 13 0.8 9
GCA Matting14.514.313.615.60.3 5 0.3 8 0.4 15 0.2 16 0.2 11 0.3 16 0.2 12 0.2 12 0.2 12 0 15 0 10 0.1 5 0.5 29 0.6 30 0.8 13 0.2 14 0.2 11 0.5 30 1 9 1.1 12 1.1 19 0.7 14 0.8 15 0.9 15
A2U Matting14.612.111.8200.3 12 0.3 10 0.4 17 0.2 15 0.2 14 0.3 9 0.2 11 0.2 10 0.1 10 0 11 0 8 0.1 9 0.4 18 0.6 23 0.8 19 0.2 11 0.2 10 0.8 47 1 8 1 9 1 17 0.7 11 0.7 10 1.2 32
ATNet Matting14.916.81413.90.3 11 0.3 13 0.3 4 0.1 6 0.2 5 0.2 1 0.2 18 0.2 14 0.2 19 0.1 29 0.1 18 0.1 14 0.4 27 0.5 19 0.7 11 0.2 12 0.2 12 0.4 21 1.3 22 1.3 22 1.4 33 0.7 9 0.7 9 0.7 8
Context-aware Matting16.72017.812.40.3 15 0.3 15 0.3 10 0.3 29 0.3 21 0.4 19 0.2 14 0.2 13 0.1 11 0 16 0.1 16 0.1 11 0.5 37 0.6 22 0.7 10 0.2 17 0.4 19 0.3 9 1.1 16 1.2 16 0.9 11 0.8 16 0.9 20 0.9 18
VDRN Matting17.419.617.515.10.3 10 0.3 9 0.3 8 0.2 18 0.2 15 0.4 20 0.1 9 0.2 11 0.1 8 0.1 34 0.1 17 0.1 12 0.5 30 0.7 35 0.8 20 0.2 16 0.2 13 0.3 12 1.1 14 1.1 13 1 14 0.9 26 1.1 27 1.1 27
Deep Matting18.116.517.320.60.4 22 0.4 19 0.4 16 0.2 11 0.3 20 0.3 12 0.1 10 0.1 8 0.2 13 0 17 0 13 0.2 27 0.5 32 0.6 33 1 28 0.2 13 0.2 14 0.4 24 1.1 10 1.1 10 1.1 21 0.8 17 0.9 21 1 24
Information-flow matting18.721.51816.60.3 17 0.4 17 0.5 21 0.3 26 0.4 25 0.5 27 0.3 22 0.3 20 0.2 22 0.1 26 0.1 21 0.1 21 0.4 26 0.4 9 0.6 8 0.2 19 0.3 16 0.3 14 1.3 21 1.2 20 0.8 3 0.8 15 0.8 16 0.9 17
DCNN Matting19.220.816.919.90.4 27 0.5 21 0.7 27 0.2 17 0.3 18 0.4 22 0.2 20 0.3 21 0.2 24 0.1 23 0.1 19 0.1 15 0.4 23 0.4 8 0.8 16 0.2 21 0.4 20 0.3 16 1.3 23 1.2 17 1 18 0.7 12 0.7 11 0.9 21
IndexNet Matting2224.420.621.10.5 39 0.6 22 0.5 18 0.2 14 0.2 12 0.3 11 0.2 16 0.3 22 0.2 14 0 12 0 14 0.1 10 0.6 42 0.7 38 1 32 0.3 29 0.3 17 0.4 20 1.1 18 1.2 18 1.1 24 0.9 25 1 22 1.4 40
AlphaGAN23.223.524.521.50.3 13 0.3 14 0.4 13 0.2 13 0.2 16 0.3 8 0.2 15 0.2 17 0.2 17 0 13 0 12 0.1 16 0.6 46 0.9 47 1.1 38 0.3 31 0.5 27 0.4 25 1.3 20 1.3 23 1.2 27 1.1 37 1.4 40 1.1 28
Three-layer graph matting24.421.321.630.30.4 18 0.7 24 0.6 25 0.2 19 0.3 17 0.6 38 0.2 19 0.3 19 0.2 23 0 10 0.1 15 0.2 34 0.4 24 0.4 11 1 34 0.2 24 0.5 29 0.7 43 1.7 38 1.9 41 1.5 35 0.8 18 0.8 17 0.8 10
Three Stages Matting25.723.326.926.90.4 21 0.5 20 0.6 23 0.2 20 0.4 23 0.5 28 0.3 29 0.3 29 0.3 28 0.1 31 0.2 31 0.2 43 0.4 22 0.9 46 1.4 45 0.2 20 0.4 23 0.3 8 1.6 30 1.5 31 1.3 29 0.7 13 0.7 12 0.8 11
LNSP Matting26.324.126.128.50.5 31 1.9 50 1.2 52 0.2 21 0.4 24 0.5 34 0.3 27 0.4 34 0.2 21 0 18 0.1 23 0.2 31 0.4 25 0.5 13 0.8 14 0.2 15 0.3 18 0.4 26 1.4 27 1.2 21 0.8 4 1 29 1.1 26 1.5 46
Patch-based Matting28.123.628.931.90.4 26 1.4 39 0.9 41 0.3 28 0.5 41 0.6 39 0.3 26 0.3 23 0.3 36 0 20 0.2 24 0.1 25 0.3 6 0.5 12 0.8 18 0.2 26 0.6 36 0.5 27 1.3 24 1.4 24 1.6 40 1 33 1.2 32 1.1 29
ATPM Matting29.43431.422.90.6 40 0.8 28 0.5 20 0.3 23 0.3 19 0.5 29 0.4 56 0.5 52 0.3 43 0.1 41 0.2 35 0.2 29 0.6 45 0.7 34 0.8 15 0.3 28 0.4 25 0.4 23 1.1 11 1.1 11 0.8 2 0.9 28 1.9 47 0.9 22
KL-Divergence Based Sparse Sampling29.828.928.6320.4 24 0.9 29 0.7 26 0.3 27 0.5 34 0.5 33 0.3 44 0.4 30 0.3 33 0.1 22 0.2 30 0.1 17 0.4 19 0.4 10 1.2 39 0.4 37 0.6 35 0.6 38 1.7 37 2 43 2.1 50 0.8 21 0.8 18 0.9 20
CCM30.334.13125.60.5 35 1.2 36 0.8 37 0.3 34 0.5 38 0.5 30 0.3 23 0.4 32 0.2 18 0.1 37 0.2 25 0.1 19 0.5 39 0.6 26 0.7 12 0.3 27 0.4 22 0.3 15 1.7 36 1.8 39 1.5 39 1.2 42 1.2 30 1.3 35
SVR Matting30.434.13027.11.1 54 2.7 58 1.2 51 0.4 49 0.4 27 0.4 25 0.3 40 0.3 26 0.2 20 0.1 25 0.2 29 0.2 37 0.3 11 0.5 18 0.7 9 0.2 23 0.4 24 0.3 18 1.4 26 1.4 25 0.9 13 1.3 45 1.2 33 1.5 44
Graph-based sparse matting30.731.33129.90.5 37 1.5 42 0.8 30 0.3 25 0.3 22 0.3 18 0.3 37 0.4 37 0.3 30 0 19 0.2 26 0.1 24 0.5 31 0.5 15 0.9 23 0.2 22 0.6 32 0.5 29 2.2 48 2.4 50 1.9 48 1 31 1.1 24 1.3 37
Comprehensive sampling31.429.431.833.10.4 25 1.2 37 0.8 31 0.3 38 0.6 43 0.6 48 0.3 39 0.3 25 0.3 38 0.1 27 0.2 27 0.1 22 0.2 4 0.5 20 0.9 25 0.3 34 0.9 41 0.5 31 1.6 33 1.5 27 1.5 34 1 35 1.2 34 1.3 36
TSPS-RV Matting31.632.328.434.10.4 20 0.8 26 0.5 22 0.3 31 0.4 28 0.6 44 0.3 35 0.3 28 0.3 32 0 21 0.1 20 0.3 51 0.8 51 0.6 24 1 31 0.5 45 0.6 33 0.8 48 1.6 32 1.6 32 1.4 31 0.8 23 1.3 36 0.9 14
Comprehensive Weighted Color and Texture32.230.634.831.10.7 46 0.8 27 0.8 38 0.4 45 0.7 47 0.5 32 0.3 24 0.3 24 0.2 27 0.1 24 0.2 33 0.1 18 0.3 5 0.7 36 1 35 0.2 18 0.4 21 0.3 11 2.2 49 2.1 46 1.7 45 1 34 1.7 44 1.4 43
CSC Matting34.137.82836.50.6 43 0.8 25 0.7 28 0.3 37 0.4 26 0.7 49 0.4 48 0.4 33 0.4 53 0.1 46 0.2 32 0.2 47 0.4 16 0.5 14 0.8 17 0.3 33 0.5 26 0.6 37 1.7 35 1.5 29 1.3 30 1.2 44 1.3 39 1.2 31
LocalSamplingAndKnnClassification34.536.133.134.40.5 32 0.7 23 0.5 19 0.3 22 0.4 29 0.5 36 0.3 25 0.3 27 0.2 26 0.1 30 0.2 36 0.2 36 0.9 53 1 48 1.7 50 0.6 49 1 45 0.9 49 1.8 39 1.5 28 1.2 26 1.1 39 1.2 29 1.2 33
Sparse coded matting34.736.936.330.90.6 45 2.7 57 0.8 36 0.3 36 0.4 32 0.3 15 0.3 45 0.4 42 0.3 41 0.1 36 0.2 28 0.1 23 0.4 12 0.5 16 0.9 22 0.2 25 0.5 28 0.3 19 2.3 50 2.6 52 2.1 49 1.3 46 1.3 35 1.4 42
Global Sampling Matting36.332.439.536.90.4 23 2.3 53 0.9 40 0.3 32 0.6 42 0.6 46 0.3 31 0.4 46 0.3 29 0.1 32 0.3 42 0.2 40 0.5 34 0.6 21 1 29 0.4 39 1 44 0.7 41 1.9 41 2 45 1.7 44 0.9 27 1 23 1.1 26
Weighted Color and Texture Matting36.434.437.637.10.5 36 0.9 30 0.8 29 0.4 41 0.6 44 0.6 45 0.3 21 0.3 18 0.2 25 0.1 40 0.5 51 0.2 45 0.5 33 0.8 40 1.5 47 0.3 30 0.5 30 0.5 28 1.6 31 1.6 34 1.5 37 1.2 43 2.6 54 1.4 41
Iterative Transductive Matting37.138.535.637.10.6 41 0.9 31 0.8 35 0.3 30 0.7 45 0.6 43 0.4 50 0.4 36 0.3 37 0.1 42 0.5 53 0.2 42 0.6 41 0.6 29 1.4 46 0.4 43 0.8 39 0.7 40 1.9 42 1.6 33 1.5 38 0.8 19 0.9 19 0.9 16
LNCLM matting37.139.636.635.10.4 19 0.4 18 0.9 42 0.4 44 0.5 37 0.4 21 0.4 55 0.6 56 0.3 42 0.1 51 0.3 40 0.2 46 0.6 48 0.8 39 1.1 36 0.4 36 0.9 43 0.5 32 1.8 40 1.6 35 1.1 23 0.8 24 1.1 25 1.3 39
KNN Matting37.540.838.633.10.8 49 1 33 0.8 33 0.4 43 0.5 40 0.5 26 0.4 49 0.5 49 0.3 51 0.1 47 0.3 43 0.2 48 0.7 50 0.9 45 0.9 27 0.3 32 0.5 31 0.4 22 1.1 15 1.1 15 0.9 10 1.2 41 2.3 53 1.6 48
Shared Matting37.536.340.835.60.5 28 1.6 44 0.9 39 0.5 51 0.9 52 0.5 37 0.3 28 0.4 31 0.3 40 0.1 43 0.4 46 0.2 33 0.4 20 0.6 28 0.9 24 0.4 35 0.6 34 0.5 33 2.9 55 2.8 54 2.7 54 1 30 1.3 37 1 25
Segmentation-based matting40.441.139.840.40.5 38 2.2 51 1.1 46 0.3 39 0.4 30 0.4 23 0.3 36 0.4 44 0.3 34 0.1 28 0.2 34 0.2 26 0.6 43 0.5 17 1.2 43 0.4 42 0.7 37 0.8 46 2.7 53 3.3 57 3.6 56 1.4 50 1.9 48 1.6 49
Improved color matting40.842.341.938.30.8 51 2.4 54 1.5 55 0.3 35 0.5 36 0.5 35 0.3 30 0.4 45 0.3 31 0.1 44 0.3 41 0.2 38 0.7 49 0.7 37 0.9 26 0.4 38 0.7 38 0.7 42 2 44 1.9 42 1.4 32 1.3 47 1.5 42 1.5 47
Improving Sampling Criterion41.639.843.941.30.5 29 1.3 38 0.8 32 0.6 54 1 53 0.7 51 0.3 42 0.5 53 0.3 49 0.3 59 0.8 58 0.4 58 0.5 36 0.9 44 1.2 40 0.6 51 1.1 47 0.8 45 1.4 25 1.5 30 1.5 36 0.8 22 1.1 28 0.9 19
SRLO Matting42.5424441.60.7 48 1 32 1 43 0.4 47 0.8 51 0.7 50 0.4 47 0.4 39 0.3 50 0.1 48 0.6 54 0.2 41 0.4 28 0.8 41 1.5 48 0.4 41 1 46 0.6 36 2 45 2.3 48 1.7 42 1 32 1.4 41 1 23
Learning Based Matting43.744.444.442.40.8 52 1.6 43 1.3 53 0.4 46 0.4 33 0.5 31 0.3 38 0.4 43 0.3 39 0.1 39 0.2 37 0.2 32 0.5 40 1.2 51 2 52 0.9 57 1.7 56 2 58 1.6 29 1.7 37 1 16 2.2 54 2.7 55 4.2 58
Local Spline Regression (LSR)4444.642.944.40.5 30 1.5 40 1 44 0.3 33 0.5 39 0.6 41 0.4 46 0.4 48 0.3 44 0.1 38 0.3 39 0.2 39 1.2 57 1.3 55 2.2 54 0.8 55 1.1 48 1.1 51 2.1 47 1.7 36 1.3 28 1.5 51 1.3 38 3 54
SPS matting44.541.549.842.10.5 33 1.6 45 0.6 24 0.7 55 1.1 55 0.7 52 0.4 54 0.6 57 0.4 54 0.2 57 0.9 59 0.3 52 0.4 17 0.8 43 1.2 41 0.5 46 1.2 50 0.6 35 1.7 34 2 44 1.7 41 1.1 36 1.7 45 1.3 38
Global Sampling Matting (filter version)44.54245.945.80.6 42 2.4 55 1.1 47 0.5 50 0.7 48 0.7 54 0.4 52 0.5 51 0.4 55 0.2 52 0.4 45 0.3 54 0.3 10 0.6 27 1 30 0.5 47 1.2 51 0.8 44 2 43 2.2 47 2.4 52 1.2 40 1.5 43 1.1 30
Closed-Form Matting44.642.344.347.30.5 34 1.8 49 1.1 48 0.3 24 0.4 31 0.6 40 0.3 33 0.4 41 0.3 35 0.1 33 0.3 38 0.2 35 1.2 56 1.4 56 2.3 57 0.8 54 1.6 55 1.6 56 3 56 2.7 53 1.9 47 1.3 48 1.2 31 5 60
LMSPIR44.944.545.544.80.8 50 1.1 34 1.2 49 0.4 42 0.8 50 0.6 47 0.3 43 0.4 35 0.3 46 0.1 45 0.5 50 0.2 44 0.6 47 1.2 54 2 53 0.4 40 0.9 42 0.6 34 2.3 51 2.3 49 2.2 51 1.1 38 2 50 1.2 34
Shared Matting (Real Time)4746.847.546.90.6 44 1.7 48 1 45 0.7 57 1.2 56 0.8 56 0.3 34 0.4 38 0.3 48 0.2 54 0.6 55 0.2 50 0.5 35 0.8 42 1.1 37 0.4 44 0.8 40 0.6 39 3 57 3 55 3 55 1.3 49 1.9 46 1.5 45
Large Kernel Matting48.250.647.846.31.2 56 1.6 46 1.7 56 0.3 40 0.5 35 0.4 24 0.4 51 0.5 50 0.3 52 0.1 49 0.5 52 0.2 49 0.9 54 1.1 50 1.4 44 0.6 50 1.1 49 1 50 2.7 52 2.4 51 1.7 43 2.1 53 2 49 2.8 52
Robust Matting49.645.350.852.91.1 55 2.8 59 1.7 57 0.7 56 1.5 57 0.9 57 0.3 32 0.4 47 0.3 45 0.1 50 0.5 48 0.3 53 0.5 38 1.2 52 1.9 51 0.5 48 1.5 54 1.2 54 1.5 28 1.8 38 2.6 53 2.4 55 2.3 51 2.9 53
Cell-based matting Laplacian49.85248.848.80.7 47 1.7 47 0.8 34 0.4 48 0.8 49 0.6 42 0.5 57 0.5 54 0.4 59 0.2 58 0.5 47 0.3 56 0.8 52 1 49 1.5 49 0.8 56 1.3 52 1.2 53 2 46 1.8 40 1.8 46 1.9 52 2.3 52 2.4 51
Transfusive Weights51.351.949.352.91.3 57 1.5 41 1.3 54 0.5 53 0.7 46 0.7 53 0.4 53 0.6 55 0.4 57 0.2 55 0.5 49 0.3 57 1.6 59 2 58 3.9 59 1.5 59 2.2 59 2.2 60 1.2 19 1.4 26 1.1 22 4.4 60 4.9 60 5.9 61
High-res matting51.549.553.851.31.3 58 2.2 52 2.2 58 0.5 52 1.1 54 0.8 55 0.3 41 0.4 40 0.3 47 0.1 35 0.7 56 0.2 30 0.6 44 1.2 53 2.2 55 0.8 52 2 58 1.4 55 3.2 58 3.4 59 4.2 60 2.6 56 4.3 58 2.2 50
Random Walk Matting57.459.35557.91 53 1.1 35 1.2 50 1 58 1.7 58 1.1 58 0.5 60 0.6 58 0.6 60 0.2 56 0.4 44 0.3 55 2 63 3.4 61 4.2 61 1.6 61 2.3 60 2.1 59