Skip to main content

Table 4 Correlation coefficients between the five methods in three marker selection sets in the Vis Island dataset

From: Comparative assessment of methods for estimating individual genome-wide homozygosity-by-descent from human genomic data

  

MLH

FPLINK

FADC

FEstimSPT

FEstim

Full marker set

MLH

1.00

-1.00

-1.00

-0.67

*

 

FPLINK

-1.00

1.00

0.99

0.67

*

 

FADC

-1.00

0.99

1.00

0.66

*

 

FEstimSPT

-0.67

0.67

0.66

1.00

*

 

FEstim

*

*

*

*

*

M0.1

MLH

1.00

-1.00

-0.99

-0.71

-0.54

 

FPLINK

-1.00

1.00

0.99

0.74

0.60

 

FADC

-0.99

0.99

1.00

0.78

0.63

 

FEstimSPT

-0.71

0.74

0.78

1.00

0.55

 

FEstim

-0.54

0.60

0.63

0.55

1.00

M0.05

MLH

1.00

-1.00

-0.99

-0.73

-0.64

 

FPLINK

-1.00

1.00

0.99

0.73

0.64

 

FADC

-0.99

0.99

1.00

0.75

0.64

 

FEstimSPT

-0.73

0.73

0.75

1.00

0.51

 

FEstim

-0.64

0.64

0.64

0.51

1.00

  1. All correlations were significant at the level of P < 0.001
  2. All FPLINK and FADC values that were negative were set to zero in these correlations, in order to allow comparisons across different methods since FEstim does not provide negative values
  3. *FEstim was not calculated for the full marker set due to LD