Skip to main content

Table 4 The relationship between the F ST estimates of the WGS and array data

From: Efficiency of different strategies to mitigate ascertainment bias when using SNP panels in diversity studies

 

WGS

 

Slope

R2

Regression constant

Standard error (SE)

Residual variance

Array_all

1.179

0.954

−0.028

0.009

0.0001

Array_MAF5

1.183

0.954

−0.027

0.010

0.0001

GG

1.197

0.959 a

−0.028

0.009

0.0001

GG_MAF5

1.197

0.959 a

−0.028

0.009

0.0001

Pruned

1.023 a

0.937

−0.017

0.010

0.0001

Pruned_MAF5

1.033

0.939

−0.016

0.010

0.0001

Pruned_GG

1.055

0.940

−0.018

0.010

0.0001

Pruned _GG_MAF5

1.057

0.941

−0.017

0.010

0.0001

  1. aNumbers in bold face represent the best value in the column. R2 – regression coefficient. These results are based on 39 populations