Skip to main content

Table 1 Mean residual errors for spots with σM' > σM and σM' < σM, using I avg or I min pooling metric.

From: Improving the statistical detection of regulated genes from microarray data using intensity-based variance estimation

 

Agilent Feature Extraction

SPOT Processing

Agilent FG + SPOT BG

 

σM 2' > σM 2

σM 2' < σM 2

σM 2' > σM 2

σM 2' < σM 2

σM 2' > σM 2

σM 2' < σM 2

 

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

Dataset 1

0.28

0.28

0.31

0.31

0.19

0.20

0.22

0.25

0.19

0.20

0.22

0.25

Dataset 2

0.24

0.23

0.25

0.25

0.15

0.15

0.16

0.17

0.15

0.15

0.16

0.17

Dataset 3

0.20

0.18

0.21

0.18

0.09

0.09

0.09

0.09

0.09

0.09

0.09

0.09

Dataset 4 #1

0.15

0.14

0.17

0.15

NA

NA

NA

NA

NA

NA

NA

NA

Dataset 4 #2

0.20

0.17

0.23

0.19

NA

NA

NA

NA

NA

NA

NA

NA

Dataset 4 #3

0.45

0.24

0.49

0.23

NA

NA

NA

NA

NA

NA

NA

NA

Dataset 4 #4

0.21

0.20

0.23

0.21

NA

NA

NA

NA

NA

NA

NA

NA

Dataset 4 #5

0.25

0.19

0.28

0.20

NA

NA

NA

NA

NA

NA

NA

NA

Dataset 4 #6

0.18

0.17

0.21

0.18

NA

NA

NA

NA

NA

NA

NA

NA

  1. Data is given for three datasets using different image processing techniques (Agilent Feature Extraction, SPOT Image Processing and Agilent foreground combined with SPOT background), and for 6 independent three-array subsets of Dataset 4.