Skip to main content

Table 1 Mean residual errors for spots with σM' > σM and σM' < σM, using I avg or I min pooling metric.

From: Improving the statistical detection of regulated genes from microarray data using intensity-based variance estimation

  Agilent Feature Extraction SPOT Processing Agilent FG + SPOT BG
  σM 2' > σM 2 σM 2' < σM 2 σM 2' > σM 2 σM 2' < σM 2 σM 2' > σM 2 σM 2' < σM 2
  Iavg Imin Iavg Imin Iavg Imin Iavg Imin Iavg Imin Iavg Imin
Dataset 1 0.28 0.28 0.31 0.31 0.19 0.20 0.22 0.25 0.19 0.20 0.22 0.25
Dataset 2 0.24 0.23 0.25 0.25 0.15 0.15 0.16 0.17 0.15 0.15 0.16 0.17
Dataset 3 0.20 0.18 0.21 0.18 0.09 0.09 0.09 0.09 0.09 0.09 0.09 0.09
Dataset 4 #1 0.15 0.14 0.17 0.15 NA NA NA NA NA NA NA NA
Dataset 4 #2 0.20 0.17 0.23 0.19 NA NA NA NA NA NA NA NA
Dataset 4 #3 0.45 0.24 0.49 0.23 NA NA NA NA NA NA NA NA
Dataset 4 #4 0.21 0.20 0.23 0.21 NA NA NA NA NA NA NA NA
Dataset 4 #5 0.25 0.19 0.28 0.20 NA NA NA NA NA NA NA NA
Dataset 4 #6 0.18 0.17 0.21 0.18 NA NA NA NA NA NA NA NA
  1. Data is given for three datasets using different image processing techniques (Agilent Feature Extraction, SPOT Image Processing and Agilent foreground combined with SPOT background), and for 6 independent three-array subsets of Dataset 4.