# Extracting regulatory modules from gene expression data by sequential pattern mining

- Mingoo Kim†
^{1}, - Hyunjung Shin†
^{2}, - Tae Su Chung
^{1}, - Je-Gun Joung
^{1, 3, 4}and - Ju Han Kim
^{1, 3, 5}Email author

**12(Suppl 3)**:S5

https://doi.org/10.1186/1471-2164-12-S3-S5

© Kim et al; licensee BioMed Central Ltd. 2011

**Published: **30 November 2011

## Abstract

### Background

Identifying a regulatory module (RM), a bi-set of co-regulated genes and co-regulating conditions (or samples), has been an important challenge in functional genomics and bioinformatics. Given a microarray gene-expression matrix, biclustering has been the most common method for extracting RMs. Among biclustering methods, order-preserving biclustering by a sequential pattern mining technique has native advantage over the conventional biclustering approaches since it preserves the order of genes (or conditions) according to the magnitude of the expression value. However, previous sequential pattern mining-based biclustering has several weak points in that they can easily be computationally intractable in the real-size of microarray data and sensitive to inherent noise in the expression value.

### Results

In this paper, we propose a novel sequential pattern mining algorithm that is scalable in the size of microarray data and robust with respect to noise. When applied to the microarray data of yeast, the proposed algorithm successfully found long order-preserving patterns, which are biologically significant but cannot be found in randomly shuffled data. The resulting patterns are well enriched to known annotations and are consistent with known biological knowledge. Furthermore, RMs as well as inter-module relations were inferred from the biologically significant patterns.

### Conclusions

Our approach for identifying RMs could be valuable for systematically revealing the mechanism of gene regulation at a genome-wide level.

## Keywords

## Background

Identifying regulatory modules (RMs) and their interaction networks has been an important challenge in functional genomics and bioinformatics [1–4]. Given a microarray gene-expression matrix, comprised of the rows of genes and the columns of samples (or conditions), biclustering has been the most common method extracting RMs defined as a bi-set of co-regulated genes and coregulating conditions [5–11]. Biclustering simultaneously performs row–clustering and column–clustering, according to the similarities among expression profile vectors of genes and of samples, respectively.

Biclustering has two favorable properties to conventional clustering. First, a gene can be assigned to multiple clusters. This property is well fit to complex biological processes, i.e. a gene can participate in more than one biological process. Second, only the selected conditions are considered for clustering. This property is also in suit with biological implication since genes are only co-regulated under specific conditions. There have been various approaches for biclustering according to the variety of homogeneity definition and search strategy [12]. Cheng and Church [6] define a bicluster as a submatrix having a low mean squared residue score. A bicluster is found from a random seed per iteration and the entries of the cluster are replaced with a random number. Since the biclusters are identified separately in a random fashion, the result may represent an arbitrary subset of all biclusters depending on iterations. Furthermore, the random replacement may interfere with the subsequent identification of biclusters.

FLOC (Flexible Overlapping biClutering) algorithm improves Cheng and Church (2000)’s algorithm by avoiding the random interference and simultaneously discovering a set of *k-* possibly–overlapping–biclusters [13]. The number of biclusters, *k*, however, is arbitrarily specified without considering the inherent characteristics of input data. Ben-Dor et al. [5] focus on the relative order of gene expression values. They define an order-preserving bicluster as a group of genes whose values induce same linear ordering across the samples in a sample subset. They proposed a search algorithm (Order Preserving SubMatrix, OPSM) based on a probabilistic model for a single order-preserving submatrix. The OPSM method, however, is also limited to find each bicluster separately and does not show enough sensitivity to find hidden biclusters.

Recently, there has been an approach to identify order-preserving biclusters using sequential pattern mining (SPM), which has been intensively studied in the field of data mining [14]. SPM is to discover frequent sub-sequences as patterns in a sequence database. In search for order-preservation, it provides an advantage of sensitivity through exhaustive enumeration of all possible patterns. However, SPM is highly time– and memory–demanding especially under gene expression data. Its complexity grows exponentially with the length of sequence whereas linearly with the number of sequences [15]. Note that a typical microarray data has a large gene–wise dimension and can have a large sample–wise one in case of combined datasets, Therefore, it can easily be computationally intractable to apply the standard SPM algorithms to the huge-sized gene expression data in practice. Another difficulty with SPM is related to inherent noise in microarray data. SPM attempts to find an exact order of genes (or conditions) according to the magnitude of the expression value. However, there almost always exists experimental noise in microarray data, which may cause trivial changes in ordering the expression values. In such a case, the current version of SPM can easily fail to detect significant biological patterns since some of the genes are not in due exact order.

In this paper, we propose a novel sequential pattern mining algorithm. This algorithm has several attractive features comparing with the related work: it is scalable in the size of microarray data and robust with respect to noise. When applied to the microarray data of yeast, the proposed algorithm successfully found long order-preserving patterns, which are biologically significant but cannot be found in randomly shuffled data. The resulting patterns are well enriched to known annotations (about genes and conditions as well) and are consistent with known biological knowledge. Among the patterns, the biologically significant patterns were used to infer RMs. There can be more interesting relationships on the level of module, and so the inter-relations between the resulting RMs were further examined. They were categorized into one of four types including (1) independent; (2) conditionally co-regulated; (3) separately co-regulated; and (4) similar. The respective types of inter-module relations were exemplified with biological inferences via enrichment study.

## Results

### Comparison with other methods in sequential pattern mining

*et al.*, 2003 and the naïve application of sequential pattern mining without search windows (SPM-naive) [5, 14]. Other biclustering methods are not considered since they are not targeting order-preserving patterns. For performance comparison, the algorithms are tested on simulation data with embedded sequential patterns. SPM-based algorithms perform better than OPSM in terms of the sensitivity to hidden patterns (Fig.1a). Basically, SPM-naive misses no patterns since it performs an exhaustive enumeration of all possible patterns. The perfect sensitivity of SPM, however, comes with the cost of complexity. The time complexity of SPM is more than exponential and easily becomes intractable as data get larger. Lowering the time complexity is inevitable when one wants to search real-sized gene expression data. As can be seen in Fig.1b and Fig.1c, SPM-window is more efficient than SPM-naive finding as many patterns as its naive counterpart while searching much less. For the reality of microarray condition, the algorithms are tested with addition of noise to simulation data. The sensitivity of SPM-naïve decreases quickly as the noise increases while SPM-window shows better sensitivity and efficiency within a reasonable range of noise (Fig.1). We used BicAT for the implementation of OPSM [16]. Further details of benchmark, such as the generation of simulation data and the parameter selection, are shown in Additional File 1.

### Searching of sequential patterns

^{ g }and the support δ

^{s}. The parameters (see Methods section) were set u = 32, l = 6, w

_{ f }= 535, and w

_{ b }= 53. The number in each cell indicates the frequency for the corresponding combination of (δ

^{ g }, δ

^{s}) where δ

^{ g }= 6, . . . , 9 and δ

^{ s }= 32, . . . , 53. The minimum support threshold u was set to 3% of the total number of samples, and the size of backward lookup w

_{ b }was set to 10% of w

_{ f }. The minimum length threshold l and the size of forward lookup w

_{ f }were empirically set. To validate the significance of resulting sequential patterns, we re-ran the same algorithm to the same data but the data elements were re-shuffled. As a result, no pattern was found all through the ten times of experimental replications. This indicates the sequential patterns only exist in biological data, which justifies the biological significance of our results.

Distribution of sequential patterns

length \ support | 6 | 7 | 8 | 9 | Total |
---|---|---|---|---|---|

32 | 1,107,247 | 98,991 | 1,359 | 3 | 1,207,600 |

33 | 711,700 | 49,900 | 351 | 761,951 | |

34 | 454,088 | 24,350 | 73 | 478,511 | |

35 | 290,648 | 11,614 | 14 | 302,276 | |

36 | 184,029 | 5,270 | 189,299 | ||

37 | 117,035 | 2,402 | 119,437 | ||

38 | 72,871 | 926 | 73,797 | ||

39 | 45,702 | 403 | 46,105 | ||

40 | 28,397 | 138 | 28,535 | ||

41 | 17,560 | 44 | 17,604 | ||

42 | 10,815 | 5 | 10,820 | ||

43 | 6,234 | 4 | 6,238 | ||

44 | 3,657 | 3,657 | |||

45 | 2,055 | 2,055 | |||

46 | 1,154 | 1,154 | |||

47 | 572 | 572 | |||

48 | 286 | 286 | |||

49 | 164 | 164 | |||

50 | 79 | 79 | |||

51 | 38 | 38 | |||

52 | 13 | 13 | |||

53 | 7 | 7 | |||

Total | 3,054,351 | 194,047 | 1,797 | 3 | 3,250,198 |

### Functional validation of sequential patterns

#### Significance test by enrichment study

^{ g }, δ

^{ s }) in Table 1, the δ

^{ g }– sequences of randomly permuted gene-names were generated as the same quantity of (δ

^{ g }, δ

^{s}). Second, all the RMs, both m

_{ P }’s from P and m

_{ R }’s from R, were enriched to known annotations by calculating hypergeometric distributions in regard to GO-slim terms and SMD-sample categories, respectively. The genes were annotated by 33 Gene Ontology (GO) slim terms (of Biological Process) defined by SGD. And, the samples were annotated by 33 SMD categories which describe the experimental context of microarray samples. More details of GO-slim terms and SMD-sample categories are shown in Additional File 2. Then, among the terms (or categories) corresponding to the genes (or the samples) of a RM, the p–value of the most significant term (category) was allocated to the regulatory module [9]. Third, the p-values of m

_{ P }and m

_{ R }were compared. Fig. 2 presents the quantile-quantile plot of the p–value distributions of both m

_{ P }and m

_{ R }. The large departure toward vertical axis from the diagonal line indicates m

_{ P }is more significantly enriched than the competitor m

_{ R }. The circle stands for the p–value of gene annotation, whereas the cross stands for the p–value of sample annotation.

#### Biological implication of regulatory modules

_{ R }’s were significant in the randomly generated modules whereas 426,558 m

_{ P }’s in the modules by sequential pattern mining. Table 2 shows biological implication of the selected RMs by relating the gene context (in terms of GO-slim term) and the sample context (in terms of SMD category). Each cell contains the number of the RMs belonging to the specified context by both aspects. For simplicity, trivial GO-slim terms (or SMD categories) having no

*RM*were removed from the table. Note the two prominent couplings: “[GO] generation of precursor metabolites and energy– [SMD] RNA processing,” and “[GO] cell homeostasis – [SMD] oxidative stress,” which imply the existence of co-regulation under a specific biological condition.

Biological implication of regulatory modules

GO-slim | SMD category | Calcium | Salt treatment | Mutants | Oxidative stress | RNA processing | Stress | DNA damage | Nutrient effects | Chemical effects | Chemostat | Starvation | Mutant vs Wild-type | Total |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

Response to stress | 154,651 | 142,140 | 28,467 | 16,889 | 23 | 3,230 | 527 | 462 | 29 | 2 | 18 | 0 | 346,438 | |

Carbohydrate metabolism | 15,360 | 19,295 | 19,747 | 1,534 | 0 | 1,545 | 156 | 6 | 196 | 18 | 0 | 5 | 57,862 | |

Generation of precursor metabolites and energy | 222 | 1,186 | 399 | 37 |
| 149 | 0 | 0 | 0 | 0 | 0 | 0 | 17,685 | |

Biological process unknown | 2,959 | 911 | 129 | 0 | 0 | 25 | 0 | 0 | 0 | 0 | 0 | 0 | 4,024 | |

Cell homeostasis | 0 | 0 | 0 |
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 514 | |

Cellular respiration | 0 | 0 | 1 | 13 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 | |

Electron transport | 6 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 7 | |

Lipid metabolism | 0 | 1 | 0 | 5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 | |

Amino acid and derevative metabolism | 0 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 | |

Sporulation | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | |

Total | 173,200 | 163,539 | 48,743 | 18,992 | 15,715 | 4,950 | 683 | 468 | 225 | 20 | 18 | 5 | 426,558 |

### Identification of inter-module relations

#### Distribution of module overlap

_{ g }and X

_{ s }.(see Methods section). For the sake of representational convenience, we sampled 300 representatives out of the original 426,558 RMs; 300 centroids from k-medoid clustering (k = 300) were selected as the representative modules. The k-medoid clustering is based on the distance between RMs, defined as an inverse of the proportion of overlap area to the area sum of two RMs. Among the representative modules, 249 were most significantly enriched to ‘response to stress’ of GO-slim term, 34 to ‘carbohydrate metabolism’, 12 to ‘generation of precursor metabolites’ and energy’, 4 to ‘biological process unknown’, and 1 to ‘cell homeostasis’. Fig. 3 shows the plot of (X

_{ s }

**,**X

_{ g })’s for all possible pairs of (m,m′). Most of the pairs belong to either similar or independent type since the gene sets of two modules are similar (dissimilar), and the sample set are highly likely to be similar (dissimilar) as well. However, in the viewpoint of biology, it will be more interesting to investigate the remaining two types of inter-module relations, conditionally co-regulated and separately co-regulated. The relationship of conditionally co-regulated may be observed when a gene set is controlled by different regulation mechanisms, and maybe at different biological states. On the other hand, the relationship of separately co-regulated may happen if distinct gene sets are co-regulated separately under same samples.

#### Typical examples of four inter-module relations

*i*,

*j*) in the lower diagonal where

*i*>

*j*(1 ≤

*i*,

*j*≤ 300) represents the gene overlap (X

_{ g }) between m

_{ i }and m

_{ j }, on the other hand, the coordinate (

*i*,

*j*) in the upper diagonal where

*i*<

*j*represents the sample overlap (X

_{ s }). The gray-scale indicates the degree of overlap; the darker the higher overlap. The square roughly groups the modules which belong to the same type of inter-module relation. The following describes group-wise characteristics of the modules.

**Type 1 / type 4 (independent/similar)**: The modules in the square tagged independent or similar correspond to Type 1 or Type 4, respectively. A module in the square has independent relationship with external modules–the modules outside the square. Both the gene set and the sample set of the module are exclusive from those of external modules, leading to small values of X_{
g
} and X_{
s
}. On the contrary, modules within the square are similar with other internal modules. They highly share the gene set and the sample set, thus the values of X_{
g
} and X_{
s
} are large. Both aspects of independent and similar are represented as darker gray-values within the square but lighter ones outside the square. They share the genes, YGR254W, YGR192C, YKL060C, and YJR009C (more than 7 out of 9 modules), which all participate in ‘glucose metabolism’. These genes are not included in the external modules. The sample context, on the other hand, is characterized by the ‘RNA processing’; 96% of the samples in internal modules are related to ‘RNA processing’ while only 0.08% are in external modules. Therefore, it is suggested that the four genes associated with ‘glucose metabolism’ are bound by ‘RNA processing’.

**Type 2 (conditionally co–regulated)**: The modules in the square tagged conditionally co–regulated belong to Type 2. The darker gray-values of the lower diagonal matrix contrast to the lighter ones of the upper diagonal matrix. This implies that they are highly overlapped in genes but little in samples. More than half of the modules include YMR105C, YBR126C, and YFR053C, which are all related to ‘carbohydrate metabolism’ as ‘Phosphoglucomutase’, ‘Trehalose-6-Phosphate synthase’, and ‘Hexokinase I’, respectively. However, the sample contexts are as diverse as ‘oxidative stress’,‘DNA damage’, ‘Nutrient effects’, ‘Chemical effect’, and so on. Therefore, it is suggested that those three genes related to ‘carbohydrate metabolism’ are conditionally co-regulated depending on different conditions.

**Type 3 (separately co–regulated)**: The modules in the square tagged separately co–regulated belong to Type 3. Opposite to Type 2, the square is light gray-valued in the lower diagonal contrasting to the dark ones in the upper diagonal. This represents that the modules are highly overlapped in samples but little in genes. The samples are dominated by ‘stress or calcium’. However, the representative context of genes is hardly identified.

## Discussion

In this paper, we successfully demonstrated the existence of sequential patterns in gene expression data and validated their biological significance. Furthermore, we inferred inter-module relations based on module overlap and illustrated the examples of condition-specific co-regulations. Module groups in overlap plot also suggest the hierarchical organization of module where genes are grouped into modules that are clustered into supermodules [18]. Our approach could be improved for identifying modular structure in biological system, regarding following several points.

First, we can score the strength of gene order instead of binary decision of their order. This scoring can be achieved by testing the hypothesis that the differential expression of gene A is same to the differential expression of gene B. Second, samples can have different weights. Each biological condition set has different sample resolution: some conditions are studied with large number of microarrays while others are rarely observed due to several reasons including technical difficulty. Although it is difficult to get equal resolution as we integrate more datasets, alternative approaches may be applied. For example, with a weighting scheme of samples - higher weight for rare samples and lower otherwise, patterns can be represented in more diverse biological conditions.

Although our approach has several advantages it still needs more improvements. The first one is the scalability of algorithm. We used yeast expression data of which the size is not relatively large in order to demonstrate the efficiency of our algorithm. In further study, we will try to deal with the pattern mining problem using huge microarray dataset consisting of human and mouse gene expression profiles in diverse conditions. To solve this problem, more memory-efficient algorithm is needed. The second is about running speed. In this study, we mainly focused on the ability of finding modules without considering the running time. However, the running time can be significantly decreased using efficient data structure such as suffix tree.

## Conclusions

In this paper, we presented a sequential pattern mining algorithm to identify RMs from microarray data. The existing definition for sequential pattern was relaxed so that the algorithm can fit into the biological implication in hand. The searching method was also modified to be more scalable and flexible than previous one. The biological meanings of the resulting RMs were enriched through known annotations for genes and samples as well. In addition, the types of relations between modules were further investigated; based on the degree of overlap between two modules, the relation was categorized into one of the four types: 1) independent, 2) conditionally co-regulated, 3) separately co-regulated, and 4) similar. Our approach enables a systematic study of inter-module relations beyond the identification of single module in gene regulation. The research on modular relations in gene expression will be valuable for revealing the mechanism of gene regulation.

## Methods

### Experimental dataset

An expression matrix E was created with 3,860 genes and 1,050 samples by combining all available yeast cDNA datasets from the Stanford Microarray Database (SMD) [17]. We used 3,860 out of the 4,356 genes verified in Saccharomyces Genome Database (SGD) [19]. We excluded ribosome-related genes because they have exceptionally high tendency for order-preservation in a preliminary analysis. Specifically, we excluded those genes annotated to two specific Gene Ontology terms: GO:0042254 (ribosome biogenensis and assembly) in the Biological Process branch and GO:005840 (ribosome) in the Cellular Component branch. Their exceptional richness in order-preserving tendency, which may originate from the fact that they comprise huge complexes, overwhelms that of those in other categories. Removing ribosomal genes effectively reveals weaker signals from other genes and greatly reduces search complexity.

### Sequential pattern mining with gene order preservation

A gene expression matrix E is a matrix of the absolute value of log-ratio of expression level of gene *i* under a specific sample *j*. A zero value of E_{
ij
} indicates no differential expression of gene *i* in sample *j*, and E_{
ij
} >E_{
kj
} indicates that gene *i* is more differentially expressed than gene *k* in sample *j*. The matrix E is then transformed to a sequence database, D. The genes of sample *j* in D are sorted by descending order of expression value of E_{
ij
}, resulting a sequence of genes per sample. In this section, we introduce the modified sequential pattern mining algorithm based on the sequence.

The notations used for definitions are as following:

G A set of genes, G = {*g*_{1}, *g*_{2}, . . . , *g*_{|}_{
G
}_{|}}, *i* = 1, . . . , |G|.

S A set of samples, S = {*s*_{1}, *s*_{2}, . . . , *s*_{|}_{
S
}_{|}}, *j* = 1, . . . , |S|.

E An expression matrix, E ∈ ℜ^{|}^{
G
}^{|×|}^{
S
}^{|}.

D A sequence database from E. Each sequence is a gene-sequence of length |G|, D = {d_{1}, d_{2} ,. . . , d_{|}_{
S
}_{|}}

d_{
j
} A sequence of genes in sample *j*. The length of d_{
j
} is |G|

p A sequential pattern.

p_{g} A sequence of genes in p. The length of p is |p_{g}|.

p_{s} A subset of samples in p. The support of p is |p_{s}|.

l The user-specified threshold for the minimum length.

u The user-specified threshold for the minimum support.

Our goal is to find a sequential pattern with the longest length of gene sequence and the largest samples size simultaneously, supporting a common set of samples. Here we propose a novel sequential pattern mining algorithm that finds long order preserving patterns.

**Definition 1.** Let *i* be a reference point of the given sequence of length *n*,

d = *g*^{1}*g*^{2} … *g*^{
i
} … *g*^{
n
}^{−1}*g*^{
n
}

A generalized sequence of length 2, *g*^{
i
}*g*^{
k
} is constructed if *k* satisfies

*k* ∈ [ *i*−w_{
b
}*i*+w_{
f
} ], *k* ≠ *i*, 1 ≤ *i* ≤ *n*−1,

where w_{
b
} and w_{
f
} specify the sizes of backward- and forward- windows (0 ≤ w_{
b
} ≤ *i*−1, 1≤ w_{
f
} ≤ *n*−*i*), respectively. The size of sequence searching window w is therefore w_{
f
} +w_{
b
}. A longer (generalized) sequence of length |p_{g}| (> 2) is similarly expanded by moving the reference point *i* to *k* (*i* ← *k* if *k* >*i*, *i* ← *i* otherwise) and padding a new *g*^{
k
} up to length |p_{g}|. If a generalized sequence arises more than *u* times in D, i.e., |p_{s}| ≥ *u*, with more forward occurrences than backward ones, we define it as a **sequential pattern** p. The definition of sequential pattern is relaxed or generalized by allowing searching window and even allowing backward lookup.

**Definition 2.** Let P_{(}_{
δ
}^{
g
}_{,}_{
δ
}^{
s
}_{)} be a **specified sequential pattern set**, a set of the sequential patterns satisfying the length (δ^{
g
})– and the support (δ^{
s
})–specific condition,

P_{(}_{
δ
}^{
g
}_{,}_{
δ
}^{
s
}_{)} = { p | |p_{g}| = *δ*^{
g
}, |p_{s}| ≥ *δ*^{
s
} }.

_{(1,}

_{ u }

_{)}, δ

^{ g }= 1, and δ

^{ s }= u, returns the set P. By eliminating the patterns having shorter length than the minimum length l, P = P \ { p ∈ P | |p

_{g}| <l }, we obtain the final set P. For further review, refer to [15, 20].

The sequential patterns found by Definition 1 can vary with the parameters related to searching window, *w*_{
b
} and *w*_{
f
} . We show the following three special cases and present an example accordingly.

**Case 1 (searching with no window)** *g*^{
k
} is added at the end of the reference *g*^{
i
} if *k* satisfies *k* ∈ ( *i*, *n* ]. It results from setting *w*_{
b
} = 0 and *w*_{
f
} = *n−i*.

**Case 2 (searching only by forward lookup)** *g*^{
k
} is added at the end of the reference *g*^{
i
} if *k* satisfies *k* ∈ ( *i*, *i* + *w*_{
f
} ] where *w*_{
b
} = 0 and 1 ≤ *w*_{
f
} ≤ *n − i*.

**Case 3 (searching by backward- and forward lookup)** *g*^{
k
} is added at the end of the reference *g*^{
i
} if *k* satisfies *k* ∈ [ *i−w*_{
b
}, *i* + *w*_{
f
} ], *k* ≠ *i* where 0 ≤ *w*_{
b
} ≤ *i − 1* and 1 ≤ *w*_{
f
} ≤ *n − i*.

*g*

^{ i }and

*g*

^{ k }in forward direction. Case 1 is the most strict definition for sequential pattern. In Case 2 or 3, one can set the size of searching window to be less than the full length of the sequence, which consequently leads to a more relaxed definition than Case 1. In general applications of sequential pattern mining, the number of attributes (corresponding to |G| in our notation) is relatively trivial to the number of samples (e.g., |S|

**>>**|G|). Therefore, it is not so seriously taken as infeasible to explore the |G|–sized sequences without restricting the searching scope. However, in the problem of finding gene sequential patterns from an expression matrix, one faces with the opposite situation (e.g., |S|

**<<**|G|). To the best of our knowledge so far, it easily becomes an intractable problem. Finally, Case 3 allows backward lookup when compared to the others. This relaxation particularly benefits when the sequence is not strictly ordered. It is even more preferable for microarray gene expression data since the orders of genes can often be switched by trivial difference in expression value, but the difference might be incurred by inherent or experimental noise. By allowing

*g*

^{ k }to precede

*g*

^{ i }, one can find more robust sequential patterns. Fig.6 exemplifies the difference of the three special cases.

### Definition of regulatory module

A regulatory module (RM), co-regulated genes and their co-regulating samples, can be identified from the sequential pattern p ∈ P found by SpSearching (Fig. 5).

**Definition 3.** A regulatory module, *m* is identified from a sequential pattern p as:

m= ( m^{
G
} , m^{
S
} )

where m^{
G
} = {g | g ∈ p_{
g
}} and m^{
S
} = {s | s ∈ p_{
s
}}.

The m^{
G
} contains co-regulated genes, and therefore the functional theme in m can be achieved by annotation enrichment for the m^{
G
}. On the other hand, the m^{
S
} contains the corresponding samples to the genes, and hence the conditional theme of the co-regulate genes in m. Note that the definition of RM allows non-exclusive membership (i.e., a sample or a gene can belong to several sequential patterns).

### Types of inter-module relations

_{ g }and X

_{ s }denote the degrees of overlap between the genes and between the samples, respectively.

Where m= ( m^{
G
} , m^{
S
} ) and m′ = ( m^{
G'
}, m^{
S'
} ). Based on the two dimensional degrees of overlap between X_{
g
} and X_{
s
}, we can characterize the inter-module relation into the following four types; two modules are:

**Type 1: independent** when both X_{
g
} and X_{
s
} are low,

**Type 2: conditionally co–regulated** when X_{
g
} is high but X_{
s
} is low,

**Type 3: separately co–regulated** when X_{
g
} is low but X_{
s
} is high, and

**Type 4: similar** when both X_{
g
} and X_{
s
} are high.

## Notes

## Declarations

### Acknowledgements

This work was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (No.2011-0018257), Systems Biomedical Informatics National Core Research Center.

This article has been published as part of *BMC Genomics* Volume 12 Supplement 3, 2011: Tenth International Conference on Bioinformatics – First ISCB Asia Joint Conference 2011 (InCoB/ISCB-Asia 2011): Computational Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/1471-2164/12?issue=S3.

## Authors’ Affiliations

## References

- Bar-Joseph Z, Gerber GK, Lee TI, Rinaldi NJ, Yoo JY, Robert F, Gordon DB, Fraenkel E, Jaakkola TS, Young RA, et al: Computational discovery of gene modules and regulatory networks. Nat Biotechnol. 2003, 21 (11): 1337-1342. 10.1038/nbt890.View ArticlePubMedGoogle Scholar
- Ihmels J, Friedlander G, Bergmann S, Sarig O, Ziv Y, Barkai N: Revealing modular organization in the yeast transcriptional network. Nat Genet. 2002, 31 (4): 370-377.PubMedGoogle Scholar
- Petti AA, Church GM: A network of transcriptionally coordinated functional modules in Saccharomyces cerevisiae. Genome Res. 2005, 15 (9): 1298-1306. 10.1101/gr.3847105.PubMed CentralView ArticlePubMedGoogle Scholar
- Joshi A, De Smet R, Marchal K, Van de Peer Y, Michoel T: Module networks revisited: computational assessment and prioritization of model predictions. Bioinformatics. 2009, 25 (4): 490-496. 10.1093/bioinformatics/btn658.View ArticlePubMedGoogle Scholar
- Ben-Dor A, Chor B, Karp R, Yakhini Z: Discovering local structure in gene expression data: the order-preserving submatrix problem. J Comput Biol. 2003, 10 (3-4): 373-384. 10.1089/10665270360688075.View ArticlePubMedGoogle Scholar
- Cheng Y, Church GM: Biclustering of expression data. Proc Int Conf Intell Syst Mol Biol. 2000, 8: 93-103.PubMedGoogle Scholar
- Getz G, Levine E, Domany E: Coupled two-way clustering analysis of gene microarray data. Proc Natl Acad Sci U S A. 2000, 97 (22): 12079-12084. 10.1073/pnas.210134797.PubMed CentralView ArticlePubMedGoogle Scholar
- Kluger Y, Basri R, Chang JT, Gerstein M: Spectral biclustering of microarray data: coclustering genes and conditions. Genome Res. 2003, 13 (4): 703-716. 10.1101/gr.648603.PubMed CentralView ArticlePubMedGoogle Scholar
- Tanay A, Sharan R, Shamir R: Discovering statistically significant biclusters in gene expression data. Bioinformatics. 2002, 18 (Suppl 1): S136-144. 10.1093/bioinformatics/18.suppl_1.S136.View ArticlePubMedGoogle Scholar
- Hochreiter S, Bodenhofer U, Heusel M, Mayr A, Mitterecker A, Kasim A, Khamiakova T, Van Sanden S, Lin D, Talloen W, et al: FABIA: factor analysis for bicluster acquisition. Bioinformatics. 2010, 26 (12): 1520-1527. 10.1093/bioinformatics/btq227.PubMed CentralView ArticlePubMedGoogle Scholar
- Reiss DJ, Baliga NS, Bonneau R: Integrated biclustering of heterogeneous genome-wide datasets for the inference of global regulatory networks. BMC Bioinformatics. 2006, 7: 280-10.1186/1471-2105-7-280.PubMed CentralView ArticlePubMedGoogle Scholar
- Madeira SC, Oliveira AL: Biclustering algorithms for biological data analysis: a survey. IEEE/ACM Trans Comput Biol Bioinform. 2004, 1: 24-45. 10.1109/TCBB.2004.2.View ArticlePubMedGoogle Scholar
- Yang J, Wang H, Wang W: Enhanced biclustering on expression data. Bioinformatics and Bioengineering. 2003, 3: 321-327.Google Scholar
- Liu J, Wang W: OP-cluster: clustering by tendency in high dimensional space. Third IEEE International Conference on 2003 (ICDM 2003). 2003, 187-194. (ICDM 2003)Google Scholar
- Agrawal R, Srikant R: Mining sequential patterns. In Proc of the 11th Int Conference on Data Engineering 1995. 1995, 3-14.Google Scholar
- Barkow S, Bleuler S, Prelic A, Zimmermann P, Zitzler E: BicAT: a biclustering analysis toolbox. Bioinformatics. 2006, 22 (10): 1282-1283. 10.1093/bioinformatics/btl099.View ArticlePubMedGoogle Scholar
- Ball CA, Awad IA, Demeter J, Gollub J, Hebert JM, Hernandez-Boussard T, Jin H, Matese JC, Nitzberg M, Wymore F, et al: The Stanford Microarray Database accommodates additional microarray platforms and data formats. Nucleic Acids Res. 2005, 33 (Database issue): D580-582.PubMed CentralView ArticlePubMedGoogle Scholar
- Tanay A, Sharan R, Kupiec M, Shamir R: Revealing modularity and organization in the yeast molecular network by integrated analysis of highly heterogeneous genomewide data. Proc Natl Acad Sci U S A. 2004, 101 (9): 2981-2986. 10.1073/pnas.0308661100.PubMed CentralView ArticlePubMedGoogle Scholar
- Hirschman JE, Balakrishnan R, Christie KR, Costanzo MC, Dwight SS, Engel SR, Fisk DG, Hong EL, Livstone MS, Nash R, et al: Genome Snapshot: a new resource at the Saccharomyces Genome Database (SGD) presenting an overview of the Saccharomyces cerevisiae genome. Nucleic Acids Res. 2006, 34 (Database issue): D442-445.PubMed CentralView ArticlePubMedGoogle Scholar
- Pei J, Han J, Mortazavi-Asl B, Pinto H, Chen Q: Prefixspan: mining sequential patterns efficiently by prefix projected pattern growth. Proceedings of the 17th International Conference on Data Engineering 2001. 2001, 215-224.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.