 Proceedings
 Open access
 Published:
Perfect Hamming code with a hash table for faster genome mapping
BMC Genomics volume 12, Article number: S8 (2011)
Abstract
Background
With the advent of nextgeneration sequencers, the growing demands to map short DNA sequences to a genome have promoted the development of fast algorithms and tools. The tools commonly used today are based on either a hash table or the suffix array/Burrow–Wheeler transform. These algorithms are the best suited to finding the genome position of exactly matching short reads. However, they have limited capacity to handle the mismatches. To find nmismatches, they requires O(2^{n}) times the computation time of exact matches. Therefore, acceleration techniques are required.
Results
We propose a hashbased method for genome mapping that reduces the number of hash references for finding mismatches without increasing the size of the hash table. The method regards DNA subsequences as words on Galois extension field GF(2^{2}) and each word is encoded to a code word of a perfect Hamming code. The perfect Hamming code defines equivalence classes of DNA subsequences. Each equivalence class includes subsequence whose corresponding words on GF(2^{2}) are encoded to a corresponding code word. The code word is used as a hash key to store these subsequences in a hash table. Specifically, it reduces by about 70% the number of hash keys necessary for searching the genome positions of all 2mismatches of 21baselong DNA subsequence.
Conclusions
The paper shows perfect hamming code can reduce the number of hash references for hashbased genome mapping. As the computation time to calculate code words is far shorter than a hash reference, our method is effective to reduce the computation time to map short DNA sequences to genome. The amount of data that DNA sequencers generate continues to increase and more accurate genome mappings are required. Thus our method will be a key technology to develop faster genome mapping software.
Background
The history of bioinformatics has been dominated by the search for faster sequence alignment methods. Beginning with dynamic programming for protein and genome sequence alignment, many algorithms have been proposed. Hash tables are used in the series of FASTA programs [1], which calculate approximate alignments in shorter times than dynamic programming can. BLAST tools, using automatons in their algorithms, are the most famous and most used alignment tools [2]. These tools are fast enough to align expression sequence tags generated by capillary electrophoresisbased DNA sequencers to target genomes.
The emergence of nextgeneration sequencing technology has changed the demands for alignment speed. A socalled nextgeneration sequencer can read far more base pairs than a conventional sequencer: more than two billion short DNA sequences in a single run. For such a large number of the sequences, BLAST tools are too slow to map the sequences to target genomes. Therefore, researchers have called for a faster approach that is focused on mapping short fragments.
To meet this demand, more than 25 software programs designed for mapping short DNA sequences onto genomes have been developed. These are classified into two categories according to their algorithms, which are either hashbased or suffix array/Burrow–Wheeler transition (BWT)based [3], MAQ [4] and SOAPv1 [5] are two hashbased algorithms. The former indexes short DNA sequences and the latter indexes genome sequences. mrsFAST is the one of the newest algorithms that indexes both the short DNA sequences and the genome sequences [6]. The first genomemapping algorithm based on suffix arrays was proposed in 2002 [7] and implemented as vmatch. Currently, a BWTbased algorithm is the fastest and is used in four tools: bowtie [8], BWA [9], SOAPv2 [10], and segemehl [11].
These algorithms are effective for mapping short sequences to genome positions of perfect matches and onebase mismatches, but are inefficient for mapping to positions for two or morebase mismatches. In general, they require O(2^{n}) computation time to calculate nbase mismatches. But genome mapping that allows only onebase mismatches is inadequate. In practice, 20 to 40% of short sequences cannot be mapped to the genome. Therefore, “wet” researchers require faster algorithms for mapping short sequences to genome positions with two or morebase mismatches. In this paper, we propose a method that can accelerate hashbased genome mapping by reducing the number of hash references without increasing the size of the hash table.
In the proposed method, DNA subsequences are divided into equivalence classes by using a perfect Hamming code. Each equivalence class includes subsequences whose corresponding words on GF(2^{2}) are encoded to the corresponding code word of the perfect Hamming code. The code word is used as a hash key to store these subsequences in a hash table. A perfect Hamming code is a special case of a Hamming code, known in the field of coding theory [12], that satisfies the Hamming bound with equality. Perfect Hamming codes have been applied to ngram analysis of genome sequence [13] and multiple alignment [14].
Hashbased genomemapping algorithms use hash tables. A hash table is an array indexed by hash values generated from hash keys. Thus, a hash table is an implementation of an associative array. There are two methods for mapping short reads onto genomes using hash tables. One is to store subsequences of the genome and their positions in a hash table and the other is to store subsequences of short reads. As there is no essential difference between their hash usages, we use the former method for the following explanation.
The hashbased methods prepare a hash table whose keys and values represent subsequences of length l cut from a target genome and the subsequence genome positions, respectively. To map a short sequence to the genome, a sequence is cut into lengths l, and these are used as keys to refer to the hash table. The methods can find the genome position of a perfect match if the hash table returns at least one entry. In general, when the lengths of short sequences are longer than the length of the hash key, the methods expand the area of alignment from the genome position. The differences between methods are how and when they refer to the hash table.
There are three methods to find the nmismatch genome positions of a subsequence of length l with the hash table.
1. Refer to all nmismatch subsequences.
Prepare a hash table whose key length is l, and use the subsequence and its nmismatch subsequences as keys to refer to the table. It requires hash references to find all the nmismatch genome positions.
2. Store nmismatch positions in the hash table.
For each position of the subsequence of the genome, store the position times. The hash keys are the subsequence and its nmismatch subsequences.
3. Use pigeonhole principle; combine hash table and another method.
Generate a hash table whose key length is ⌊l/n⌋. After getting the perfectmatch genome position of length ⌊l/n⌋ by referring to the hash table, find nmismatch sequences by another method, such as dynamic programming or BWT.
Figure 1 shows examples of the three methods.
These methods are effective when l is small and n equals 1. But they are difficult to use when n is 2 or more because the number of 2mismatch sequences of length l is l(l – 1)/2 ∗ 9 and that of 3mismatches is l(l – 1)(l – 2)/2 ∗ 9. The first and second methods require too many hash references and too big a hash table, respectively. The third method is the best, but as n becomes larger, the ability to narrow the genome position down becomes weaker, and so the load of the post process to find nmismatch sequences increases. To overcome these difficulties and improve the effectiveness of using hash tables for genome mapping, technical breakthroughs are needed.
We propose a method to reduce the number of hash references to find the genome positions of 2 or more mismatches without enlarging the size of the hash table. To realize the method, 4ary perfect Hamming code is used.
Results
Perfect Hamming codes as hash keys
Idea
We first describe the main idea of the proposed method. We define a graph whose nodes are all the subsequences of length l and edges are between pairs of subsequences of one nucleotide difference. The graph has 4^{l} nodes and each node has 3l edges. Assume we divide the 4^{l} nodes of the graph into 4^{l}/(3l + 1) equivalence classes such that each class has a center node and 3l adjacent nodes. Then, we use the center node as the hash key to store the genome positions of 3l + 1 subsequences in a hash table. For example, Figure 2 shows a part of the graph of length 5. The node “AAAAA” has 15 adjacent nodes. These comprise an equivalence class with subsequence“AAAAA” at its center. To store “ACAAA”, which belongs to the equivalence class, the center word “AAAAA” is used as a hash key.
The features of this hash table are as follows: (1) The number of entries in the hash table does not increase because each subsequence is stored only once. (2) Using this hash table, we can reduce the number of hash references to find the genome positions of subsequences of 1 or moremismatches.
We explain the concept how to reduce the number of hash references to find 1mismatches by using an example. Let the length of subsequence be 5, the hash table be as described above, and s be a subsequence for which we want to find the entries of 1mismatch. There are 15 1mismatch subsequences to be referred to. When s is the center subsequence of the equivalence class, such as “AAAAA” in Figure 2, using s as the hash key, one can find all the genome positions of 1mismatch subsequences. When s is not the center subsequence of its equivalence class, seven hash keys are needed. One hash key is the center subsequence of its equivalence class. This leads to 3 of the 15 1mismatch subsequences. The rest of 12 subsequences are members of six different equivalence classes, and so the center subsequence of these classes are used as the other six keys. Figure 3 shows the equivalence class that s=“CAAAA” belongs to and an equivalence class containing the two adjacent subsequences “CAAAT” and “CAAGA”. Because the proportion of center words (nodes) to total words is 1/16, the expected number of hash references is 1/16 ∗ 1 + 15/16 ∗ 7 = 6.625, which is 41.4% of the number of exact and 1mismatch subsequences.
The requirements for the establishment of the equivalence classes need to be determined. At a minimum, the length of the subsequence l must satisfy the condition:
This shows that 3l + 1 must be a power of 4. For example, l = 5 and 21 satisfies the condition.
It is not clear that the above equation is a sufficient condition for constructing equivalence classes. Even if it is, two problems still remain; how to construct the equivalence classes and how to calculate the center words from a given subsequence. Perfect Hamming codes provide solutions to both these problems.
Perfect Hamming code
A perfect Hamming code (PHC) is a Hamming code that satisfies the equation of the Hamming bound,
where C is a set of q–ary block code of length n, d is the minimum Hamming distance between code words, and . In the PHC method, all the received words are classified into a code word or a 1bit error. In other words, all the words are decoded to code words whose Hamming distance is 0 or 1.
The condition for a qary (n, k)Hamming code be a perfect code is n = q^{k}/(q – 1). In the case of a 4ary code, (5,3)Hamming code and (21,18)Hamming code are perfect. Their paritycheck matrixes are shown in equations (3) and (4), respectively.
where (0, 1, α, α^{2}) are the elements in the Galois field GF(2^{2}). To get a code word x from received word z, the syndrome s = (z – x)H^{T} is used to determine the error vector e = (z – x) [12]. If the syndrome s is not zero, the column of H that is equal to or constant factor of s indicates the error position of z. The addition and multiplication tables are shown in Table 1.
The code word is calculated from a received word as follows.
1. Calculate the syndrome s.
2. If the syndrome s is zero, then the recieved word is the code word.
3. Find a column c of paritycheck matrix that is a constant factor t of the syndrome.
4. Subtract t from the column c of the received word and the result is the code word.
For example, assume the word z = (αααα^{2}0) is received. The code word of z is calculated as follows. The syndrome s of z is:
As s^{T} is equal to α^{2} × (1 α), which is α^{2} times the fourth column of H, subtract (000α^{2}0) from z:
The code word of z is (ααα 00).
The (n, k)Hamming codes are composed of the information digits and the check digits. The information digits are k arbitrary digits of the code and the other n – k digits are the check digits. The generator matrix G can reproduce check digits from information digits. Therefore, code words can be uniquely represented by the k digits. In this paper, we call these representations short codes.
PHC and DNA subsequence
DNA sequences are composed of four nucleotides, adenine, cytosine, guanine and thymine. Let these correspond onetoone to the elements of Galois field GF(2^{2}). Then, DNA sequences correspond to words on the Galois field. Without loss of generality, let (A,C,G,T) correspond to (0,1, α, α^{2}). The sequence “GGGTA” is expressed as the word (αααα^{2}0), and the word (10000) represents the DNA sequence “CAAAA”.
This correspondence relationship and the PHC enables us to build the equivalence classes described in Section Idea. Each equivalence class is composed of a DNA subsequence that corresponds to a PHC code word and DNA subsequences whose corresponding words are errorcorrected to the code word. Figure 2 shows an equivalence class. The DNA subsequence “AAAAA” corresponds to word (00000) on GF(2^{2}) and is a code word of 4ary (53)PHC. From the properties of PHC, All the words whose Hamming distances from the code word (00000) are 1 are errorcorrected to the code word, and they are adjacent nodes of “AAAAA”. Additional File 1 shows correspondence table of 5mer subsequences and code words of 4ary (5,3)PHC. In the following, we regard DNA subsequences and their corresponding codes on the Galois field as equivalent (i.e., aliases).
Algorithms
We propose a hash table for genome mapping whose hash keys are code words of PHC. Then we show its use and efficiency in finding genome positions of nmismatches and ngaps. Following is a description of the notation used in this section.
Preparing the hash table
There are two ways to construct hash tables for mapping short DNA sequences onto a genome. One uses subsequences of the genome as hash keys to store their genome positions in a hash table. And another uses subsequences of short DNA sequence as the hash key. Because both of these use DNA subsequences as hash keys, our method can be applied to either. In the following, we use the former in the explanation.
The hash table of our method uses the representative subsequence of the equivalence classes as hash keys. The representative is the code word on PHC. Without loss of generality, the information digits of the code words can be used as the hash key. Given an (n, k) – PHC on G(2^{2}), let S be a set of subsequences of the genome with length l = n. The genome positions of a subsequence s ∈ S are stored in the hash table along with a hash key c(s) or its information digits i(c(s)). Figure 4 shows the use of hash tables.
Searching for nmismatches
In this section we describe how to find genome positions of 1 and 2mismatch subsequences of a given subsequence s given the hash table prepared as described in section Preparing the hash table. The efficiency of the method is also described.
Let s be a DNA subsequence. The set of hash keys K required to refer to all the entries of perfect match and 1– to n–mismatches is naturally expressed as follows.
The number of keys K_{ n }(s) is less than the number of subsequences to be referred to, . Specifically, when the length of s is 5 and 21, the expected number of keys for 1mismatch K_{1}(s) are 6.625 and 30.25, respectively. As the number of subsequences of perfect and 1mismatch are 1 + _{5}C_{1} × 3, the method reduces the number of hash keys to 41.4% (= 6.625/16) and 47.7% (= 30.25/64), respectively. We summarize these values in the “ratio” column of Table 2. In the following, we analyze the properties of the hash keys K_{1}(s) and K_{2}(s).
First, we analyze K_{1}(s) for s of length 5. The subsequence s is classified into two cases according to whether s is a code word on PHC.
Case 1: s is a code word. As s is the code word, all the 1mismatch words of s are decoded to s by PHC. That is to say, they belong to the same equivalence class E(s). Therefore, s is used as a hash key and it can refer to all the 1mismatch subsequences.
Case 2: s is not a code word. Figure 5 shows the fifteen 1mismatch subsequences. As s is not a code word, the equivalence class E(s) has three 1mismatch subsequence of s. One of these three is the code word c(s). These three differ from s at the same digit. Assume s= “AAAAG”. Then, the code word c(s) is “AAAAA”, and The words “AAAAC” and “AAAAT” belong to same equivalence class, E(“AAAAG”). These differ at the fifth digit. The hash key c(s) can refer to four sequences at once.
The rest of 12 words belong to six equivalence classes. Assume that word t differs at jth digit. t is not a code word because d_{ H }(t, c(s)) = 2 and the distance between code words must be more than 3. The code word c(t) and t differ at the kth digit, where k ≠ i, j. There is a word u that differs from s at the kth digit and c(t) at the jth digit. Because c(t) belongs to the equivalence class E(t), use c(t) as a hash key and two words t and u can be referred to. Finally, the number of keys K_{1}(s) to refer to all the 1mismatch subsequences is seven.
Because the proportions of Case 1 and Case 2 are respectively 1/16 and 15/16, the expected number of keys in K_{1}(s) is 6.625 (1 ∗ 1/16 + 7 ∗ 15/16).
Next, we show an algorithm to calculate the set of hash keys K_{1}(s).
Input : s
Output : K_{1}(s) : a set of hash keys

1.
K_{1}(s) ← c (s)

2.
s := c (s) and return (K_{1} (s))

3.
for t in N_{1}(s) add c(t) to K_{1}(s)

4.
return (K_{1}(s))
The algorithm calculates code words 16 times when s is not a code word, where the number of the hash keys is seven. There appears to be redundancy. There are various ways of reducing the computation time of the code words, but it is better not to use complicated algorithms. The calculation of code words is fast because the operations + and × on G(2^{2}) can be calculated as binary operations.
By using the set of hash keys K_{1}(s), not only the entries of s and all the 1mismatch subsequences are referred to, but also the other entries are. For example, when s is not a code word, 12 subsequences of 2mismatch belongs to the same equivalence class E(s). Therefore, the hash key c (s) refers to these subsequences. To analyze the properties of these subsequences, we define a reference formula:
where s is a subsequence, K is a set of hash keys, and the coefficient a represents the number of subsequences that are referred to by K and whose distance from s is b.
For Case 1, because s is the code word, all the 1mismatch subsequences belong to E(s). Therefore, the reference formula for Case 1 is:
For Case 2, there are 7 hash keys in K_{1}(s). Because the equivalence class of c (s) has 12 2mismatch subsequences, the reference formula of c (s) is:
Each of the equivalence classes of the other hash keys has two 1mismatch sequences, five 2mismatch sequences and nine 3mismatch sequences. The reference formula of K_{1}(s) – {c(s)} is:
Finally, the reference formula for the Case 2 is:
The reference formula shows the proposed method searches many 2 and 3mismatch sequences. We discuss this feature in Section Discussion.
The above algorithm and analysis can be applied to the word length 21. The numbers of hash keys are 1 and 31 for Case 1 and Case 2, respectively. Using the rate of occurrences of Case 1 and Case 2, 1/64 and 63/64, respectively, the expected number of hash keys is 30.53. The reference formulas are shows in Table 2.
To refer to all the entries of 2mismatches, our method requires 27.25 hash keys, which is 25.5% of the number of subsequences with 2 or fewer mismatches. when the length of subsequences is 5. Figure 6 shows the subsequence s and its surroundings when s is a code word. The number of subsequences of exact 2mismatches N_{2}(s) is 90, and the elements of N_{2}(s) are neighbors of N_{1}(s). Each n ∈ N_{2}(s) has two neighbors of N_{1}(s) and each n belongs to an equivalence class that contains other two elements of N_{2}(s). In other words, 30 equivalence classes are required to cover N_{2}(s). In total, the number of required keys K_{2}(s) is 31. The reference formula is:
In Case 2, s is not a code word and Figure 7 shows 2mismatch sequences of s. The equivalence classes 2mismatch subsequences belong to are classified into four types.
Type 1: 2mismatch subssequences belong to this type are neighbors of c(s).
Type 2: for some t such that d_{ H }(t, s) = 1 and c(t) ≠ c(s), 2mismatch subsequences are neighbors of t belonging to c(t).
Type 3: for some t such that d_{ H }(t, s) = 1 and c(t) ≠ c(s), they are neighbors of t not belonging to c(t).
Type 4: for some u such that d_{ H }(u, s) = 1 and c(u) = c(s), they are neighbors of u not belonging to c(s).
Types 1 and 2 are included in K_{1}(s) and the numbers of subsequences are 12 and 30, respectively. The equivalence classes of Type 3 are the rightmost circles in Figure 7. Similar to subsequences of 2mismatches in Figure 6, three 2mismatch subsequences belong to each equivalence class. The number of equivalence classes is eight and they includes 24 2mismatch subsequences. The bottomleft circle in Figure 7 represents Type 4. The relation between of Types 4 and 1 looks similar to that between Types 2 and 1. In fact, Type 4 is a union of K_{1}(u) – c(s) for over each possible u. As the size of u is 2, Type 4 has 12 equivalence classes. In total, the number of hash keys to refer to 2mismatch subsequences is 27 (= 1 + 6 + 8 + 12). The reference formula is as follows:
In the same manner, we can analyze the hash keys K_{2}(s) for the subsequence of length of 21. In this case, the reference formula when s = c(s) becomes:
and the formula when s ≠ c(s) is:
Search ngaps
To align DNA subsequence and a genome, there are three types of gaps. These are gaps in short DNA sequence, gaps in genome sequence, and gaps in both. Our method can reduce the number of hash keys to refer to gaps in short DNA sequences. Given a subsequence with gaps s, hash keys to refer to the genome positions are a set of code words of subsequences which with the gaps of s are substituted with nucleotides. The expected numbers of hash keys are 3.25 and 3.84 when the length of a subsequence with one gap is 5 and 21 respectively.
Let s be a subsequence with onegap, such as “AAAA”, and S be a set of subsequences for which a gap in s is substituted with a nucleotide, in this case the set comprising “AAAAA”, “AACAA”, “AAGAA”, and “AATAA”. To find the genome position that matches s, we need to refer to entries that correspond to S.
When a subsequence t ∈ S is a code word, all the subsequences in S belong to the same equivalence class. Therefore, by using c(t) as a hash key, all the entries correspond to gapped subsequence s can be referred to from. In this case, the reference formula becomes 4 + 12x, where the index number of x represents the minimum distance from the four subsequences in S.
If no t ∈ S is a code word, the four subsequences belong to different equivalence classes. Therefore, four hash keys are required and the reference formula is 4 + 60x. The proportion for which one member of S is a code word is s/# of words in a equivalence class = 4/16 = 1/4, and so the expected number of hash keys is .
In the same way, when the length is 21, the expected number of hash keys is . The reference formulas are shown in Table 2.
Next, we consider a subsequence with two gaps. Let s be a subsequence of length 5 with two gaps such as “AAA” and S be the set of 16 sequences for which the gaps in s are replaced with nucleotides. The number of information digits in (5, 3)PHC is 3, and so one of 16 words in S is a code word t. The code word t is the only code word in S because the maximum Hamming distance among words in S is 2, which equals the number of gaps, and the minimum Hamming distance between code words is 3. The equivalence class E(t) includes seven subsequences of S; let U be the remaining subsequences (U = S – N_{1}(t)). Because u ∈ U is not a code word and d_{ H }(u, t) = 2, the distance between t and the code word c(u) is 3 (d_{ H }(c(u),t) = 3). This implies that c(u) and t differ at a nongapped position in t. Therefore, for all u, v ∈ U, u ≠ v and d(c(u), v) = d(u, v) + 1 ≥ 2. Thus, all the subsequences in U belong to different equivalence classes and nine (=U) hash keys are required to refer to 2gap subsequences.
For example, if s=“AAA”, S includes a code word t =“AAAAA” and t can refer to 7 sequences: “AAAAA”, “ACAAA”, “AGAAA”, “ATAAA”, “AAACA”, “AAAGA”, and “AAATA”. The set of remaining subsequences are U = {“ACACA”, “ACAGA”, “ACATA”, “AGACA”, “AGAGA”, “AGATA”, “ATACA”, “ATAGA”, “ATAGA” }. Let u ∈ U = “ACACA”. The code cord c(u) is “ACACC” and Hamming distance from the rest of U are two or three. Therefore, all subsequences in U belong to different equivalence classes.
Length of subsequence
The code length of the PHC is restricted to 5 or 21 in practice. This is inconvenient. Therefore, we next explain ways to elongate the code length. There are four ways to elongate the code length. The first way is to simply add nucleotides before or/and after the code words. Two other ways are serialization and parallelization of PHCs. The former method serializes more than two PHCs and serialized code words are used as the hash key. The latter one uses more than two hash tables for the parallelization and is a way to utilize the pigeonhole principle where pigeons are mismatches or gaps and holes are the regions without mismatches and gaps. The fourth way is a combination of the three. Figure 8 shows the concepts behind each. In the following, we show a serialized code and a parallelized code, both of length 10.
Let s = s_{1}s_{2} be a sequence of length 10 and s_{1} and s_{2} be the subsequences of length 5. The hash key used in the serialization to store s is c(s_{1})c(s_{2}). In this case, each equivalence class holds 256 subsequences. To refer to the entry of a sequence s = s_{1}s_{2} and the 30 1mismatch sequences, the set of hash keys is:
and the expected number of hash keys is 12.25. To prove this, we consider four cases:

Case 1 s_{1} and s_{2} are both code words.

Case 2 s_{1} is a code word, but s_{2} is not.

Case 3 s_{2} is a code word, but s_{1} is not.

Case 4 neither s_{1} nor s_{2} is a code word.
In Case 1, Use s_{1}s_{2} as a hash key; this can refer to all the 1mismatches. The reference formula in this case is the square of the reference formula of length 5, (1 + 15x)(1 + 15x) = 1 + 30x + 225x^{2}.
In Case 2, we need to consider two subcases based on the position of the 1mismatch. When the position is in the first half of s, the hash key s_{1}s_{2} can refer to all of them. When the position is in the second half, the second half of the hash keys becomes one of the seven words in K_{1}(s_{2}). Therefore, a set of hash keys is:
Because s_{2} ∈ K_{1}(s_{2}), the hash keys in the second subcase include the hash keys in the first subcase. Therefore, the number of hash keys K_{1}(s) is 7. The reference formula is:
In Case 3, similar to in Case2, the set of hash keys is:
and the reference formula is same as that of Case 2.
In Case 4, the set of hash keys is the union of {s_{1}tt ∈ K_{1}(s_{2})} and {ts_{2}t ∈ K_{1}(s_{1})}, which correspond to 1mismatch in the first half and 1mismatch in the second half, respectively. Because both of these include c(s_{1})c(s_{2}), the number of hash keys is 13 (= 7 + 7 – 1). The reference formula is:
The proportions of cases 1 through 4 of 1/256, 15/256, 15/256, and 225/256, respectively, and so the expected number of hash keys is 12.25.
The parallelization requires two hash tables and each subsequence is stored in both hash tables. Therefore, the total size of the hash tables is twice that of serialization. The hash keys are c(s_{1})s_{2}: the first haf is PHC, and s_{1}c(s_{2}): the second half is PHC. Consequently, two types of equivalence classes are used in the parallelization and each equivalence class holds 16 subsequences. The set of hash keys for 1mismatch sequences is:
where each set corresponds to one of the two hash tables. The expectation number of keys is 13.25.
Let us consider the four cases, which are the same as those for serialization. In case 1, use s_{1}s_{2} as the hash key for two hash tables and all the entries of 1mismatch are referred to. In this case, the reference formula is (1 + 15x) + (1 + 15x) – 1 = 1 + 30x. As a subsequence s_{1}s_{2} is stored in both hash tables, one is subtracted in the formula. Though the number of hash keys appears to be one, it is used twice. Thus the number of hash keys K_{1}(s) is two.
In Case 2, the hash keys are:
The total number hash keys is 8 and the reference formula is:
Case 3 is similar to Case 2. In this case the hash keys are:
In Case 4, The hash keys when the first half includes the mismatch are {ts_{2}t ∈ K_{1}(s_{1})} and that for the second half are {s_{1}tt ∈ K_{1}(s_{2})}. The number of hash keys is 14 and the reference formula is:
The proportions of the cases are same as for serialization, and the expected number of hash keys is 13.25.
Discussion
To search genome positions of nmismatches and ngaps with our method, Table 2 shows it also searches some positions of n+αmismatch. For example, our method searches not only 1 perfect match and 63 1mismatch subsequences, but also 210 2mismatches and 1710 3mismatches as byproducts 11.1%(= 210/1890) and 4.8%(= 1710/35910) of all 2 and 3mismatches, respectively. This proportion increases to 46.7%(= 42/90), 20% (= 54/270) when l = 5. These byproducts are, in fact, effective. One reason for the current low mapping ratios from DNA sequencers of short reads to a genome is the small number of mismatches and gaps that the employed mapping method can find. Therefore, increasing the numbers of mismatches and gaps will contribute to increasing the mapping ratio and subsequent biological analyses, even if the method is probabilistic.
The increasing demand to map massive amounts of short DNA sequences to genomes is inevitable. Because the number of short sequences is enormous, it is difficult to ensure finding all genome positions of 1mismatches in a practical computation time. Therefore, faster methods are required and the proposed method is a step in that direction. We have shown that the proposed method can reduce the number of keys necessary to find the genome positions of nmismatches. The main idea behind the method is to classify the subsequences into equivalence classes using PHC. Because equivalence classes contain multiple subsequences, our method can increase the density of the hash table over those using in the usual method. That is to say, our method can use longer subsequences.
For example, the size of human genome is about 3G bases long. When this is stored it with subsequences of length 21 in usual way, the density of the hash table is 3 × 10^{12}/4^{21} ≈ 0.07%. On the other hand, the hash table using our proposed method using (21,18)PHC, the density is 3 × 10^{12}/[# of equivalence classes] = 3 × 10^{12}/4^{18} ≈ 4.7%. That is to say, our method can use longer subsequences. The length of subsequence is sensitive to the efficiency of the genomemapping programs, and the longer the better, for a given density of hash table. Therefore, the proposed method has an advantage from this point of view.
We consider the computation time for code words is far shorter than a hash reference when we describe the effectiveness of the proposed method. In practice, the calculation of the syndrome using the paritycheck matrix of the Hamming code is very short, even if on GF(2^{2}), and so it is easy to calculate the code word from a subsequence. Also, the calculation is small enough to be executed within a CPU cache. On the other hand, the size of hash table is larger than the size of CPU caches. Some exceeds the size of memory because the number of entries is almost equal to the length of the target genome. The hash reference is apparently slower than the calculation of the code word. Therefore, the advantage of reducing the hash references exceeds the disadvantage of additional tasks to calculate code words. With these advantages, our method will help to implement faster genome mapping programs.
Conclusions
The paper shows perfect hamming code can reduce the number of hash references for hashbased genome mapping. The method encodes subsequences to perfect hamming codes on GF(2^{2}) and use them as hash keys. It can reduce by about 70% the number of hash keys necessary for searching the genome positions of all 2mismatches of 21baselong DNA subsequence. As the amount of data that DNA sequencers generates continues to increase and more accurate genome mappings are required, our method will help to develop faster genome mapping software.
References
Pearson WR, Lipman DJ: Improved tools for biological sequence comparison. Proc. Natl. Acad. Sci. USA. 1988, 85: 24442448. 10.1073/pnas.85.8.2444.
Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J. Mol. Biol. 1990, 215: 40310.
Burrows M, Wheeler DJ: A blocksorting lossless data compression algorithm. Palo Alto, CA, Digital Equipment Corporation. 1994, Technical report 124
Li H, Durbin R: Mapping short DNA sequencing reads and calling variants using mapping quality scores. Genome Research. 2008, 18 (11): 18511858. 10.1101/gr.078212.108.
Li R, Kristiansen K, Wang J: SOAP: short oligonucleotide alignment program. Bioinformatics. 2008, 24 (5): 713714. 10.1093/bioinformatics/btn025.
Hach F, Hormozdiari F, Alkan C, Hormozdiari F, Birol I, Eichler EE, Sahinalp SC: mrsFAST: a cacheoblivious algorithm for shortread mapping. Nature Methods. 2010, 7: 576577. 10.1038/nmeth0810576.
Abouelhoda MI, Kurtz S, Ohlebusch E: The enhanced suffix array and its applications to genome analysis. Lecture Note in Computer Science. 2002, 2542: 449463.
Langmead B, Trapnell C, Pop M, Salzberg SL: Ultrafast and memoryefficient alignment of short DNA sequences to the human genome. Genome Biology. 2009, 10 (3): R2510.1186/gb2009103r25.
Li H, Durbin R: Fast and accurate short read alignment with BurrowsWheeler transform. Bioinformatics. 2009, 25 (14): 17541760. 10.1093/bioinformatics/btp324.
Li R, Yu C, Li Y, Lam TW, Yiu SM, Kristiansen K, Wang J: SOAP2: an improved ultrafast tool for short read alignment. Bioinformatics. 2009, 25 (15): 19661967. 10.1093/bioinformatics/btp336.
Hoffmann S, Otto C, Kurtz S, Sharma CM, Khaitovich P, Vogel J, Stadler PF, Hackermüller J: Fast mapping of short sequences with mismatches, insertions and deletions using index structures. PLoS Comput Biol. 2009, 5 (11): e1000502
Encycropedic Dictionary of Mathematics, second edition. Edited by: Ito K. 1996, First MIT Press, second
Takenaka Y, Matsuda H: Frequency enmeration of DNA subsequences from largescale sequences using linear code. Proceeding of 11th Intl. conf. ISMB. 2003, B59.
Takenaka Y, Sakata M, Matsuda H: Nucleotide encoding according to perfect linear code and its application to mutiple alignment. Information Processing Society of Japan, Special Interest Groups Technical Report. 2006, BIO5: 103109.
Acknowledgements
This work was partially supported by KAKENHI (22680023) and (22310125).
This article has been published as part of BMC Genomics Volume 12 Supplement 3, 2011: Tenth International Conference on Bioinformatics – First ISCB Asia Joint Conference 2011 (InCoB/ISCBAsia 2011): Computational Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/14712164/12?issue=S3.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
YT provide the key idea and the mathematical analyses. SS and HM provide valuable help on the topics. All authors discusses the results and commented on the manuscript.
Electronic supplementary material
12864_2011_3698_MOESM1_ESM.xlsx
Additional file 1: DNA sequences and their code words. All the 5mer DNA sequences and their code words on 4ary (5,3)perfect Hamming codes. (XLSX 13 KB)
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Takenaka, Y., Seno, S. & Matsuda, H. Perfect Hamming code with a hash table for faster genome mapping. BMC Genomics 12 (Suppl 3), S8 (2011). https://doi.org/10.1186/1471216412S3S8
Published:
DOI: https://doi.org/10.1186/1471216412S3S8