Skip to main content

Modular and configurable optimal sequence alignment software: Cola

Abstract

Background

The fundamental challenge in optimally aligning homologous sequences is to define a scoring scheme that best reflects the underlying biological processes. Maximising the overall number of matches in the alignment does not always reflect the patterns by which nucleotides mutate. Efficiently implemented algorithms that can be parameterised to accommodate more complex non-linear scoring schemes are thus desirable.

Results

We present Cola, alignment software that implements different optimal alignment algorithms, also allowing for scoring contiguous matches of nucleotides in a nonlinear manner. The latter places more emphasis on short, highly conserved motifs, and less on the surrounding nucleotides, which can be more diverged. To illustrate the differences, we report results from aligning 14,100 sequences from 3' untranslated regions of human genes to 25 of their mammalian counterparts, where we found that a nonlinear scoring scheme is more consistent than a linear scheme in detecting short, conserved motifs.

Conclusions

Cola is freely available under LPGL from https://github.com/nedaz/cola.

Findings

The fundamental question for optimal alignment of genomic sequences is how to define "optimality", with particular regard to biological relevance. Mathematically, optimality is determined by the underlying scoring function, and different linear and limited nonlinear schemes have been proposed [17]. To date, the Smith-Waterman gap affine (SWGA) method [3], a modification of the Smith-Waterman (SW) method [7] that applies additional penalties to alignment gaps regardless of the gap size itself, has remained the method of choice, and is utilised by common alignment tools [8]. Here, we extend this method (SWGA+) by allowing for any arbitrary nonlinear match scoring function, enabling us to give higher weights to consecutive matching nucleotides, rather than optimising the total number of matches. The software we have developed, Cola (Contiguous optimal local aligner), is a C++ implementation of this algorithm, which, by applying a linear match scoring function, degenerates into the SWGA and SW schemes. Notable features include a constant factor difference between generalised and linear scoring, both in runtime and memory consumption. Also, banded alignments, i.e. limiting the search space to a band around the diagonal, allows for scaling linearly in time with sequence length. We also utilise a variation of an algorithm that significantly improves the space complexity from O(N2) to O(2 N). This is based on the check-pointing method introduced by Powell et al. [9] as an extension of the divide-and-conquer method introduced by Hirschberg [10].

Cola provides an Application Programmer’s Interface (API) for ease of integration into larger software packages, and is e.g. included in the recent versions of the whole genome synteny aligner Satsuma[11], and the universal genome coordinate mapper Kraken (Zamani et al., submitted). Depending on parameterisation, Cola is bit-compatible with the SW and SWGA methods.

Methods

Both SW and SWGA maximise the overall number of matches, modulo the gap penalty, in a linear fashion, e.g. each nucleotide match or mismatch is scored separately, conceptually allowing for computing the alignment on a two-dimensional grid. Cola implements this strategy, but extends the dimensionality to accommodate non-linear scoring of consecutive matches so that confined sequence motif matches are preferred over dispersed matches within their diverged flanks. Since this algorithm adds considerable computational complexity, i.e. the alignment can no longer be performed in two dimensions, Cola implements a three-dimensional graph structure analogous to the 'edit-graph' used by SW and SWGA. The difference is exemplified in Figure 1: in two dimensions, every node in a graph can be reached from a preceding neighbour by means of a horizontal, vertical, or diagonal edge (Figure 1a). Assuming that the query sequence is represented horizontally and the target sequence vertically, the horizontal, vertical, and diagonal edges entering a node, in turn, correspond to an insertion or deletion (indel) in the query, indel in the target, and a match or mismatch between the query and target bases at the node coordinates. In three dimensions, SWGA keeps nodes for vertical and horizontal moves separately at each cell position (i,j), storing the number of consecutive matches in the third dimension (Figure 1b), so that scores are computed in any arbitrary manner and can depend on the match depth, allowing for favoring fewer consecutive matches over more total matches.

Figure 1
figure 1

2D and 3D edit graphs. (a) Edit-graph for the alignment between the target and query sequences shown on the top and left hand side of the graph. The optimal path chosen by SWGA+ is shown with red arrows and the corresponding alignment is shown below the graph. Note that the local alignment starts and ends with the blue arrows. (b) The corresponding 3D edit-graph for the alignment shown in part (a). For better visibility the starting point, (0,0), in this graph is shown on the bottom-left and end point (n,m) is on the top-right. Each cell contains n number of nodes, which are shown on the third dimension of the graph and correspond to the lengths of contiguity starting from 0 to di,j. The optimal path, which is similar to the path shown in part (a) is depicted in a dotted red line.

Cola implements its search method using a dynamic programming algorithm, similar to SWGA, but with the added challenge of tracking match contiguity. The recurrence given in the equation below keeps the runtime almost as that of SWGA, affecting it only by a linear factor (See section on performance for more detail).

S i , j = max n = 0 : d i , j S i , j , n S i , j , 0 S i , j , 0 0
(1)

Si,j represents the score pertaining to the optimal local alignment that extends to the ith element of the target and jth element of the query. This score is obtained by finding the optimum among all possibilities of reaching the node (i, j) from its neighbours, which are shown as four elements in Eq. 1. The first element Si,j,n represents the score for reaching (i, j) with n number of contiguous matches, where n is enumerated from 0 to di,j, the maximum number of contiguous matches possible, or in other words, the depth of the edit-graph at (i, j). The recurrence for computing Si,j,n is shown below (Eq. 2), where Δf(n) = f(n) − f(n − 1) is the score difference for n and n-1 matches, which is added to Si − 1,j − 1,n − 1 to obtain Si,j,n, and f(n) can be any arbitrary function. If n = 0, i.e. the target base i and query base j do not match, a fixed mismatch penalty ρ m is applied.

S i , j , n = S i 1 , j 1 , n 1 + Δf n n > 0 S i 1 , j 1 ρ m n = 0
(2)

The next two elements in Eq. 1 are S i , j , 0 and S i , j , 0, which represent the horizontal and vertical moves, i.e., indels kept separately for enabling gap-affine scoring. The recurrence relationships below demonstrate how these values are calculated, where ρ o is the cost of opening a gap and ρ e is the cost for extending a gap.

S i , j , 0 = max S i 1 , j ρ e S i , j 1 ρ o + ρ e
(3)
S i , j , 0 = max S i , j 1 ρ e S i 1 , j ρ o + ρ e
(4)

The last element in Eq. 1, i.e., 0 is required for finding the local alignment as opposed the global. It translates into starting the alignment from any point that maximises the overall alignment score. Removing this element from the recurrence turns the algorithm into a global aligner rather than a local one.

To conceptualise the effect of the aforementioned recurrences, we can think of extending the SWGA edit-graph structure by appending nodes that correspond to the cost of getting from cell (i,j) to cell (i', j') with n contiguous matches. This translates to adding one node for each value of n at every cell (i,j) in the graph. Conceptually, the underlying edit-graph becomes three-dimensional, with the third dimension containing the nodes that track the path and cost of contiguous matching. For memory efficiency, Cola dynamically allocates the third dimension only in an on-demand fashion (see Figure 1b), and limits the depth to 1 in case a linear function is applied (e.g. to match the SW and SWGA schemes). The depth at each cell (i,j) demonstrates the various lengths of contiguity of matches for which the best path can be obtained from cell (0,0) to cell (i,j). Knowing the length of contiguity of matches at every given node allows for applying a scoring mechanism based on an arbitrary function of the matches. Cola implements a cubic function f (n) = n3 by default, as manually examined examples suggest good balance between a too steeply rising function (e.g. exponential function) and a lower degree polynomial (e.g. quadratic function) in combination with the penalties ρ m = 8, ρ o = 200, and ρ e = 20, which we determined empirically (2 consecutive matches equal 1 mismatch penalty, 3 consecutive matches score higher than a single gap extension penalty, etc.).

Performance and accuracy

The time and space complexities of SW+ in comparison with SW are affected by a constant factor. The algorithm complexity for SW+ is in the order of O(kNM) as opposed to O(NM) for SW, where N and M represent the size of the target and query sequences and k is the average length of contiguity over the entire search space. The exact value of the constant factor k depends on the data, but is in practice below 2. To obtain an empirical measure of this coefficient, we show a graph of runtime of SW+ versus SW for aligning all regions in the human and dog [12] genomes that are identified by LASTZ chains [13] to be orthologous. From this dataset, consisting of about 500,000 alignments, we estimate k from a regression to be 1.6, as shown in Figure 2, along with significance statistics.

Figure 2
figure 2

The regression of SW+ runtime values against SW runtime for regions in the human and dog genome that were identified by BLAST to have a significant alignment score. For this dataset, which is representative of others with similarly significant alignments, the SW+ runtime is by a factor of 1.6 slower than SW.

While the true accuracy of a pairwise alignment is difficult to assess, we define several measures to highlight the difference as a result of linear or non-linear scoring: (i) the number of positions in which all or most genomes agree with the reference, representing events that could be less likely to occur by random chance; and (ii) the number of elements consisting of n consecutive nucleotides matching all or most genomes. As a test set, we choose 14,100 3' Un-translated Regions (3'UTRs) of human coding genes that are between 100 and 1000 in size, with 4.9 million nucleotides in total sequence, and their orthologous sequences in at least 25 mammalian genomes [13]. 3'UTRs are known to contain short (6 nucleotides), and in some cases highly conserved recognition motifs required for post-translational processing of RNAs, including the poly-adenylation signal AATAAA.

In comparing the different scoring schemes (restricted to the regions in which all methods report alignments), SW finds the largest number of matching nucleotides in all pairwise mammal-to-human alignments (see Table 1). The SW method yields fewer positions in which a higher fraction of genomes agree compared to SWGA, SW+ and SWGA+. Figure 3 shows the nucleotide counts over the percentage of matching genomes for SWGA, SW+, and SWGA+, after subtracting the SW counts. All three methods show a clear shift towards the higher end, indicating that the SW scoring method is sub-optimal in terms of consistency across multiple alignments. The SWGA and SWGA+ methods perform almost equally well in terms of single nucleotides. However, when examining the number of elements of 6 consecutive nucleotides (the size of the poly-adenylation signal) or longer that are matched in 90% of the aligned genomes or more, both SW+ and SWGA+ find more instances, as well as more total sequence in such regions (Table 1). When computing the frequencies of all 6-mers in these regions, we find that all methods report the poly-adenylation signal AATAAA to be the motif with the highest occurrence rate, and that SWGA+ finds 33 more instances than SWGA (Table 1), which is to be expected due to its scoring preference to compact motifs.

Table 1 Comparison of SW, SWGA, SW + and SWGA+ with regards to alignment consistency
Figure 3
figure 3

Normalised counts of nucleotide matches over the percentage of genomes in which the nucleotides match. Shown are the count distributions form SWGA (black), SW+ (blue), and SWGA+ (red), minus the counts for SW. All three scoring schemes exhibit a pronounced shift into the higher percentage bins compared to SW, with aligning fewer nucleotides that match fewer genomes (most notably the drop at the 50% mark), and more nucleotides that match in 80-100% of the genomes.

Software availability and requirements

Cola is an object-oriented software written in C++, compiled using gcc, and runs on Linux operating systems. The software is modular and provides a collection of utilities for input data conversion. The source code is designed to be easily configurable allows for easy integration as the back-end into e.g. seed-finding methods, such as BLAST (Stephen F [14]).

The source code is freely available under LPGL. For code usage guide, command line parameters, and output file formats, see website at https://github.com/nedaz/cola.

References

  1. Altschul S, Erickson B: Optimal sequence alignment using affine gap costs. Bull Math Biol. 1986, 48 (5–6): 603-616. doi:10.1016/S0092-8240(86)90010-8

    Article  CAS  PubMed  Google Scholar 

  2. Altschul SF: Generalized affine gap costs for protein sequence alignment. Proteins. 1998, 32 (1): 88-96. 10.1002/(SICI)1097-0134(19980701)32:1<88::AID-PROT10>3.0.CO;2-J.

    Article  CAS  PubMed  Google Scholar 

  3. Gotoh O: An improved algorithm for matching biological sequences. J Mol Biol. 1982, 162 (3): 705-708. 10.1016/0022-2836(82)90398-9.

    Article  CAS  PubMed  Google Scholar 

  4. Miller W, Myers EW: Sequence comparison with concave weighting functions. Bull Math Biol. 1988, 50 (2): 97-120. 10.1007/BF02459948. doi:10.1007/BF02459948

    Article  CAS  PubMed  Google Scholar 

  5. Mott R: Local sequence alignments with monotonic gap penalties. Bioinformatics (Oxford, England). 1999, 15 (6): 455-462. 10.1093/bioinformatics/15.6.455.

    Article  CAS  Google Scholar 

  6. Needleman SB, Wunsch CD: A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol. 1970, 48 (3): 443-453. 10.1016/0022-2836(70)90057-4.

    Article  CAS  PubMed  Google Scholar 

  7. Smith TF, Waterman MS: Identification of common molecular subsequences. J Mol Biol. 1981, 147 (1): 195-197. 10.1016/0022-2836(81)90087-5. doi:10.1016/0022-2836(81)90087-5

    Article  CAS  PubMed  Google Scholar 

  8. Zachariah MA, Crooks GE, Holbrook SR, Brenner SE: A generalized affine gap model significantly improves protein sequence alignment accuracy. Proteins. 2005, 58 (2): 329-338. doi:10.1002/prot.20299

    Article  CAS  PubMed  Google Scholar 

  9. Powell DR, Allison L, Dix TI: A versatile divide and conquer technique for optimal string alignment. Inform Process Lett. 1999, 70 (3): 127-139. 10.1016/S0020-0190(99)00053-8. doi:10.1016/s0020-0190(99)00053-8

    Article  Google Scholar 

  10. Hirschberg DS: A linear space algorithm for computing maximal common subsequences. Commun ACM. 1975, 18 (6): 341-343. 10.1145/360825.360861. doi:10.1145/360825.360861

    Article  Google Scholar 

  11. Grabherr MG, Russell P, Meyer M, Mauceli E, Alföldi J, Di Palma F, Lindblad-Toh K: Genome-wide synteny through highly sensitive sequence alignment: Satsuma. Bioinformatics. 2010, 26 (9): 1145-1151. 10.1093/bioinformatics/btq102. doi:10.1093/bioinformatics/btq102

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  12. Lindblad-Toh K, Wade CM, Mikkelsen TS, Karlsson EK, Jaffe DB, Kamal M, Zody MC: Genome sequence, comparative analysis and haplotype structure of the domestic dog. Nature. 2005, 438 (7069): 803-819. 10.1038/nature04338. doi:10.1038/nature04338

    Article  CAS  PubMed  Google Scholar 

  13. Schwartz S, Kent WJ, Smit A, Zhang Z, Baertsch R, Hardison RC, Miller W: Human-mouse alignments with BLASTZ. Genom Res. 2003, 13 (1): 103-107. 10.1101/gr.809403. doi:10.1101/gr.809403

    Article  CAS  Google Scholar 

  14. Altschul SF: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 1997, 25 (17): 3389-3402. 10.1093/nar/25.17.3389. doi:10.1093/nar/25.17.3389

    Article  PubMed Central  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This work was funded by a start-up grant from the Science for Life Laboratory (MGG), with support from the Bioinformatics Infrastructure for Life Sciences in Sweden (MPH).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Neda Zamani or Manfred G Grabherr.

Additional information

Competing interests

The authors have declared that no competing interests exist.

Authors’ contributions

NZ and MGG designed and developed the software and designed and performed the analyses. MPH, GS, and MGG provided the biological interpretation of the results. All authors wrote the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zamani, N., Sundström, G., Höppner, M.P. et al. Modular and configurable optimal sequence alignment software: Cola. Source Code Biol Med 9, 12 (2014). https://doi.org/10.1186/1751-0473-9-12

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1751-0473-9-12

Keywords