SVAw - a web-based application tool for automated surrogate variable analysis of gene expression studies
Source Code for Biology and Medicine volume 8, Article number: 8 (2013)
Surrogate variable analysis (SVA) is a powerful method to identify, estimate, and utilize the components of gene expression heterogeneity due to unknown and/or unmeasured technical, genetic, environmental, or demographic factors. These sources of heterogeneity are common in gene expression studies, and failing to incorporate them into the analysis can obscure results. Using SVA increases the biological accuracy and reproducibility of gene expression studies by identifying these sources of heterogeneity and correctly accounting for them in the analysis.
Here we have developed a web application called SVAw (Surrogate variable analysis Web app) that provides a user friendly interface for SVA analyses of genome-wide expression studies. The software has been developed based on open source bioconductor SVA package. In our software, we have extended the SVA program functionality in three aspects: (i) the SVAw performs a fully automated and user friendly analysis workflow; (ii) It calculates probe/gene Statistics for both pre and post SVA analysis and provides a table of results for the regression of gene expression on the primary variable of interest before and after correcting for surrogate variables; and (iii) it generates a comprehensive report file, including graphical comparison of the outcome for the user.
SVAw is a web server freely accessible solution for the surrogate variant analysis of high-throughput datasets and facilitates removing all unwanted and unknown sources of variation. It is freely available for use at http://psychiatry.igm.jhmi.edu/sva. The executable packages for both web and standalone application and the instruction for installation can be downloaded from our web site.
Accurate analysis of high-throughput data in molecular biology is complicated because of the presence of underlying factors that cause unwanted heterogeneity in the data. An inherent issue with microarray expression studies is that of artefactual or confounded variation. In addition to the biological factors that are of interest to the researcher, gene expression levels are affected by other factors that are both technical and biological. A typical example is a batch effect, which can occur when some samples are processed differently than others . These heterogeneity factors, also commonly known as batch effect, can range from genetic and environmental variables to demographic factors [2, 3]. The impact of these factors may vary from a deviation in the outcome to potentially completely compromising the statistical or biological validity of a study . The sva method developed by Leek et al.[4, 5] addresses this issue by identifying, estimating and removing unwanted sources of variation in high-throughput experiments. The sva function estimates surrogate variables, which are covariates constructed directly from high-dimensional data, and then uses these variables in downstream analyses such as differential expression analysis. Here we employed the Leek et al. sva algorithm [4, 5] and implemented a web application, called SVAw, to perform fully automated analysis in a user friendly web browser view. SVAw can also be downloaded as a fully functional automated standalone application.
SVAw is a tool that enables researchers to utilize Surrogate Variable Analysis when analyzing high throughput genomic data to capture such heterogeneities in the dataset that can potentially lead to biased analysis of the data. Additionally, the web server makes the Surrogate Variable Analysis more accessible to researchers with no programming background in order to identify and control for potential heterogeneity in their genomics data. The SVAw calculates probe/gene statistics such as the fold change and p-value for both pre (unadjusted) and post sva analysis (adjusted with sva) and generates a comprehensive report, including graphical comparison of the outcome.
A typical gene expression analysis involves identifying differential expressed genes among various experimental conditions. Statistical analysis will usually calculate the magnitude of fold changes as well as measures of statistical significance (p-values). SVAw generates pre- and post-Surrogate variable Analysis p-values and fold changes of the analyzed data. The statistical and graphical visualization of the data before and after the SVA procedure gives the user a clear sense of the extent of heterogeneity in their dataset. In particular, visualization of the data using three different graphical representations: 1) volcano plot; 2) MA plot and 3) histogram of p-values, draws the user’s attention to the different aspects of statistical analysis. The SVAw architecture simplifies the analysis of gene expression data by executing a computational workflow on a set of data uploaded by user. For a midsize dataset (50 samples) SVAw can process up to 1mb of raw data per minute using both the web and standalone applications on a quad core AMD processor with 8GB memory. The SVAw web server is currently able to process up to a 16MB input file size.
Input data: For SVAw, there are two required input files from the user: Expression and Factors file. The expression file is a m x n expression matrix with n arrays for m genes/probesets/probes. Factors file is a m x 2 matrix with m individuals/arrays divided into groups. Column1 is the unique identifier (ID) and column2 is the group status as 1 stand for “Group1 arrays” (for e.g. "cases") and 0 for “Group2” arrays (for e.g. "controls").
Output: SVAw has a comprehensive output. All text files will be in plain-text in tabular format with each row terminated by a new-line character. These files can be easily used in spreadsheet applications and database programs (such as SQL databases) for further analysis. Output files include:
Surrogate_Variable.txt: An m x n matrix with m individuals/arrays and n surrogate variables predicted for the data set by SVAw.
Probe_Statistics.txt: A table of results for regression of gene expression on the primary variable of interest before and after correcting for surrogate variables. This file includes the following columns (fields) for each gene/probesets/probes:
Coefficient unadjusted: linear regression coefficient from the fitted model before sva adjustment.
Fold change: up or down regulated (unadjusted), log2 ratio of mean expression of Group1 (e.g., "cases") vs. Group2 (e.g., "controls") from the fitted model before sva adjustment.
p_unadjusted: p-value for the test of significance comparing the mean expression levels between groups (e.g., Group1 or “cases” vs. Group2 or “controls”) for all genes/probesets/probes from the fitted model before sva adjustment.
surrogate variables included as "covariates" in the linear regression model of gene expression on the primary variable of interest:
Coefficient after sva adjusted.
Fold change: up or down regulated after adjustment with sva
p_adjusted: p-value for the test of significance after sva adjustment
Probe_Statistics_Significants.txt: A subset of the Probe_Statistics.txt table (above) of results by significance (p-value [post-sva] < 0.05). All genes/probesets/probes meeting this criterion are shown in this table.
Unadjusted and Adjusted Graph (Figure 1) files in PNG format: These files contains three plots:
Volcano Plot: Plot to compare the size of the fold change to the statistical significance level. The x axis is the fold change between the two groups (on a log scale) indicating biological impact of the change, and the y axis represents the p-value for a t-test of differences between samples (on a negative log scale) indicating the statistical evidence, or reliability of the change.
MA Plot: M (the intensity ratio) vs. A (the average intensity)
Histogram: Histograms of the unadjusted and the sva adjusted p-values from differential expression analysis
Report.htm: A brief report of the analysis in html format.
We tested the functionality of SVAw using well-known datasets from gene expression experiments with different sizes of inputs, as well as simulated datasets. Some of the datasets include genome-wide expression studies using autopsy brain samples from the Stanley Medical Research Institute (SMRI) comparing bipolar and depression cases and controls. Details of the methods and results are provided online at Metamoodics web resource .
We employed Surrogate variable estimation based on the algorithms in Leek and Storey [4, 7]. The method has been described before. Briefly, the SVA algorithm can be performed in four steps: 1) Removing the signal due to the primary variables of interest and obtain a residual expression matrix and identify signatures of heterogeneity, 2) Identifying the subset of genes that are driving each signature of expression heterogeneity, 3) Building a surrogate variable for each subset of genes, and 4) Including all significant surrogate variables as covariates in regression analyses. Surrogate variables are estimated using either the iteratively re-weighted (IRW) or the two-step surrogate variable analysis algorithm . The basic idea of IRW is to construct a specified number of surrogate variables from a gene expression data set and a fixed model. The two steps function, on the other hand, estimates surrogate variables based on the subset of rows affected by unmodeled dependence [3, 9]. The default method in SVAw is IRW.
Univariate linear regression
Univariate linear regression  analysis is first applied and linear regression coefficients are obtained from the fitted models. We then calculate the log2 ratio (Fold Change (FC)) of mean expression levels for group1 vs. group2 from the fitted model before sva adjustment. P-values for the test of significance for each genes/probesets/probes comparing mean expression levels between the two groups is also estimated from the fitted model before sva adjustment.
Multivariate linear regression
We incorporate the surrogate variables as cofounders and perform multivariate linear regression . FCs and p-values for each genes/probesets/probe are then calculated from the fitted models after the sva adjustment.
Web Server System Architecture
The Web Server is designed and implemented on the basis of two-tier client–server architecture; a presentation layer or front-end and a business layer or back-end. Figure 2 illustrates the core components of the system. Java Servlet container Apache's Jakarta Tomcat application server  has been employed to take advantage of state-of-the-art Java technologies  in order to provide effective client server-side application execution. The front-end web application program (Screenshot shown in Figure 3), constructed based on JQuery , and Java Server Page (JSP) 2.0 technology , is in charge of task submissions and results displays. The back-end program consists of series of servlets  that communicates with system resources and utilities. Several open source applications and technologies [16–19] have been employed to enhance the flexibility and extendibility of this component. Open source R statistical analysis packages [18, 19] are mainly in charge of the data analysis and processing. The web application is hosted on Apache Tomcat web server  on a Red Hat Linux operating system . A war file (Web application ARchive)  format can be downloaded from our website and imported to any Servlet container web server.
Download and install the pre-requirements:
Download and install R package .
Download and install “corpcor” R package :
R CMD INSTALL corpcor_1.6.2.tar.gz
Download and install “qvalue” R package :
R CMD INSTALL qvalue_1.28.0.tar.gz
Download and install “corpcor” R package :
R CMD INSTALL sva_3.1.2.tar.gz
Web application Installation:
Download and install TOMCAT .
Deploy war files into the webapps directory:
SVAw.war is automatically extracted, then becomes available in:
Installation for the standalone application:
Download and install the pre-requirements:
This is the same as section 1.1 (pre-requirements for web application).
Download and install the application
Download and unzip the standalone application:
tar -zxvf SVAw_standalone.tar.gz
The SVAw standalone executable package has been designed and implemented using Shell scripting language. The packages can be run on 32 and 64-bit Linux system. Before running the packages, some essential R packages declared in the download page are needed to be installed in the system.
SVAw is a web-based freely accessible solution for the surrogate variant analysis of high- throughput datasets and should facilitate removing all unwanted and unknown sources of variation. It provides users to analyze gene expression data directly and simply by an easy-to-use browser user interface. Moreover, we also provide executable standalone packages for users to incorporate and build their pipeline locally.
Availability and requirements
Project name: SVAw (Surrogate variable analysis Web app)
Project home page: http://psychiatry.igm.jhmi.edu/sva
Operating system(s): Platform independent
Programming language: Java 1.5.0 or higher, R v2.10 or higher
Other requirements: Tomcat 5.5 or higher, supported web browsers: Firefox3+, chrome, safari3+, Internet Explorer8+
License: GNU GPL
Any restrictions to use by non-academics: none
Gagnon-Bartsch JA, Speed TP: Using control genes to correct for unwanted variation in microarray data. Biostatistics. 2012, 13 (3): 539-552. 10.1093/biostatistics/kxr034.
Leek JT, Scharpf RB, Bravo HC, Simcha D, Langmead B, Johnson WE, Geman D, Baggerly K, Irizarry RA: Tackling the widespread and critical impact of batch effects in high-throughput data. Nat Rev Genet. 2010, 11 (10): 733-739. 10.1038/nrg2825.
Teschendorff AE, Zhuang J, Widschwendter M: Independent surrogate variable analysis to deconvolve confounding factors in large-scale microarray profiling studies. Bioinformatics. 2011, 27 (11): 1496-1505. 10.1093/bioinformatics/btr171.
Leek JT, Storey JD: Capturing heterogeneity in gene expression studies by surrogate variable analysis. PLoS Genet. 2007, 3 (9): 1724-1735.
Leek JT, Johnson WE, Parker HS, Jaffe AE, Storey JD: The sva package for removing batch effects and other unwanted variation in high-throughput experiments. Bioinformatics. 2012, 28 (6): 882-883. 10.1093/bioinformatics/bts034.
Pirooznia M, Seifuddin F, Judy J, Goes FS, Zandi PP: Metamoodics: An Integrated Web Resource For Systematic Meta-Analysis Of Genetic Association Studies In Mood Disorders.http://metamoodics.org.
Leek JT, Storey JD: A general framework for multiple testing dependence. Proc Natl Acad Sci USA. 2008, 105 (48): 18718-18723. 10.1073/pnas.0808709105.
Storey JD, Akey JM, Kruglyak L: Multiple locus linkage analysis of genomewide expression in yeast. PLoS Biol. 2005, 3 (8): e267-10.1371/journal.pbio.0030267.
Gibson G: The environmental contribution to gene expression profiles. Nat Rev Genet. 2008, 9 (8): 575-581. 10.1038/nrg2383.
Draper NR, Smith H: Applied Regression Analysis. 1998, Hoboken, NJ: Wiley-Interscience
Java programming language.http://www.oracle.com/technetwork/java/index.html.
JavaServer Pages Technology.http://www.oracle.com/technetwork/java/javaee/jsp/.
Java Servlet Technology.http://www.oracle.com/technetwork/java/index-jsp-135475.html.
Visne I, Dilaveroglu E, Vierlinger K, Lauss M, Yildiz A, Weinhaeusel A, Noehammer C, Leisch F, Kriegner A: RGG: a general GUI Framework for R scripts. BMC Bioinforma. 2009, 10: 74-10.1186/1471-2105-10-74.
Newton R, Deonarine A, Wernisch L: Creating web applications for spatial epidemiological analysis and mapping in R using Rwui. Source code for biology and medicine. 2011, 6 (1): 6-10.1186/1751-0473-6-6.
The R Project for Statistical Computing.http://www.r-project.org/.
The Bioconductor project.http://www.bioconductor.org/.
The Apache HTTP Server Project.http://httpd.apache.org/.
Red Hat® Enterprise Linux® servers.http://www.redhat.com/products/enterprise-linux/.
WAR file format. http://en.wikipedia.org/wiki/WAR_file_format_(Sun)
corpcor R package.http://strimmerlab.org/software/corpcor/.
qvalue: Q-value estimation for false discovery rate control.http://www.bioconductor.org/packages/release/bioc/html/qvalue.html.
This project is supported by the National Institutes of Health (K01-MH093809 to M.P.), (R01-MH083738 to P.P.Z.).
The authors declare that they have no competing interests.
MP, JTK and PPZ conceived and designed the project. MP and FS wrote and ran the algorithms. MP constructed and designed the web-server and coded the web application. FS performed the experimental analysis. MP, FSG and PPZ directed to project. All authors read, contributed to and approved the final manuscript.
About this article
Cite this article
Pirooznia, M., Seifuddin, F., Goes, F.S. et al. SVAw - a web-based application tool for automated surrogate variable analysis of gene expression studies. Source Code Biol Med 8, 8 (2013). https://doi.org/10.1186/1751-0473-8-8