Comparison of different search engines using validated MS/MS test datasets

Massive amounts of tandem mass spectra are produced in high-throughput proteomics studies. The manual interpretation of these spectra is not feasible. Instead, search engines are used to match the tandem mass spectra with sequence information contained in proteomics and genomics databases. Typically, these search engines provide a list of the best matching peptide sequences for an individual tandem mass spectrum. As well, they provide scores that are somewhat related to the confidence level in the match. Many peptide tandem mass spectra search engines have been reported. These search engines provide very different results depending on the type of mass spectrometers used and their input parameters. Here we describe a comparative analysis of different search engines using validated test sets of tandem mass spectra. We have defined test sets of MS/MS spectra derived from high throughput proteomics experiments performed by HPLC-ESI-MS/MS on ion trap (LCQ) and tandem quadrupole time-of-flight instruments with a pulsar functionality (Qstar Pulsar) mass spectrometers. We analyzed the ability of the different search engines to identify the correct peptides, and the cross-validations of the different search engines.