Folding simulations with novel conformational search method

A novel scheme for fast conformational search has been developed by combining the replica exchange method (REM) with the generalized effective potential concept. The new method, referred to Q-REM [S. Jang et al. Phys. Rev. Lett. 91, 058305 (2003)], is expected to provide a useful alternative to the conventional REM for effective conformational sampling of complex systems. The authors have performed folding simulations of the Trp-cage miniprotein using Q-REM. All atom level simulations with generalized Born solvent access-area solvation model show that successful folding can be observed with much smaller number of replicas in Q-REM compared to the conventional REM. It can be concluded that the new method has potential to significantly improve sampling efficiency, allowing simulations of more challenging systems.     

Coulomb replica‐exchange method: Handling electrostatic attractive and repulsive forces for biomolecules

We propose a new type of the Hamiltonian replica‐exchange method (REM) for molecular dynamics (MD) and Monte Carlo simulations, which we refer to as the Coulomb REM (CREM). In this method, electrostatic charge parameters in the Coulomb interactions are exchanged among replicas while temperatures are exchanged in the usual REM. By varying the atom charges, the CREM overcomes free‐energy barriers and realizes more efficient sampling in the conformational space than the REM. Furthermore, this method requires only a smaller number of replicas because only the atom charges of solute molecules are used as exchanged parameters. We performed Coulomb replica‐exchange MD simulations of an alanine dipeptide in explicit water solvent and compared the results with those of the conventional canonical, replica exchange, and van der Waals REMs. Two force fields of AMBER parm99 and AMBER parm99SB were used. As a result, the CREM sampled all local‐minimum free‐energy states more frequently than the other methods for both force fields. Moreover, the Coulomb, van der Waals, and usual REMs were applied to a fragment of an amyloid‐β peptide (Aβ) in explicit water solvent to compare the sampling efficiency of these methods for a larger system. The CREM sampled structures of the Aβ fragment more efficiently than the other methods. We obtained β‐helix, α‐helix, 3₁₀‐helix, β‐hairpin, and β‐sheet structures as stable structures and deduced pathways of conformational transitions among these structures from a free‐energy landscape. © 2012 Wiley Periodicals, Inc.     

Sampling enhancement for the quantum mechanical potential based molecular dynamics simulations: a general algorithm and its extension for free energy calculation on rugged energy surface

An approach is developed in the replica exchange framework to enhance conformational sampling for the quantum mechanical (QM) potential based molecular dynamics simulations. Importantly, with our enhanced sampling treatment, a decent convergence for electronic structure self-consistent-field calculation is robustly guaranteed, which is made possible in our replica exchange design by avoiding direct structure exchanges between the QM-related replicas and the activated (scaled by low scaling parameters or treated with high "effective temperatures") molecular mechanical (MM) replicas. Although the present approach represents one of the early efforts in the enhanced sampling developments specifically for quantum mechanical potentials, the QM-based simulations treated with the present technique can possess the similar sampling efficiency to the MM based simulations treated with the Hamiltonian replica exchange method (HREM). In the present paper, by combining this sampling method with one of our recent developments (the dual-topology alchemical HREM approach), we also introduce a method for the sampling enhanced QM-based free energy calculations.     

Coupling of replica exchange simulations to a non-Boltzmann structure reservoir

Computing converged ensemble properties remains challenging for large biomolecules. Replica exchange molecular dynamics (REMD) can significantly increase the efficiency of conformational sampling by using high temperatures to escape kinetic traps. Several groups, including ours, introduced the idea of coupling replica exchange to a pre-converged, Boltzmann-populated reservoir, usually at a temperature higher than that of the highest temperature replica. This procedure reduces computational cost because the long simulation times needed for extensive sampling are only carried out for a single temperature. However, a weakness of the approach is that the Boltzmann-weighted reservoir can still be difficult to generate. We now present the idea of employing a non-Boltzmann reservoir, whose structures can be generated through more efficient conformational sampling methods. We demonstrate that the approach is rigorous and derive a correct statistical mechanical exchange criterion between the reservoir and the replicas that drives Boltzmann-weighted probabilities for the replicas. We test this approach on the trpzip2 peptide and demonstrate that the resulting thermal stability profile is essentially indistinguishable from that obtained using very long (>100 ns) standard REMD simulations. The convergence of this reservoir-aided REMD is significantly faster than for regular REMD. Furthermore, we demonstrate that modification of the exchange criterion is essential; REMD simulations using a standard exchange function with the non-Boltzmann reservoir produced incorrect results.     

Serial replica exchange

Parallel tempering (or the replica exchange method (REM)) is a powerful method for speeding up the sampling of conformational states of systems with rough energy landscapes, like proteins, where stable conformational states can be separated by large energy barriers. The usual implementation of the REM is performed on local computer clusters (or parallel processors) where the different replicas must be run synchronously. Here, we present serial replica exchange (SREM), a method that is equivalent to the standard REM in terms of efficiency yet runs asynchronously on a distributed network of computers. A second advantage is the method's greatly enhanced fault tolerance, which enables the study of biological systems on worldwide distributed computing environments, such as Folding@Home. For proof of concept, we apply the SREM to a single alanine dipeptide molecule in explicit water. We show that the SREM reproduces the thermodynamic and structural properties determined by the REM.     

Comparison of two adaptive temperature-based replica exchange methods applied to a sharp phase transition of protein unfolding-folding

Temperature-based replica exchange (T-ReX) enhances sampling of molecular dynamics simulations by autonomously heating and cooling simulation clients via a Metropolis exchange criterion. A pathological case for T-ReX can occur when a change in state (e.g., folding to unfolding of a protein) has a large energetic difference over a short temperature interval leading to insufficient exchanges amongst replica clients near the transition temperature. One solution is to allow the temperature set to dynamically adapt in the temperature space, thereby enriching the population of clients near the transition temperature. In this work, we evaluated two approaches for adapting the temperature set: a method that equalizes exchange rates over all neighbor temperature pairs and a method that attempts to induce clients to visit all temperatures (dubbed "current maximization") by positioning many clients at or near the transition temperature. As a test case, we simulated the 57-residue SH3 domain of alpha-spectrin. Exchange rate equalization yielded the same unfolding-folding transition temperature as fixed-temperature ReX with much smoother convergence of this value. Surprisingly, the current maximization method yielded a significantly lower transition temperature, in close agreement with experimental observation, likely due to more extensive sampling of the transition state.     

How hot? Systematic convergence of the replica exchange method using multiple reservoirs

We have devised a systematic approach to converge a replica exchange molecular dynamics simulation by dividing the full temperature range into a series of higher temperature reservoirs and a finite number of lower temperature subreplicas. A defined highest temperature reservoir of equilibrium conformations is used to help converge a lower but still hot temperature subreplica, which in turn serves as the high‐temperature reservoir for the next set of lower temperature subreplicas. The process is continued until an optimal temperature reservoir is reached to converge the simulation at the target temperature. This gradual convergence of subreplicas allows for better and faster convergence at the temperature of interest and all intermediate temperatures for thermodynamic analysis, as well as optimizing the use of multiple processors. We illustrate the overall effectiveness of our multiple reservoir replica exchange strategy by comparing sampling and computational efficiency with respect to replica exchange, as well as comparing methods when converging the structural ensemble of the disordered Aβ_21‐30 peptide simulated with explicit water by comparing calculated Rotating Overhauser Effect Spectroscopy intensities to experimentally measured values. © 2009 Wiley Periodicals, Inc. J Comput Chem 31: 620–627, 2010     

Replica exchange with solute tempering: efficiency in large scale systems

We apply the recently developed replica exchange with solute tempering (REST) to three large solvated peptide systems: an alpha-helix, a beta-hairpin, and a TrpCage, with these peptides defined as the "central group". We find that our original implementation of REST is not always more efficient than the replica exchange method (REM). Specifically, we find that exchanges between folded (F) and unfolded (U) conformations with vastly different structural energies are greatly reduced by the nonappearance of the water self-interaction energy in the replica exchange acceptance probabilities. REST, however, is expected to remain useful for a large class of systems for which the energy gap between the two states is not large, such as weakly bound protein-ligand complexes. Alternatively, a shell of water molecules can be incorporated into the central group, as discussed in the original paper.     

Convergence and sampling efficiency in replica exchange simulations of peptide folding in explicit solvent

Replica exchange methods (REMs) are increasingly used to improve sampling in molecular dynamics (MD) simulations of biomolecular systems. However, despite having been shown to be very effective on model systems, the application of REM in complex systems such as for the simulation of protein and peptide folding in explicit solvent has not been objectively tested in detail. Here we present a comparison of conventional MD and temperature replica exchange MD (T-REMD) simulations of a beta-heptapeptide in explicit solvent. This system has previously been shown to undergo reversible folding on the time scales accessible to MD simulation and thus allows a direct one-to-one comparison of efficiency. The primary properties compared are the free energy of folding and the relative populations of different conformers as a function of temperature. It is found that to achieve a similar degree of precision T-REMD simulations starting from a random set of initial configurations were approximately an order of magnitude more computationally efficient than a single 800 ns conventional MD simulation for this system at the lowest temperature investigated (275 K). However, whereas it was found that T-REMD simulations are more than four times more efficient than multiple independent MD simulations at one temperature (300 K) the actual increase in conformation sampling was only twofold. The overall gain in efficiency using REMD resulted primarily from the ordering of different conformational states over temperature, as opposed to a large increase of conformational sampling. It is also shown that in this system exchanges are accepted primarily based on (random) fluctuations within the solvent and are not strongly correlated with the instantaneous peptide conformation raising questions in regard to the efficiency of T-REMD in larger systems.     

The temperature intervals with global exchange of replicas empirical accelerated sampling method: parameter sensitivity and extension to a complex molecular system

The recently developed "temperature intervals with global exchange of replicas" (TIGER2) algorithm is an efficient replica-exchange sampling algorithm that provides the freedom to specify the number of replicas and temperature levels independently of the size of the system and temperature range to be spanned, thus making it particularly well suited for sampling molecular systems that are considered to be too large to be sampled using conventional replica exchange methods. Although the TIGER2 method is empirical in nature, when appropriately applied it is able to provide sampling that satisfies the balance condition and closely approximates a Boltzmann-weighted ensemble of states. In this work, we evaluated the influence of factors such as temperature range, temperature spacing, replica number, and sampling cycle design on the accuracy of a TIGER2 simulation based on molecular dynamics simulations of alanine dipeptide in implicit solvent. The influence of these factors is further examined by calculating the properties of a complex system composed of the B1 immunoglobulin-binding domain of streptococcal protein G (protein G) in aqueous solution. The accuracy of a TIGER2 simulation is particularly sensitive to the maximum temperature level selected for the simulation. A method to determine the appropriate maximum temperature level to be used in a TIGER2 simulation is presented.     

A divide-and-conquer strategy to improve diffusion sampling in generalized ensemble simulations

Generalized ensemble simulations generally suffer from the associated diffusion-sampling problem; the increased entropic barrier can greatly abolish sampling efficiency, in particular, with the increase of number of degrees of freedom in the target conformational space. Taking advantage of the recent simulated scaling method, we formulate a divide-and-conquer sampling strategy to solve this problem so as to robustly improve the sampling efficiency in generalized ensemble simulations. In the present method, the target conformational space sampling enhancement is decomposed to the sampling enhancements of several subconformational regions, and multiple independent SS simulations are performed to establish the individual sampling enhancement for each of the subconformational regions; in order to realize the global importance sampling, structure exchanges among these replicas are performed based on the Monte Carlo acceptance/rejection procedure. As demonstrated in our studies, the present divide-and-conquer sampling algorithm, named by us as "simulated scaling based variant Hamiltonian replica exchange method," has superior sampling capability so as to possibly play an essential role in dealing with the present bottleneck of generalized ensemble method developments: the system size limitations.     

Replica exchange with nonequilibrium switches: enhancing equilibrium sampling by increasing replica overlap

We describe a replica exchange strategy where trial swap configurations are generated by nonequilibrium switching simulations. By devoting simulation time to the switching simulations, one can systematically increase an effective overlap between replicas, which leads to an increased exchange acceptance rate and less correlated equilibrium samples. In this paper, we derive our method for a general class of stochastic dynamics, and discuss various strategies for enhancing replica overlap through novel dynamical schemes and prudent choices of switching protocols. We then demonstrate our method on a model system of alanine dipeptide in implicit solvent, characterizing decreases in data correlations and gains in sampling efficiency.     

Modified replica exchange simulation methods for local structure refinement

Parallel tempering, also known as replica exchange molecular dynamics (REMD), has recently been successfully used to study the structure and thermodynamic properties of biomolecules such as peptides and small proteins. For large systems, however, applying REMD can be costly since the number of replicas needed increases as the square root of the number of degrees of freedom in the system. Often, enhanced sampling is only needed for a subset of atoms, such as a loop region of a large protein or a small ligand binding to a receptor. In such applications, it is often reasonable to assume a weak dependence of the structure of the larger region on the instantaneous conformation of the smaller region of interest. For these cases, we derived two variant replica exchange methods, partial replica exchange molecular dynamics (PREMD) and local replica exchange molecular dynamics (LREMD). The Hamiltonian for the system is separated, with replica exchange carried out only for terms involving the subsystem of interest while the remainder of the system is maintained at a single temperature. The number of replicas required for efficient exchange thus depends on the number of degrees of freedom in the fragment needing refinement rather than on the size of the full system. The method can be applied to much larger systems than was previously practical. This also provides a means to preserve the integrity of the structure outside the refinement region without introduction of restraints. LREMD takes this weak coupling approximation a step further, employing only a single representation of the large fragment that simultaneously interacts with all of the replicas of the subsystem of interest. This is obtained by combining replica exchange with the locally enhanced sampling approximation (LES), reducing the computational expense of replica exchange simulations to near that of a single standard molecular dynamics (MD) simulation. Use of LREMD also permits the use of LES without requiring the specification of a single temperature, a known difficulty for standard LES simulations. We tested these two methods on the loop region of an RNA hairpin model system and find significant advantages over standard MD and REMD simulations.     

Exchange frequency in replica exchange molecular dynamics

The effect of the exchange-attempt frequency on sampling efficiency is studied in replica exchange molecular dynamics (REMD). We show that sampling efficiency increases with increasing exchange-attempt frequency. This conclusion is contrary to a commonly expressed view in REMD. Five peptides (1-21 residues long) are studied with a spectrum of exchange-attempt rates. Convergence rates are gauged by comparing ensemble properties between fixed length test REMD simulations and longer reference simulations. To show the fundamental correlation between exchange frequency and convergence time, a simple model is designed and studied, displaying the same basic behavior of much more complex systems.     

Replica exchanging self-guided Langevin dynamics for efficient and accurate conformational sampling

This work presents a replica exchanging self-guided Langevin dynamics (RXSGLD) simulation method for efficient conformational searching and sampling. Unlike temperature-based replica exchanging simulations, which use high temperatures to accelerate conformational motion, this method uses self-guided Langevin dynamics (SGLD) to enhance conformational searching without the need to elevate temperatures. A RXSGLD simulation includes a series of SGLD simulations, with simulation conditions differing in the guiding effect and∕or temperature. These simulation conditions are called stages and the base stage is one with no guiding effect. Replicas of a simulation system are simulated at the stages and are exchanged according to the replica exchanging probability derived from the SGLD partition function. Because SGLD causes less perturbation on conformational distribution than high temperatures, exchanges between SGLD stages have much higher probabilities than those between different temperatures. Therefore, RXSGLD simulations have higher conformational searching ability than temperature based replica exchange simulations. Through three example systems, we demonstrate that RXSGLD can generate target canonical ensemble distribution at the base stage and achieve accelerated conformational searching. Especially for large systems, RXSGLD has remarkable advantages in terms of replica exchange efficiency, conformational searching ability, and system size extensiveness.     

An integrate-over-temperature approach for enhanced sampling

A simple method is introduced to achieve efficient random walking in the energy space in molecular dynamics simulations which thus enhances the sampling over a large energy range. The approach is closely related to multicanonical and replica exchange simulation methods in that it allows configurations of the system to be sampled in a wide energy range by making use of Boltzmann distribution functions at multiple temperatures. A biased potential is quickly generated using this method and is then used in accelerated molecular dynamics simulations.     

Solid-solid structural transformations in Lennard-Jones clusters: accurate simulations versus the harmonic superposition approximation

We consider systems undergoing very-low-temperature solid-solid transitions associated with minima of similar energy but different symmetry, and separated by a high potential barrier. In such cases the well-known "broken-ergodicity" problem is often difficult to overcome, even using the most advanced Monte Carlo (MC) techniques, including the replica exchange method (REM). The methodology that we develop in this paper is suitable for the above specified cases and is numerically accurate and efficient. It is based on a new MC move implemented within the REM framework, in which trial points are generated analytically using an auxiliary harmonic superposition system that mimics well the true system at low temperatures. Due to the new move, the low-temperature random walks are able to frequently switch the relevant potential energy funnels leading to an efficient sampling. Numerically accurate results are obtained for a number of Lennard-Jones clusters, including those that have so far been treated only by the harmonic superposition approximation (HSA). The latter is believed to provide good estimates for low-temperature equilibrium properties but is manifestly uncontrollable and is difficult to validate. The present results provide a good test for the HSA and demonstrate its reliability, particularly for estimation of the solid-solid transition temperatures in most cases considered.     

Hamiltonian replica‐permutation method and its applications to an alanine dipeptide and amyloid‐β(29–42) peptides

We propose the Hamiltonian replica‐permutation method (RPM) (or multidimensional RPM) for molecular dynamics and Monte Carlo simulations, in which parameters in the Hamiltonian are permuted among more than two replicas with the Suwa‐Todo algorithm. We apply the Coulomb RPM, which is one of realization of the Hamiltonian RPM, to an alanine dipeptide and to two amyloid‐β(29–42) molecules. The Hamiltonian RPM realizes more efficient sampling than the Hamiltonian replica‐exchange method. We illustrate the protein misfolding funnel of amyloid‐β(29–42) and reveal its dimerization pathways. © 2013 Wiley Periodicals, Inc.     

Replica exchange with guided annealing for accelerated sampling of disordered protein conformations

We critically examine a recently proposed convective replica exchange (cRE) method for enhanced sampling of protein conformation based on theoretical and numerical analysis. The results demonstrate that cRE and related replica exchange with guided annealing (RE‐GA) schemes lead to unbalanced exchange attempt probabilities and break detailed balance whenever the system undergoes slow conformational transitions (relative to the temperature diffusion timescale). Nonetheless, numerical simulations suggest that approximate canonical ensembles can be generated for systems with small conformational transition barriers. This suggests that RE‐GA maybe suitable for simulating intrinsically disordered proteins, an important class of newly recognized functional proteins. The efficacy of RE‐GA is demonstrated by calculating the conformational ensembles of intrinsically disordered kinase inducible domain protein. The results show that RE‐GA helps the protein to escape nonspecific compact states more efficiently and provides several fold speedups in generating converged and largely correct ensembles compared to the standard temperature RE. © 2014 Wiley Periodicals, Inc.     

A convective replica‐exchange method for sampling new energy basins

Replica‐exchange is a powerful simulation method for sampling the basins of a rugged energy landscape. The replica‐exchange method's sampling is efficient because it allows replicas to perform round trips in temperature space, thereby visiting both low and high temperatures in the same simulation. However, replicas have a diffusive walk in temperature space, and the round trip rate decreases significantly with the system size. These drawbacks make convergence of the simulation even more difficult than it already is when bigger systems are tackled. Here, we present a simple modification of the exchange method. In this method, one of the replicas steadily raises or lowers its temperature. We tested the convective replica‐exchange method on three systems of varying complexity: the alanine dipeptide in implicit solvent, the GB1 β‐hairpin in explicit solvent and the Aβ_25–35 homotrimer in a coarse grained representation. For the highly frustrated Aβ_25–35 homotrimer, the proposed “convective” replica‐exchange method is twice as fast as the standard method. It discovered 24 out of 27 free‐energy basins in less than 500 ns. It also prevented the formation of groups of replicas that usually form on either side of an exchange bottleneck, leading to a more efficient sampling of new energy basins than in the standard method. © 2012 Wiley Periodicals, Inc.