Truncated Newton method for sparse unconstrained optimization using automatic differentiation

When solving large complex optimization problems, the user is faced with three major problems. These are (i) the cost in human time in obtaining accurate expressions for the derivatives involved; (ii) the need to store second derivative information; and (iii), of lessening importance, the time taken to solve the problem on the computer. For many problems, a significant part of the latter can be attributed to solving Newton-like equations. In the algorithm described, the equations are solved using a conjugate direction method that only needs the Hessian at the current point when it is multiplied by a trial vector. In this paper, we present a method that finds this product using automatic differentiation while only requiring vector storage. The method takes advantage of any sparsity in the Hessian matrix and computes exact derivatives. It avoids the complexity of symbolic differentiation, the inaccuracy of numerical differentiation, the labor of finding analytic derivatives, and the need for matrix store. When far from a minimum, an accurate solution to the Newton equations is not justified, so an approximate solution is obtained by using a version of Dembo and Steihaug's truncated Newton algorithm (Ref. 1).This paper was presented at the SIAM National Meeting, Boston, Massachusetts, 1986.     

应用自动微分的Newton-PCG算法

一类新的使用符号微分的Newton-PCG型算法在文献[1]和[2]被导出来了。本文建立和研究应用自动微分的相应的Newton-PCG算法，理论分析和数值实验结果显示应用自动微分之后，目标函数的维数或复杂性越大，Newton-PCG算法对Newton法的改进越显著。     

Robust Speed Control of a Low Damped Electromechanical System Based on CRONE Control: Application to a Four Mass Experimental Test Bench

Robust speed control of a low damped electromechanical system with backlash is studied, controlled load angular speed being not measured. The proposed control strategy combines a Luenberger observer (load angular speed and load torque disturbance estimations) and a robust CRONE controller. The observer provides estimation of the load angular speed and of the disturbance torque applied on the load. Through the computation of only three independent parameters (as many as a PID controller), the CRONE controller permits to ensure the robust speed control of the load in spite of plant parametric variations and speed observation errors. The proposed control strategy is applied to a four mass experimental test bench.     

Impact of Partial Separability on Large-Scale Optimization

ELSO is an environment for the solution oflarge-scale optimization problems. With ELSO the user is required to provide only code for the evaluation of a partially separable function. ELSO exploits the partialseparability structure of the function to computethe gradient efficiently using automatic differentiation.We demonstrate ELSO's efficiency by comparing thevarious options available in ELSO.Our conclusion is that the hybrid option in ELSOprovides performance comparable to the hand-coded option, while having the significantadvantage of not requiring a hand-coded gradient orthe sparsity pattern of the partially separable function.In our test problems, which have carefully coded gradients,the computing time for the hybrid AD option is within a factor of two of thehand-coded option.     

Solid phase synthesis of azapeptides using an automatic synthesizer

Peptides containing azaglycine located terminally or within the backbone have been prepared in the solid phase by means of an automatic synthesizer.     

A Supergene Differentiation Model for Orebearing Granitic Magma

According to the features of geophysics, experimental petrology, granite geology and geochemistry, the differentiations of ore-bearing granitic magmas are discussed. It is put forward that only the supergene differentiations of ore-bearing granitic magma might exist, instead of the hypogene one of the magma. Based on it, a supergene differentiation model for the ore-bearlng granitic magma is presented.     

屋顶绿化的自动灌溉系统设计

屋顶绿化对提高城市空气质量、减少“热岛效应”、改善居住环境有积极的意义，但其灌溉环节与普通园林绿化灌溉相比有更高的要求．为了增强屋顶灌溉的科学性，根据其特点提出了建立自动灌溉系统的设想，并对灌溉过程建立了混杂自动机模型，从离散事件动态系统与连续变量动态系统的角度共同描述了自动灌溉的过程，最后给出了自动灌溉系统的工程设计方案，对屋顶绿化自动化、精细化程度的提高具有一定的启示意义．     

书籍扫描图像畸变参数自动计算方法的研究

为实现书籍扫描图像的畸变自动校正,提出用多项式来描述各像素的理论灰度g(zi)与页面上对应点到扫描仪工作平面距离zi二者之间的关系。为确立该多项式,在畸变参数已知条件下扫描一幅图像,根据已知畸变参数求出zi,即可按最小二乘法原理由各像素灰度的实际值求出多项式的各个系数。实验证明,采用4阶多项式已能满足一般要求,并求出了各系数。对任意扫描图像,自动计算畸变参数的方法为:首先利用扫描图像上页边空白处各像素的灰度,对畸变参数进行估计,并求出zi的估计值;然后代入所确立的多项式,可求得g(zi);通过调整各畸变参数的估计值,直到g(zi)与gi最为接近,即得最佳畸变参数。用于图像校正实验,获得了较好的校正效果,最大误差由不校正时的41%下降到了6.9%。这使得无需用户测量并输入有关畸变参数即可进行自动校正。