Existence of solutions for a class of nonconcave infinite horizon optimal control problems

In this article, we establish the existence of optimal solutions for a large class of nonconvex infinite horizon discrete-time optimal control problems. This class contains optimal control problems arising in economic dynamics which describe a model with nonconcave utility functions representing the preferences of the planner.     

One-Dimensional Infinite Horizon Nonconcave Optimal Control Problems Arising in Economic Dynamics

We study the existence of optimal solutions for a class of infinite horizon nonconvex autonomous discrete-time optimal control problems. This class contains optimal control problems without discounting arising in economic dynamics which describe a model with a nonconcave utility function.     

Solution of an optimal control problem with phase constraints by the double variation method

An optimal control problem with an integral quality index specified in a finite time interval is formulated for a model of economic growth that leads to emission of greenhouse gases. The controlled system is linear with respect to control. The problem contains phase constraints that abandon emission of greenhouse gases above some predefined time-dependent limit. As is known, optimal control problems with phase constraints fall beyond the sphere of efficient application of the Pontryagin maximum principle because, for such problems, this principle is formulated in a complicated form difficult for analytic treatment in particular situations. In this study, the analytic structure of the optimal control and phase trajectories is constructed using the double variation method.     

Turnpike Results for a Class of Discrete-Time Optimal Control Problems Arising in Economic Dynamics

In this paper we establish turnpike results for a class of discrete-time optimal control problems. These control problems arise in economic dynamics and describe a nonstationary model proposed by Robinson, Solow and Srinivasan. We study the structure of approximate solutions which is independent of the length of the interval, for all sufficiently large intervals.     

On the boundedness of optimal controls in infinite-horizon problems

A class of infinite-horizon optimal control problems that arise in economic applications is considered. A theorem on the nonemptiness and boundedness of the set of optimal controls is proved by the method of finite-horizon approximations and the apparatus of the Pontryagin maximum principle. As an example, a simple model of optimal economic growth with a renewable resource is considered.     

A note on the free terminal time transversality condition

This note clarifies some issues dealing with the necessary condition for the optimal terminal time in free terminal time optimal control problems. It is shown that this condition is independent of the other maximum principle conditions and a simple proof is presented. Also the economic interpretation of the condition is provided.     

Maximum principle for infinite-horizon optimal control problems under weak regularity assumptions

The paper deals with first order necessary optimality conditions for a class of infinite-horizon optimal control problems that arise in economic applications. Neither convergence of the integral utility functional nor local boundedness of the optimal control is assumed. Using the classical needle variations technique we develop a normal form version of the Pontryagin maximum principle with an explicitly specified adjoint variable under weak regularity assumptions. The result generalizes some previous results in this direction. An illustrative economical example is presented.     

Nonlinear optimal control problems of degenerate parabolic equations with logistic time-varying delays of convolution type

In this article, we consider a bioeconomic model for optimal control problems which are governed by degenerate parabolic equations governing diffusive biological species with logistic growth terms and multiple time-varying delays. The time-varying delays are given in a convolution form. The existence, uniqueness and regularity results to the state equations with homogeneous Dirichlet and Neumann boundary conditions are established. The vanishing viscosity method is used to obtain the existence result. Afterwards, we formulate the optimal control problem in two cases. Firstly, we suppose that this biological species causes damage to environment (e.g. forest, agriculture): the optimal control is the trapping rate and the cost functional is a combination of damage and trapping costs. Secondly, an optimal harvesting control of a biological species is considered: the optimal control is a distribution of harvesting effort on the biological species and the cost functional measure the difference between economic revenue and cost. The existence and the condition of uniqueness of the optimal solution are obtained. A nonlinear optimality system is derived, characterizing the optimal control.     

Multi‐area transboundary pollution problems under learning by doing in Yangtze River Delta Region,China

In this paper, we investigate transboundary pollution problems in the Yangtze River Delta Region where emission permits trading and abatement costs under learning by doing. At first, we use the optimal control theory to analyze two‐area transboundary pollution problems and give an empirical study for the Shanghai Municipality and Zhejiang Province by using four‐order Runge‐Kutta method and the authentic economic data. Then, we extend two‐area transboundary pollution problems to three‐area transboundary pollution problems and also give an empirical study by adopting the authentic economic data of Shanghai Municipality, Zhejiang Province, and Jiangsu Province. Finally, we get a similar conclusion that the abatement cost will decrease with the amelioration of abatement technology.     

Optimal Control of Some Simple Deterministic Epidemic Models

Using control variables such as the level of medicare programme effort and the level of inoculation programme effort, three simple mathematical models of epidemics are transformed into optimal control problems. These are multi-state problems with the state variables as numbers of infectives and susceptibles and with the objective function being minimization of the total present value of the social or economic costs of infectives and medical controls. The problems are analysed with the framework of the maximum principle to obtain or, at least, partially characterize the optimal policies over time.     

Cyclical strategies in two-dimensional optimal control models: Necessary conditions and existence

This paper derives necessary conditions such that cyclical policies may be optimal in concave, two state variable (economic) control problems. These conditions identify four different routes. One major implication is that two of these four conditions may be met by separable models. This possibility has been overlooked so far. Therefore, even separable and structurally very simple models may be characterized by optimal cyclical policies. Indeed, it will be shown that stable limit cycles exist for concave and separable control problems.     

Exact solution of Pontryagin's equations of optimal control—Part 1

In the treatment of constrained optimal control processes, it is customary to employ the Pontryagin maximum principle, which requires the solution of a two-point boundary-value problem. Various economic, mechanical, and biological control processes are of this type, including optimization of hemodialysis. Generally speaking, two-point boundary-value problems are more difficult to treat computationally than initial-value or Cauchy problems. In this paper, a Cauchy system is derived for a class of optimal control processes, and it is then shown that the solution of the Cauchy problem satisfies the Pontryagin equations.This research was supported by the National Science Foundation, Grant No. GF-294, and the National Institutes of Health, Grants Nos. GM-16197-01 and GM-16437-01.     

On a class of dynamic programming problems whose optimal controls and states are independent of the future

When applying dynamic programming for optimal decision making one usually needs considerable knowledge about the future. This knowledge, e.g. about future functions and parameters, necessary to determine optimal control policies, however, is often not available and thus precludes the application of dynamic programming.In the present paper it is shown that for a certain class of dynamic programming problems the optimal control policy is independent of the future. To illustrate the results an application in inventory control is given and further applications in the theories of economic growth and corporate finance are listed in the references.     

EQUIVALENCE OF THREE DIFFERENT KINDS OF OPTIMAL CONTROL PROBLEMS FOR STOKES EQUATIONS

This article presents an equivalence theorem for three different kinds of optimal control problems,which are optimal target control problems,optimal norm control problems,and optimal time control problems.Controlled systems in this study are internally controlled Stokes equations.     

Reciprocal Optimal Control Problems and the Associated Pareto Frontier

It is well known that, if a control is Pareto optimal for a multiobjective optimal control problem, then it satisfies the necessary conditions of an optimal control problem with isoperimetric constraints. We introduce a set of sufficient conditions reversing that implication. Thus, we study some properties of the isoperimetric problems and their applications to the analysis of economic models.Research supported by the Ministry of Education, University, and Research of Italy and by the University of Padova.The authors thank the anonymous referee for suggestions that have added clarity to the exposition of the paper.     

On some properties of the adjoint variable in the relations of the Pontryagin maximum principle for optimal economic growth problems

For a class of infinite-horizon optimal control problems that appear in studies on economic growth processes, the properties of the adjoint variable in the relations of the Pontryagin maximum principle, defined by a formula similar to the Cauchy formula for the solutions to linear differential systems, are studied. It is shown that under a dominating discount type condition the adjoint variable defined in this way satisfies both the core relations of the maximum principle (the adjoint system and the maximum condition) in the normal form and the complementary stationarity condition for the Hamiltonian. Moreover, a new economic interpretation of the adjoint variable based on this formula is presented.     

对偶理论在国民经济按比例最优增长分析中的应用

本文根据宏观经济行为和微观经济行为的辩证关系，设计了一类数学模型，并利用该模型研究了国民经济按比例最优增长及其实现问题．基于模型的分析表明．只要政府调控合适，国民经济就能够按比例最优增长．     

On the Optimal Stabilisation for a set of Programmed Motions of the Bilinear Control System

During recent years there has been considerable interest in using bilinear systems [1, 2] as mathematical models to represent the dynamic behavior of a wide class of engineering, biological and economic systems. Moreover, there are some methods [3] which may approximate nonlinear control systems by bilinear systems. For the first time Zubov has proposed a method of stabilization control synthesis for a set of programmed motions in linear systems [4]. In papers [5, 6] this method has been developed and used to solve the same problem for bilinear systems. In the present paper the following problems are considered. First, synthesis of nonlinear control as feedback under which the bilinear control system has a given set of programmed and asymptotic stable motions. Because this control is not unique, the second problem concerns optimal stabilization. In this paper a method for the design of nonlinear optimal control is suggested. This control is constructed in the form of a convergent series. The theorem on the sufficient conditions to solve this problem is represented.     

On necessary optimality conditions for infinite-horizon economic growth problems with locally unbounded instantaneous utility function

We consider a class of infinite-horizon optimal control problems that arise in studying models of optimal dynamic allocation of economic resources. In a typical problem of that kind the initial state is fixed, no constraints are imposed on the behavior of the admissible trajectories at infinity, and the objective functional is given by a discounted improper integral. Earlier, for such problems, S.M. Aseev and A.V. Kryazhimskiy in 2004–2007 and jointly with the author in 2012 developed a method of finite-horizon approximations and obtained variants of the Pontryagin maximum principle that guarantee normality of the problem and contain an explicit formula for the adjoint variable. In the present paper those results are extended to a more general situation where the instantaneous utility function need not be locally bounded from below. As an important illustrative example, we carry out a rigorous mathematical investigation of the transitional dynamics in the neoclassical model of optimal economic growth.     

Optimal Control and the Fibonacci Sequence

We bridge mathematical number theory with optimal control and show that a generalised Fibonacci sequence enters the control function of finite-horizon dynamic optimisation problems with one state and one control variable. In particular, we show that the recursive expression describing the first-order approximation of the control function can be written in terms of a generalised Fibonacci sequence when restricting the final state to equal the steady-state of the system. Further, by deriving the solution to this sequence, we are able to write the first-order approximation of optimal control explicitly. Our procedure is illustrated in an example often referred to as the Brock–Mirman economic growth model.