An Edge Server Placement Method Based on Reinforcement Learning

In mobile edge computing systems, the edge server placement problem is mainly tackled as a multi-objective optimization problem and solved with mixed integer programming, heuristic or meta-heuristic algorithms, etc. These methods, however, have profound defect implications such as poor scalability, local optimal solutions, and parameter tuning difficulties. To overcome these defects, we propose a novel edge server placement algorithm based on deep q-network and reinforcement learning, dubbed DQN-ESPA, which can achieve optimal placements without relying on previous placement experience. In DQN-ESPA, the edge server placement problem is modeled as a Markov decision process, which is formalized with the state space, action space and reward function, and it is subsequently solved using a reinforcement learning algorithm. Experimental results using real datasets from Shanghai Telecom show that DQN-ESPA outperforms state-of-the-art algorithms such as simulated annealing placement algorithm (SAPA), Top-K placement algorithm (TKPA), K-Means placement algorithm (KMPA), and random placement algorithm (RPA). In particular, with a comprehensive consideration of access delay and workload balance, DQN-ESPA achieves up to 13.40% and 15.54% better placement performance for 100 and 300 edge servers respectively.     

NMR imaging of solid polymers: Strategies for chemical-shift selectivity

One reason that the solid-state imaging field is exciting is because of its potential to provide spatially resolved chemical information from deep inside a solid sample. To achieve this goal, methods are needed which exploit the many NMR parameters to generate image contrast. We describe two strategies for employing the chemical-shift anisotropy as a contrast mechanism in images of abundant nuclei in solid polymers. We illustrate these approaches with images which map spatial variations of molecular orientation in samples of polytetrafluoroethylene.     

Design and experimental validation of a nonlinear controller for underactuated surface vessels

Nonlinear Dynamics - This paper addresses the problem of trajectory tracking control of an underactuated surface vessel moving in a two-dimensional space in the presence of unknown disturbances. In...     

Non-Existence of Black Hole Solutions¶for a Spherically Symmetric, Static Einstein–Dirac–Maxwell System

We consider for j=?, … a spherically symmetric, static system of (2j+1) Dirac particles, each having total angular momentum j. The Dirac particles interact via a classical gravitational and electromagnetic field. The Einstein–Dirac–Maxwell equations for this system are derived. It is shown that, under weak regularity conditions on the form of the horizon, the only black hole solutions of the EDM equations are the Reissner–Nordstr?m solutions. In other words, the spinors must vanish identically. Applied to the gravitational collapse of a “cloud” of spin-?-particles to a black hole, our result indicates that the Dirac particles must eventually disappear inside the event horizon. Received: 2 November 1998 / Accepted: 23 February 1999     

Factorizing the complete graph into factors with large star number

The graph G has star number n if any n vertices of G belong to a subgraph which is a star. Let f(n, k) be the smallest number m such that the complete graph on m vertices can be factorized into k factors with star number n. In the present paper we prove that $\text{c}{}_1{}^{\mathrm{n}}\text{k ≤ f(n, k) < c}{}_2{}^{\mathrm{n}}\text{k}$.     

A laser system for high accuracy measurement of small apertures in mechanical parts

A simple, high accuracy small gap measurement system for rough industrial environments was designed and constructed. The system could detect apertures as small as 60 μm with less than 6 μm error in metallic parts with finite (cm range) depth. The principle is based in the transient analysis of transmitted laser intensity which is focused and swept along the region of the gap. The system is composed of a low power visible laser (semiconductor or He–Ne), focusing system, rotating mirror scanner, detection optics and amplifier, control unit for signal processing, speed control and data delivery to the process control unit.     

Clusters,metastability, and nucleation: Kinetics of first-order phase transitions

We describe and interpret computer simulations of the time evolution of a binary alloy on a cubic lattice, with nearest neighbor interactions favoring like pairs of atoms. Initially the atoms are arranged at random; the time evolution proceeds by random interchanges of nearest neighbor pairs, using probabilities compatible with the equilibrium Gibbs distribution at temperatureT. For temperatures 0.59T_c, 0.81 T_c, and 0.89T _c, with density of A atoms equal to that in the B-rich phase at coexistence, the density C₁ of clusters ofl A atoms approximately satisfies the following empirical formulas: C₁ w(1 –)³ andC ₁, (1 –)⁴Q₁w¹ (2 l 10). Herew is a parameter and we defineQ _l = _K e ^–E(K) , where the sum goes over all translationally nonequivalentl-particle clusters andE(K) is the energy of formation of the clusterK. Forl > 10,Q ₁ is not known exactly; so we use an extrapolation formulaQ _l Aw _s ^–l l ^– exp(–bl ), wherew _s is the value ofw at coexistence. The same formula (withw > w _s) also fits the observed values of C, (for small values ofl) at densities greater than the coexistence density (forT=0.59T_c): When the supersaturation is small, the simulations show apparently metastable states, a theoretical estimate of whose lifetime is compatible with the observations. For higher supersaturation the system is observed to undergo a slow process of segregation into two coexisting phases (andw therefore changes slowly with time). These results may be interpreted as a more quantitative formulation (and confirmation) of ideas used in standard nucleation theory. No evidence for a spinodal transition is found.Supported by AFOSR Grant No. 73-2430D and by ERDA Contract No. EY-76-C-02-3077*000.     

Growth of clusters in a first-order phase transition

The results of computer simulations of phase separation kinetics in a binary alloy quenched from a high temperature are analyzed in detail, using the ideas of Lifshitz and Slyozov. The alloy was modeled by a three-dimensional Ising model with Kawasaki dynamics. The temperature after quenching was 0.59T _c, whereT _c is the critical temperature, and the concentration of minority atoms was=0.075, which is about five times their largest possible single-phase equilibrium concentration at that temperature. The time interval covered by our analysis goes from about 1000 to 6000 attempted interchanges per site. The size distribution of small clusters of minority atoms is fitted approximately byc ₁(1-)³ w(t),c ₁ (1–)⁴ Q _l w(t)^l(2l10); wherec _l is the concentration of clusters of sizel;Q ₂,...,Q ₁₀ are known constants, the cluster partition functions;t is the time; andw(t)=0.015(1+7.17t ^–1/3). The distribution of large clusters (l20) is fitted approximately by the type of distribution proposed by Lifshitz and Slyozov,c _l ,(t)=–(d/dl) [lnt+p (l/t)], where is a function given by those authors and is defined by(x)=C _o e–x-C ₁ e ^–4x/3-C ₂ e ^–5x/3;C ₀,C ₁,C ₂ are constants determined by considering how the total number of particles in large clusters changes with time.Supported by the U.S. Air Force Office of Scientific Research under Grant No. 78-3522 and by the U.S. Department of Energy under Contract No. EY-76-C-02-3077*000.