Electricity price forecasting accounting for renewable energies: optimal combined forecasts

Electricity price forecasting is an interesting problem for all the agents involved in electricity market operation. For instance, every profit maximisation strategy is based on the computation of accurate one-day-ahead forecasts, which is why electricity price forecasting has been a growing field of research in recent years. In addition, the increasing concern about environmental issues has led to a high penetration of renewable energies, particularly wind. In some European countries such as Spain, Germany and Denmark, renewable energy is having a deep impact on the local power markets. In this paper, we propose an optimal model from the perspective of forecasting accuracy, and it consists of a combination of several univariate and multivariate time series methods that account for the amount of energy produced with clean energies, particularly wind and hydro, which are the most relevant renewable energy sources in the Iberian Market. This market is used to illustrate the proposed methodology, as it is one of those markets in which wind power production is more relevant in terms of its percentage of the total demand, but of course our method can be applied to any other liberalised power market. As far as our contribution is concerned, first, the methodology proposed by García-Martos et al (2007 and 2012) is generalised twofold: we allow the incorporation of wind power production and hydro reservoirs, and we do not impose the restriction of using the same model for 24?h. A computational experiment and a Design of Experiments (DOE) are performed for this purpose. Then, for those hours in which there are two or more models without statistically significant differences in terms of their forecasting accuracy, a combination of forecasts is proposed by weighting the best models (according to the DOE) and minimising the Mean Absolute Percentage Error (MAPE). The MAPE is the most popular accuracy metric for comparing electricity price forecasting models. We construct the combination of forecasts by solving several nonlinear optimisation problems that allow computation of the optimal weights for building the combination of forecasts. The results are obtained by a large computational experiment that entails calculating out-of-sample forecasts for every hour in every day in the period from January 2007 to December 2009. In addition, to reinforce the value of our methodology, we compare our results with those that appear in recent published works in the field. This comparison shows the superiority of our methodology in terms of forecasting accuracy.     

A systematic comparison of professional exchange rate forecasts with the judgemental forecasts of novices

Professional forecasters in foreign exchange markets are not able to beat naive forecasts. In order to find reasons for this phenomenon we compare the empirical forecasts of experts with the experimentally generated forecasts of novices for the EUR/USD exchange rate in three different forecast horizons. Although the subjects are only provided with the realizations of the exchange rate and are not supported by any statistical procedures they outperform experts in accuracy. Professionals consistently expect a reversal of forgoing exchange rate changes whereas novices extrapolate trends. The judgemental forecasts appear to be unbiased and professionals appear to be biased. We demonstrate that professionals are influenced by the fundamental value—an irrelevant anchor in speculative exchange markets. The poor performance of the experts is not a common failure of human decision-making in market environments but caused by misleading information.     

On the role of heterogeneous and imperfect information in a laboratory financial market

In this paper, we analyze the behavior of a group of heterogeneously informed investors in an laboratory asset market. Our experimental setting is inspired by Huber et al. (On the benefit of information in markets with heterogeneously informed traders: an experimental study, 2004). However, instead of their system of cumulative and exogenously given information structure, we introduce an information market where the traders can buy an imperfect prediction of the future value of the dividend with a maximum anticipation of four periods. The accuracy of the prediction decreases with the chosen time horizon, whereas its price remains constant. Our results confirm a non-strictly monotonic increasing value of the information.     

Asymptotic arbitrage in large financial markets with friction

In the modern version of arbitrage pricing theory suggested by Kabanov and Kramkov the fundamental financially meaningful concept is an asymptotic arbitrage. The ??real world?? large market is represented by a sequence of ??models?? and, though each of them is arbitrage free, investors may obtain non-risky profits in the limit. Mathematically, absence of the asymptotic arbitrage is expressed as contiguity of envelopes of the sets of equivalent martingale measures and objective probabilities. The classical theory deals with frictionless markets. In the present paper we extend it to markets with transaction costs. Assuming that each model admits consistent price systems, we relate them with families of probability measures and consider their upper and lower envelopes. The main result concerns the necessary and sufficient conditions for absence of asymptotic arbitrage opportunities of the first and second kinds expressed in terms of contiguity. We provide also more specific conditions involving Hellinger processes and give applications to particular models of large financial markets.     

Expectation formation in an experimental foreign exchange market

Participants of an experimental foreign exchange market forecast an exchange rate with an unknown price reaction function. Aggregate demand is derived from their own forecasts and random shocks. Our experimental results indicate that the expectations of the subjects tend to be coordinated on a common prediction strategy. This strategy is best described as a trend-extrapolative, destabilizing expectation formation scheme. Deviations from common expectations are mainly caused by random shocks, which can be ascribed to the similarity of the subjects’ behavior within and between the different markets. The findings can be explained using insights of behavioral economics.     

Bidding in sequential electricity markets: The Nordic case

For electricity market participants trading in sequential markets with differences in price levels and risk exposure, it is relevant to analyze the potential of coordinated bidding. We consider a Nordic power producer who engages in the day-ahead spot market and the hour-ahead balancing market. In both markets, clearing prices and dispatched volumes are unknown at the time of bidding. However, in the balancing market, the market participant faces an additional risk of not being dispatched. Taking into account the sequential clearing of these markets and the gradual realization of market prices, we formulate the bidding problem as a multi-stage stochastic program. We investigate whether higher risk exposure may cause hesitation to bid into the balancing market. Furthermore, we quantify the gain from coordinated bidding, and by deriving bounds on this gain, assess the performance of alternative bidding strategies used in practice.     

基于ARIMA与信息粒化SVR组合的股指预测研究

对于证券市场投资者而言,基于合理假设准确预测资产价格未来发展方向与趋势关乎投资成败。本文通过构建一个基于ARIMA与信息粒化SVR的组合预测模型,对股票市场指数价格和收益变化的趋势进行预测。实证研究结果表明：基于ARIMA与信息粒化SVR组合的股指预测模型相较于传统时间序列模型而言,在预测精度和效度方面有较大提升,能够在一定时间周期内对股票等风险资产的价格波动区间进行较为可靠地预测,但目前还只能大致确定时间序列波动的区间范围而不能精确地预测具体点位。未来仍需结合其他预测模型和预判技术进一步深入研究,以有效提升股指趋势预测的准确性和实际指导性。     

Real options valuation of forest plantation investments in Brazil

In this paper, we consider investments in eucalyptus plantations in Brazil. For such projects, we discuss real options valuation in the place conventional methods such as IRR or NPV, possibly with CAPM. Traditionally, real options valuation assumes complete markets and neglects market imperfections. Yet, market frictions, such as transaction costs, interest rate spreads, and restricted short positions, can play an important role. We extend real options valuation to allow incomplete and imperfect markets. The value is obtained as a competitive price, given markets of competing investment opportunities, such as real and financial assets. Under perfect and complete markets, such valuation method is consistent with conventional real options theory. Stochastic programming and standard software is used for valuation of eucalyptus plantations. We estimate the underlying interdependent diffusion processes of stock market, interest rates, exchange rates and pulpwood price, and derive novel expressions of stochastic integrals to be employed in scenario generation for discrete time stochastic programming.     

Bayesian estimation of nonlinear equilibrium models with random coefficients

In this paper, we develop a conditional likelihood based approach for estimating the equilibrium price and shares in markets with differentiated products and oligopoly supply. We model market demand using a discrete choice model with random coefficients and random utility. For most applications, the likelihood function of equilibrium prices and shares is intractable and cannot be directly analyzed. To overcome this, we develop a Markov Chain Monte Carlo simulation strategy to estimate parameters and distributions. To illustrate our methodology, we generate a dataset of prices and quantities simulated from a differentiated goods oligopoly across a number of markets. We apply our methodology to this dataset to demonstrate its attractive features as well as its accuracy and validity. Copyright © 2014 John Wiley & Sons, Ltd.     

Pricing policy in dynamic markets and a generalization of the Ramsey rule

Pricing policy in a regulated monopoly industry is usually based on maximizing welfare or some other measure of utility level of return on investment. Previously, the Ramsey pricing policy which states that the percentage deviation of quasi-optimal price from marginal cost for each product must be inversely proportional to its price elasticity of demand, has been developed for a static market. The Ramsey framework assumes instantaneous demand response to price changes; empirical evidence suggests demand changes occur dynamically through time.In this paper an optimum pricing rule for a profit maximizing firm based on a general time varying demand model in a dynamic market is obtained assuming a single price change at the beginning of the planning period. A dynamic market equivalent of the well known inverse elasticity law of the static market is developed. Defining the concept of average price elasticity for dynamic markets we show that the inverse elasticity law of static markets takes an inequality form in dynamic markets. For demand functions which decrease, increase or are constant with time the optimum price markups are greater than, less than, or equal to the inverse of the average price elasticity, respectively.The results are then generalized to the case of a constrained welfare maximizing firm. This leads to the development of a dynamic market generalization of the well known Ramsey pricing rule. A simple rule for making quantitative arguments about the relative size of the optimum price in static and dynamic markets is also derived.This work was completed when the author was with Bell Laboratories, USA.     

Price formation model with zero-Neumann boundary condition

ABSTRACT

This paper concerns the mathematical analysis of a mathematical model for price formation. We take a large number of rational buyers and vendors in the market who are trading the same good into consideration. Each buyer or vendor will choose his optimal strategy to buy or sell goods. Since markets seldom stabilize, our model mimics the real market behavior. We introduce three models. All of them are modifications of the original J.-M. Lasry and P. L. Lions evolution model. In the first modified model, a random term is added to mimic the randomness of trading in the real market. This reflects markets with low volatility, where it might be difficulty to buy or sell goods at specific price. In the second model, we use cumulative density function instead of density function. We give numerical simulations on these two models in order to have a general picture on the solution. In the third model, we add a term associated with the parameter R to destabilize the original Larsy–Lions model and study oscillations and wave solutions depending on different values of R. We also study existence and uniqueness of the solution. Moreover, Several plots are given to demonstrate these results corresponding to the theoretical prediction.     

Temporal hierarchies with autocorrelation for load forecasting

We propose four different estimators that take into account the autocorrelation structure when reconciling forecasts in a temporal hierarchy. Combining forecasts from multiple temporal aggregation levels exploits information differences and mitigates model uncertainty, while reconciliation ensures a unified prediction that supports aligned decisions at different horizons. In previous studies, weights assigned to the forecasts were given by the structure of the hierarchy or the forecast error variances without considering potential autocorrelation in the forecast errors. Our first estimator considers the autocovariance matrix within each aggregation level. Since this can be difficult to estimate, we propose a second estimator that blends autocorrelation and variance information, but only requires estimation of the first-order autocorrelation coefficient at each aggregation level. Our third and fourth estimators facilitate information sharing between aggregation levels using robust estimates of the cross-correlation matrix and its inverse. We compare the proposed estimators in a simulation study and demonstrate their usefulness through an application to short-term electricity load forecasting in four price areas in Sweden. We find that by taking account of auto- and cross-covariances when reconciling forecasts, accuracy can be significantly improved uniformly across all frequencies and areas.     

Asymptotic asset pricing and bubbles

We define the concept of asymptotic superreplication, and prove a duality principle of asset pricing for sequences of financial markets (e.g., weakly converging financial markets and large financial markets) based on contiguous sequences of equivalent local martingale measures. This provides a pricing mechanism to calculate the fundamental value of a financial asset in the asymptotic market. We introduce the notion of asymptotic bubbles by showing that this fundamental value can be strictly lower than the current price of the asset. In the case of weakly converging markets, we show that this fundamental value is equal to an expectation of the terminal value of the asset in the weak-limit market. From a practical perspective, we relate the asymptotic superreplication price to a limit of quantile-hedging prices. This shows that even when a price process is a true martingale, it can have properties similar to a bubble, up to a set of small probability. For practical applications, we give examples of weakly converging discrete-time models (e.g. some GARCH models) and large financial models that present bubbles.     

What price stability? Social welfare in matching markets

In two-sided matching markets, stability can be costly. We define social welfare functions for matching markets and use them to formulate a definition of the price of stability. We then show that it is common to find a price tag attached to stability, and that the price of stability can be substantial. Therefore, when choosing a matching mechanism, a social planner would be well advised to weigh the price of stability against the value of stability, which varies from market to market.     

A new methodology for generating and combining statistical forecasting models to enhance competitive event prediction

Forecasting methods are routinely employed to predict the outcome of competitive events (CEs) and to shed light on the factors that influence participants’ winning prospects (e.g., in sports events, political elections). Combining statistical models’ forecasts, shown to be highly successful in other settings, has been neglected in CE prediction. Two particular difficulties arise when developing model-based composite forecasts of CE outcomes: the intensity of rivalry among contestants, and the strength/diversity trade-off among individual models. To overcome these challenges we propose a range of surrogate measures of event outcome to construct a heterogeneous set of base forecasts. To effectively extract the complementary information concealed within these predictions, we develop a novel pooling mechanism which accounts for competition among contestants: a stacking paradigm integrating conditional logit regression and log-likelihood-ratio-based forecast selection. Empirical results using data related to horseracing events demonstrate that: (i) base model strength and diversity are important when combining model-based predictions for CEs; (ii) average-based pooling, commonly employed elsewhere, may not be appropriate for CEs (because average-based pooling exclusively focuses on strength); and (iii) the proposed stacking ensemble provides statistically and economically accurate forecasts. These results have important implications for regulators of betting markets associated with CEs and in particular for the accurate assessment of market efficiency.     

An investigation of stock price dynamics in emerging markets

The emergence of stock markets in former centrally planned economies poses a significant problem to financial economists and policy makers in that price movements in these markets are not well explained by conventional capital theory. The opening of stock markets brings about a new equilibrium value P̂ for the firm. Shares are floated on an estimate of P̂, and buyers of these shares and individuals trading in the secondary market are also obliged to do so on the basis of their estimates of this magnitude. At any time, the market price of the firm's shares then reflects the market's best guess of what its value would be in the new equilibrium, and information on which to calculate estimates become more readily available as the stock market matures. This paper presents a stochastic price model which takes all of these factors into consideration. The model also provides a theoretical foundation underlying the pronounced trends of prices in emerging stock markets, and explains why they appear to be so volatile. © 1998 John Wiley & Sons, Ltd.     

The efficiency of financial futures markets: Tests of prediction accuracy

The prices of financial futures contracts can be interpreted as forecasts of the spot rates, which will apply at the final delivery date of that contract. Financial futures contracts have been traded daily since the early 1980s and provide a substantial bank of data to test the forecasting efficiency of such contracts. Tests are carried out to examine whether the interest rates implied by the futures price for eurodollar and short sterling contracts are cointegrated with the final settlement price over forecasting horizons of 1, 2 and 3 months. Similar analysis is carried out for the yen/dollar exchange rate futures contract. The paper then examines the forecasting performance of the three contracts over the forecasting horizons of 1, 2 and 3 months and in particular whether the forecasts implied by the futures contract provide better predictions than the naı̈ve no-change (i.e. random walk), a vector error correction model (VECM) or an ARIMA model.An examination of the relative efficiency of the markets for the three markets over the three time horizons is carried out and finally trading strategies are simulated to see whether excess profits can be achieved. In fact the results suggest that both profits and losses would be attracted.     

Multifractal structure in Latin-American market indices

We study the multifractal nature of daily price and volatility returns of Latin-American stock markets employing the multifractal detrended fluctuation analysis. Comparing with the results obtained for a developed country (US) we conclude that the multifractality degree is higher for emerging markets. Moreover, we propose a stock market inefficiency ranking by considering the multifractality degree as a measure of inefficiency. Finally, we analyze the sources of multifractality quantifying the contributions of two factors, the long-range correlations of the time series and the broad fat-tail distributions. We find that the multifractal structure of Latin-American market indices can be mainly attributed to the latter.     

Optimal procurement strategies for online spot markets

Spot markets have emerged for a broad range of commodities, and companies have started to use them in addition to their traditional, long-term procurement contracts (forward contracts). In comparison to forward contracts, spot markets offer products at essentially negligible lead time, but typically command a higher expected price for this added flexibility while also exhibiting substantial price uncertainty. In our research, we analyze the resulting procurement challenge and quantify the benefits of using spot markets from a supply chain perspective. We develop and solve mathematical models that determine the optimal order quantity to purchase via forward contracts and the optimal quantity to purchase via spot markets. We analyze the most general situation where commodities can be both bought and sold via a spot market and derive closed-form results for this case. We compare the obtained results to the reference scenario of pure contract sourcing and we include results for situations where the use of spot markets is restricted to either buying or selling only. Our approaches can be used by decision makers to determine optimal procurement strategies based on key parameters such as, demand and spot price volatilities, correlation between demand and spot prices, and risk aversion. The results of our analysis demonstrate that significant profit improvements can be achieved if a moderate fraction of the commodity demand is procured via spot markets. The results also show that companies who use spot markets can offer a higher expected service level, but that they might experience a higher variability in profits than companies who do not use spot markets. We illustrate our analytical results with numerical examples throughout the paper.     

Modelling and measuring the irrational behaviour of agents in financial markets: Discovering the psychological soliton

Following a Geometrical Brownian Motion extension into an Irrational fractional Brownian Motion model, we re-examine agent behaviour reacting to time dependent news on the log-returns thereby modifying a financial market evolution. We specifically discuss the role of financial news or economic information positive or negative feedback of such irrational (or contrarian) agents upon the price evolution. We observe a kink-like effect reminiscent of soliton behaviour, suggesting how analysts' forecasts errors induce stock prices to adjust accordingly, thereby proposing a measure of the irrational force in a market.