Flexible software reliability growth model with testing effort dependent learning process

A lot of importance has been attached to the testing phase of the Software Development Life Cycle (SDLC). It is during this phase it is checked whether the software product meets user requirements or not. Any discrepancies that are identified are removed. But testing needs to be monitored to increase its effectiveness. Software Reliability Growth Models (SRGMs) that specify mathematical relationships between the failure phenomenon and time have proved useful. SRGMs that include factors that affect failure process are more realistic and useful. Software fault detection and removal during the testing phase of SDLC depend on how testing resources (test cases, manpower and time) are used and also on previously identified faults. With this motivation a Non-Homogeneous Poisson Process (NHPP) based SRGM is proposed in this paper which is flexible enough to describe various software failure/reliability curves. Both testing efforts and time dependent fault detection rate (FDR) are considered for software reliability modeling. The time lag between fault identification and removal has also been depicted. The applicability of our model is shown by validating it on software failure data sets obtained from different real software development projects. The comparisons with established models in terms of goodness of fit, the Akaike Information Criterion (AIC), Mean of Squared Errors (MSE), etc. have been presented.     

Software reliability assessment models based on cumulative bernoulli trial processes

The binomial software reliability growth model (SRGM) contains most existing SRGMs proposed in earlier work as special cases, and can describe every software failure-occurrence pattern in continuous time. In this paper, we propose generalized binomial SRGMs in both continuous and discrete time, based on the idea of cumulative Bernoulli trials. It is shown that the proposed models give some new unusual discrete models as well as the well-known continuous SRGMs. Through numerical examples with actual software failure data, two estimation methods for model parameters with grouped data are provided, and the predictive model performance is examined quantitatively.     

NHPP software reliability model considering the uncertainty of operating environments with imperfect debugging and testing coverage

In this paper, we propose a testing-coverage software reliability model that considers not only the imperfect debugging (ID) but also the uncertainty of operating environments based on a non-homogeneous Poisson process (NHPP). Software is usually tested in a given control environment, but it may be used in different operating environments by different users, which are unknown to the developers. Many NHPP software reliability growth models (SRGMs) have been developed to estimate the software reliability measures, but most of the underlying common assumptions of these models are that the operating environment is the same as the developing environment. But in fact, due to the unpredictability of the uncertainty in the operating environments for the software, environments may considerably influence the reliability and software's performance in an unpredictable way. So when a software system works in a field environment, its reliability is usually different from the theory reliability, and also from all its similar applications in other fields. In this paper, a new model is proposed with the consideration of the fault detection rate based on the testing coverage and examined to cover ID subject to the uncertainty of operating environments. We compare the performance of the proposed model with several existing NHPP SRGMs using three sets of real software failure data based on seven criteria. Improved normalized criteria distance (NCD) method is also used to rank and select the best model in the context of a set of goodness-of-fit criteria taken all together. All results demonstrate that the new model can give a significant improved goodness-of-fit and predictive performance. Finally, the optimal software release time based on cost and reliability requirement and its sensitivity analysis are discussed.     

Sensitivity analysis of release time of software reliability models incorporating testing effort with multiple change-points

To accurately model software failure process with software reliability growth models, incorporating testing effort has shown to be important. In fact, testing effort allocation is also a difficult issue, and it directly affects the software release time when a reliability criteria has to be met. However, with an increasing number of parameters involved in these models, the uncertainty of parameters estimated from the failure data could greatly affect the decision. Hence, it is of importance to study the impact of these model parameters. In this paper, sensitivity of the software release time is investigated through various methods, including one-factor-at-a-time approach, design of experiments and global sensitivity analysis. It is shown that the results from the first two methods may not be accurate enough for the case of complex nonlinear model. Global sensitivity analysis performs better due to the consideration of the global parameter space. The limitations of different approaches are also discussed. Finally, to avoid further excessive adjustment of software release time, interval estimation is recommended for use and it can be obtained based on the results from global sensitivity analysis.     

Enhancing software reliability modeling and prediction through the introduction of time-variable fault reduction factor

Over the past three decades, many software reliability models with different parameters, reflecting various testing characteristics, have been proposed for estimating the reliability growth of software products. We have noticed that one of the most important parameters controlling software reliability growth is the fault reduction factor (FRF) proposed by Musa. FRF is generally defined as the ratio of net fault reduction to failures experienced. During the software testing process, FRF could be influenced by many environmental factors, such as imperfect debugging, debugging time lag, etc. Thus, in this paper, we first analyze some real data to observe the trends of FRF, and consider FRF to be a time-variable function. We further study how to integrate time-variable FRF into software reliability growth modeling. Some experimental results show that the proposed models can improve the accuracy of software reliability estimation. Finally, sensitivity analyses of various optimal release times based on cost and reliability requirements are discussed. The analytic results indicate that adjusting the value of FRF may affect the release time as well as the development cost.     

Profust reliability of a gracefully degradable system

Research in traditional reliability theory is based mainly on probist reliability, which uses a binary state assumption and classical reliability distributions. In the present paper the binary state assumption has been replaced by a fuzzy state assumption, thereby leading to profust reliability estimates of a powerloom plant, which is modelled as a two unit gracefully degradable system. Results of Bowles and Palaez [Application of fuzzy logic to reliability engineering, Proc. IEEE 83(3) (1995) 435–449] have been deduced as a particular case of results presented here. It is also recognized that estimation of system parameters such as failure rates, is vital in reliability estimation. Available methods for such estimation do not cover the underlying uncertainty in the failure data collection involving human judgment, evaluation and decision. In this paper we introduce a new approach based on fuzzy set theory to estimate such system parameters.     

Nonparametric estimation of interval-censored failure time data in the presence of informative censoring

Nonparametric estimation of a survival function is one of the most commonly asked questions in the analysis of failure time data and for this, a number of procedures have been developed under various types of censoring structures (Kalbfleisch and Prentice, 2002). In particular, several algorithms are available for interval-censored failure time data with independent censoring mechanism (Sun, 2006; Turnbull, 1976). In this paper, we consider the interval-censored data where the censoring mechanism may be related to the failure time of interest, for which there does not seem to exist a nonparametric estimation procedure. It is well-known that with informative censoring, the estimation is possible only under some assumptions. To attack the problem, we take a copula model approach to model the relationship between the failure time of interest and censoring variables and present a simple nonparametric estimation procedure. The method allows one to conduct a sensitivity analysis among others.     

Statistical software reliability prediction and its applicability based on mean time between failures

One of the most important issues for a development manager may be how to predict the reliability of a software system at an arbitrary testing time. In this paper, using the software failure-occurrence time data, we discuss a method of software reliability prediction based on software reliability growth models described by an NHPP (nonhomogeneous Poisson process). From the applied software reliability growth models, the conditional probability distribution of the time between software failures is derived, and its mean and median are obtained as reliability prediction measures. Finally, based on several numerical examples, we compare the performance between these measures from the view point of software reliability prediction in the testing phase.     

COTS selection using fuzzy interactive approach

In this paper, we introduce fuzzy mathematical programming (FMP) for decision-making related to software creation by selecting optimal commercial-off-the-shelf (COTS) products in a modular software system. Each module in such software systems have different alternatives with variations in their properties, for example, quality, reliability, execution time, size and cost. Due to these variations, component-based software developers generally deals with the problem of selecting appropriate COTS products. The development of COTS-based systems largely depends on the success of the selection process. Various crisp optimization models of COTS products selection have been proposed in literature. However, in real COTS products selection problem, it is difficult to estimate precisely the values of various model parameters due to lack of sufficient data and also because of measurement errors. Hence, instead of crisp optimization model, if we use flexible optimization model then we might obtain results which are more preferred by the decision maker. In this study, we use multiple methodologies such as quality model, analytical hierarchy process and FMP to develop fuzzy multiobjective optimization model of the COTS products selection. To determine a preferred compromise solution for the multiobjective optimization problem, an interactive fuzzy approach is used.     

A better project performance prediction model using fuzzy time series and data envelopment analysis

Earned value management (EVM) is a critical project management methodology that evaluates and predicts project performance from cost and schedule perspectives. The novel theoretical framework presented in this paper estimates future performance of a project based on the past performance data. The model benefits from a fuzzy time series forecasting model in the estimation process. Furthermore, fuzzy-based estimation is developed using linguistic terms to interpret different possible conditions of projects. Eventually, data envelopment analysis is applied to determine the superior model for forecasting of project performance. Multiple illustrative cases and simulated data have been used for comparative analysis and to illustrate the applicability of theoretical model to real situations. Contrary to EVM-based approach, which assumes the future performance is the same as the past, the proposed model can greatly assist project managers in more realistically assessing prospective performance of projects and thereby taking necessary and on-time appropriate actions.     

A generalized JM model with applications to imperfect debugging in software reliability

For their nice mathematical properties, state space models have been widely used, especially for forecasting. Over the last decades, the study of tracking software reliability by statistical models has attracted scientists’ attention. However, most of models focus on perfect debugging although practically imperfect debugging arises everywhere. In this paper, a non-Gaussian state space model is modified to predict software failure time with imperfect debugging. In fact, this model is very flexible so that we can modify the system equation in this model to satisfy the various situations. Besides, this model is suitable for tracking software reliability, and applied to two well known datasets on software failures.     

单失效模式双变量函数复杂系统模糊随机可靠性广义模型研究

在综合考虑系统功能函数变量不同属性的基础上 ,建立了单一失效模式下复杂系统模糊随机可靠性的广义模型 ,并讨论了广义模型与各个单一模型之间的关系 ,为产品在复杂状态下的可靠性求解提供了统一的数学模型 .分析讨论表明 :所建立的模糊随机可靠性广义模型更具有一般性 .     

Effect of change point and imperfect debugging in software reliability and its optimal release policy

This article presents a software reliability growth model based on non-homogeneous Poisson process. The main focus of this article is to deliver a method for software reliability modelling incorporating the concept of time-dependent fault introduction and fault removal rate with change point. Also in this article, a cost model with change point has been developed. Based on the cost model optimal release policy with change point has been discussed. Maximum likelihood technique has been applied to estimate the parameters of the model. The proposed model has been validated using some real software failure data. Comparison has been made with models incorporating change point and without change point. The application of the proposed cost model has been shown using some numerical examples.     

Modelling redundancy allocation for a fuzzy random parallel-series system

Due to subjective judgment, imprecise human knowledge and perception in capturing statistical data, the real data of lifetimes in many systems are both random and fuzzy in nature. Based on the fuzzy random variables that are used to characterize the lifetimes, this paper studies the redundancy allocation problems to a fuzzy random parallel-series system.Two fuzzy random redundancy allocation models (FR-RAM) are developed through reliability maximization and cost minimization, respectively. Some properties of the FR-RAM are obtained, in which an analytical formula of reliability with convex lifetimes is derived and the sensitivity of the reliability is discussed. To solve the FR-RAMs, we first address the computation of reliability. A random simulation method based on the derived analytical formula is proposed to compute the reliability with convex lifetimes. As for the reliability with nonconvex lifetimes, the technique of fuzzy random simulation together with the discretization method of fuzzy random variable is employed to compute the reliability, and a convergence theorem of the fuzzy random simulation is proved. Subsequently, we integrate the computation approaches of the reliability and genetic algorithm (GA) to search for the approximately optimal redundancy allocation of the models. Finally, some numerical examples are provided to illustrate the feasibility of the solution algorithm and quantify its effectiveness.     

Behavior prediction of washing system in a paper industry using GA and fuzzy lambda–tau technique

Availability analysis has been an important issue in the design field of any Industrial system as the system structure has become more complicated. Also, the system availability is affected by many factors such as design, manufacturing, installation, etc., and so it may be extremely difficult to model, analyze and predict the failure behavior of the system. The purpose of this paper is to develop a new approach for computing various performance measures, namely reliability, availability, MTBF (mean time between failures), ENOF (expected number of failures), failure rate and repair time, for any industrial system. In the proposed approach, the failure rates and repair times of all constituent components are obtained using genetic algorithms and then various performance measures are computed using fuzzy lambda–tau methodology. Washing system, the major part of paper industry is the subject of study. The interactions among the working components are modeled using Petri nets. Failure and repair rates are represented using triangular fuzzy numbers as they allow expert opinion, linguistic variables, operating conditions, uncertainty and imprecision in reliability information to be incorporated into system model. Based on calculated reliability parameters, a structured framework has been developed that may help the maintenance engineers to analyze and predict the system behavior.     

A novel two-factor forecasting model for fuzzy time series

The study of fuzzy time series has increasingly attracted much attention due to its salient capabilities of tackling vague and incomplete data. A variety of forecasting models have devoted to improving forecasting accuracy, however, the issue of partitioning intervals has rarely been investigated. Recently, we proposed a novel deterministic forecasting model to eliminate the major overhead of determining the k-order issue in high-order models. This paper presents a continued work with focusing on handling the interval partitioning issue by applying the fuzzy c-means technology, which can take the distribution of data points into account and produce unequal-sized intervals. In addition, the forecasting model is extended to allow process twofactor problems. The accuracy superiority of the proposed model is demonstrated by conducting two empirical experiments and comparison to other existing models. The reliability of the forecasting model is further justified by using a Monte Carlo simulation and box plots. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Interval statistic based reliability analysis method on small sample hot test of satellite thruster

As one of the most important components of satellites, the thruster must maintain high reliability, but the assessment is difficult when lacking test failure data. When conducting hot test of the satellite thruster, we encountered the problem of reliability assessment on type-I censored data with only one failure, which is common for small sample tests. This paper proposes a novel interval statistic based reliability analysis method, which can fulfill the life information from the failure time to the censored time ignored by conventional methods, and improve the assessment accuracy. In this paper, a life distribution model is established by proper failure mechanism analysis and prior test information exploitation. As thrust chamber burning-through has been considered as the main failure mode, life test of the chamber coating was conducted under different thermal conditions to obtain the model parameter. Based on the interval statistic theory, a detailed derivation is illustrated. Then, reliability assessment and life prediction for the satellite thruster in both transfer orbit phase and synchronous orbit phase have been achieved, and the results show that our method performs very well, which provides an important way for dealing with test data with only one failure.     

A distance-based statistical analysis of fuzzy number-valued data

Real-life data associated with experimental outcomes are not always real-valued. In particular, opinions, perceptions, ratings, etc., are often assumed to be vague in nature, especially when they come from human valuations. Fuzzy numbers have extensively been considered to provide us with a convenient tool to express these vague data. In analyzing fuzzy data from a statistical perspective one finds two key obstacles, namely, the nonlinearity associated with the usual arithmetic with fuzzy data and the lack of suitable models and limit results for the distribution of fuzzy-valued statistics. These obstacles can be frequently bypassed by using an appropriate metric between fuzzy data, the notion of random fuzzy set and a bootstrapped central limit theorem for general space-valued random elements. This paper aims to review these ideas and a methodology for the statistical analysis of fuzzy number data which has been developed along the last years.     

实时双机系统的可靠性分析

对于强实时双机系统，应该建立考虑影响系统可靠性因素较多的模型。本文，在给出可用度改进因子（ＡＩＦ）的定义基础上，建立了强实时双机系统的可靠性模型，用于综合考虑故障判别成功率（Ｃ）和故障判别时间（１／β）对系统可用度的影响，研究结果表明：应分别建立强实时和弱实时双机系统的可靠性模型，不能将二者混淆。     

Forecasting stock index price based on M-factors fuzzy time series and particle swarm optimization

In real time, one observation always relies on several observations. To improve the forecasting accuracy, all these observations can be incorporated in forecasting models. Therefore, in this study, we have intended to introduce a new Type-2 fuzzy time series model that can utilize more observations in forecasting. Later, this Type-2 model is enhanced by employing particle swarm optimization (PSO) technique. The main motive behind the utilization of the PSO with the Type-2 model is to adjust the lengths of intervals in the universe of discourse that are employed in forecasting, without increasing the number of intervals. The daily stock index price data set of SBI (State Bank of India) is used to evaluate the performance of the proposed model. The proposed model is also validated by forecasting the daily stock index price of Google. Our experimental results demonstrate the effectiveness and robustness of the proposed model in comparison with existing fuzzy time series models and conventional time series models.