Qualification and validation of software and computer systems in laboratories

 Installation and operational qualification are important steps in the overall validation and qualification process for software and computer systems. This article guides users of such systems step by step through the installation and operational qualification procedures. It provides guidelines on what should be tested and documented during installation prior to routine use. The author also presents procedures for the qualification of software using chromatographic data systems and a network server for central archiving as examples. Received: 31 October 1997 · Accepted: 25 November 1997     

Qualification and validation of software and computer systems in laboratories

 When software and computer systems are purchased from vendors, the user is still responsible for the overall validation. Because the development validation can only be done by the developers, the user can delegate this part to the vendor. The user's firm should have a vendor qualification program in place to check for this. The type of qualification depends very much on the type and complexity of software and can go from documented evidence of ISO 9001 or equivalent certification for off-the-shelf products to direct audit for software that has been developed on a contract basis. Using a variety of practical examples, the article will help to find the optimal qualification procedure. Received: 8 August 1997 · Accepted: 12 September 1997     

Ion chromatography characterization of polysaccharides in ancient wall paintings

Specific programming of automated HPLC systems allows total on-line qualification, validation and stability monitoring using the concept of deferred standards. Setting up such a process for routine analyses in an automated HPLC system requires specific autosampler programming as well as specific monitoring software. With an autosampler, a double injection procedure is programmed, the first introducing the sample, and the second, a few minutes deferred, the deferred control standard. Two additional compounds are therefore added to the sample before and during the chromatographic process: the intemal standard for sample quantification and the deferred standard for system control. Specific methodologies are described of how to obtain classical quantitative analysis information as well as system qualification validation stability information. Experiments were performed to develop specified methodologies to monitor the quality of quantitative analysis during the life of the column by using the deferred standard concept to probe the effects of column ageing on separation characteristics.     

How instrument manufactures help with accreditation and ISO certification

 To help users of laboratory instrumentation to obtain laboratory accreditation and International Organization of Standardization certification, instrument manufactures should develop a comprehensive compliance programme for their products that includes product features, documentation and services for equipment validation and qualification. Received: 5 October 1998 · Accepted: 20 October 1998     

Instrumental validation in capillary electrophoresis and checkpoints for method validation

Capillary electrophoresis (CE) is increasingly being used in regulated and testing environments which demand validation. The design, development and production of CE instrumentation should be governed by qualifications which ensure the quality of the finished product. The vendor should therefore provide guidelines and procedures which assist the user in ensuring the adequate operation of the instrumentation and especially in designing installation qualification (IQ) and operational qualification/performance verification (OQ/PV) procedures. OQ/PV should test those functions of an instrument which directly affect the CE analysis, i.e. voltage, temperature, injection precision and detector function. In validation of CE methods care should be taken that those aspects which directly affect the precision of peak parameters are appreciated. The relationship between CE instrumentation, chemistry and validation parameters is discussed and guidelines are presented for definition of a CE method for submission to regulatory authorities.     

Automation and validation of HPLC-systems

Summary The automation of chromatographic systems is of increasing interest to industry and research laboratories in routine applications. Besides potentially saving time or making better use of available instrumentation, automation also improves the quality of results by producing more precise and more reproducible HPLC data. The need for the validation of methods and qualification of instruments is increasingly recognised in order to ensure compliance with legal requirements (e.g. in the pharmaceutical industry) and to ensure the reliability of analytical results. Possibilities and requirements for automated HPLC systems are elaborated. Emphasis is placed on defining the goals of validation and on discussing different aspects of the validation of LC methods, system suitability tests, ruggedness of methods and the transfer of LC methods from laboratory to laboratory. Adequate strategies of HPLC method development provide very useful information on the validation and ruggedness of LC methods.     

Equipment qualification and its application to conductivity measuring systems

It is only possible to obtain analytical results that are suitable for their intended purpose if the equipment used is capable of producing measurements of the required quality. To ensure that this requirement is met, analysts should define the performance criteria required from the instruments, ensure that only suitable instruments are selected for analytical measurements, and confirm that these instruments continue to meet these criteria for their entire operational life. This process should be conducted on a formal, documented basis, known as equipment qualification. In addition to describing the key elements of equipment qualification for all analytical instruments, this paper gives specific guidance on its application to conductivity systems that has never previously appeared in the literature. The benefits of performing equipment qualification are highlighted and guidance is given on the selection of control standards and why the equipment vendor performing stages of equipment qualification can be of benefit to the user. The relationship between equipment qualification and method validation is discussed, including how these activities play a major role in determining the quality control measures that should be applied to routine analysis.     

Analytical instrument qualification in capillary electrophoresis

Capillary electrophoresis (CE) is a well-established and frequently used technique in the pharmaceutical industry. Therefore an appropriate analytical instrument qualification (AIQ) is required for quality assurance. AIQ forms the basis of a quality management followed by analytical method validation, system suitability tests (SSTs) and quality control checks. Two parts of the AIQ, namely the operational qualification (OQ) and the performance qualification (PQ) are of particular interest in the daily routine of the laboratory. A new concept for OQ and PQ was developed to assure the correct function of a CE system. The significance of each parameter, possible test methods as well as acceptance criteria will be presented and discussed in detail. Especially temperature adjustment by the cooling system and the voltage supply must be tested for accurate and precise operation. The detector noise, wavelength accuracy and detector linearity have to be checked as well. Finally, the injection linearity, accuracy and precision need to be qualified. The proposed set of qualification procedures is easy to implement and was already tested on five CE instruments from three different manufacturers. A time- and cost-saving continuous PQ was derived, using results from method-specific SSTs and some additional experiments. This holistic concept continuously surveys the most relevant parameters, hence assuring the suitability of the used instruments and decreasing their downtimes.     

色谱类分析仪器性能确认用标准物质的筛选

分析仪器验证是制药、食品、环境等多个行业实验室质量管理的重点,为解决我国色谱类分析仪器验证评价体系中缺乏统一标准物质的问题,提出了筛选性能确认行业推荐用标准物质的原则。通过分析不同行业色谱类分析仪器标准物质使用情况和国家标准及有证标准物质的发布现状,以筛选原则为指导,筛选出93种高效液相色谱性能确认用标准物质。为保证分析仪器的稳定性和可靠性提供了标准依据。     

Quality control in residual solvent analysis: the static headspace gas chromatographic method

 Residual solvent testing of raw materials and drug products constitutes part of a quality control programme. Static headspace gas chromatography (HS/GC) is suggested in current pharmacopoeias as a general tool for residual solvent testing. But the main obstacles to using HS/GC procedures are the absence of performance tests, suitable reference solvents and matrix standards, and reference methods. Harmonized regulations for residual solvent testing allow the use of a cumulative approach to estimate the residual solvent content in drug products. The supplier data may be appropriate. Therefore, in a quality control programme the main accent is put on the definition of specification limits (in accordance with toxicological data, and the influence of residual solvents on the physical properties and stability of the product) and supplier qualification. This paper focuses on two main problems linked to supplier qualification: system performance and matrix effect. HS/GC of a mixture containing solvents of different volatility and polarity is proposed as a performance test. The test can be done in three ways in accordance with the residual solvents characteristics, the test sample solubility and the specification levels required. The use of the test as a diagnostic tool is demonstrated and sources of uncertainty of the recovery determination are discussed. Received: 12 December 1998 · Accepted: 25 January 1999     

Validation and qualification: the fitness for purpose of mass spectrometry-based analytical methods and analytical systems

The context of validation for mass spectrometry (MS)-based methods is critically analysed. The focus is on the fitness for purpose depending on the task of the method. Information is given on commonly accepted procedures for the implementation and acceptance of analytical methods as ‘confirmatory methods’ according to EU criteria, and strategies for measurement. Attention is paid to the problem of matrix effects in the case of liquid chromatography-mass spectrometry-based procedures, since according to recent guidelines for bioanalytical method validations, there is a need to evaluate matrix effects during development and validation of LC-MS methods “to ensure that precision, selectivity and sensitivity will not be compromised”. Beneficial aspects of the qualification process to ensure the suitability of the MS analytical system are also evaluated and discussed.     

Problems of validation of computerised instruments for accredited chemical laboratories

 Some problems of validation of computerised instruments are reviewed briefly, taking essential standards and guides into account. The significant role of certified standard reference materials is underlined. An attitude of suppliers towards the validation of instruments is presented, and producers' responsibilities and obligations are discussed. The "black-box" concept is recommended as a preliminary step for the validation of computerised instruments. Two examples for gel permeation chromatography are given that illustrate a bad manufacturer's practice (BMP) and good manufacturer's practice (GMP). In the case of BMP, a need is expressed for a guide and for regulations that should be implemented into the quality assurance system. It has been proposed that the EURACHEM/VAM draft of guidance for qualification/validation of instruments should be amended by incorporating the "black-box" approach as a preliminary procedure for validation of computerised instruments, a retrospective validation procedure if the need for current validation was not foreseen or not specified, and a procedure (or selection rules) for qualification of the supplier. Moreover, the mechanisms of inspection to control the observance of the standardised rules and commonly recognised recommendations should also be considered by international quality organisations. Received: 19 November 1996 · Accepted: 20 March 1997     

Pre-Validation and Performance Prediction Using Pressure Monitoring to Evaluate HPLC Method Development Changes

HPLC methods for pharmaceutical analysis evolve from method development to commercial product testing. The majority of development and validation takes place in an R&D setting, followed by transfer to commercial sites that execute test methods on a routine basis. There is a growing need to increase confidence and probability that developed methods will be successful both during validation and long-term use with products, particularly when introducing new or unfamiliar technologies. An HPLC method pre-validation and performance prediction plan is presented using model pharmaceutical ingredients in prototype liquid formulations. The pre-validation includes limited linearity, repeatability in sample matrix, precision, carry-over, and selectivity. The performance prediction involves injecting large numbers of worst-case samples and monitoring five critical parameters: retention time, tailing factor, resolution, efficiency, and system pressure. Parameter results are assessed with respect to precision and/or system performance. In a proof of principle model, the performance prediction data demonstrate that system suitability parameters remain constant during injections of prepared samples; however, the system pressure increases over time. These underlying data indicate a potential trend prior to method validation. As a result, sample preparation and HPLC condition modifications are evaluated using pressure plots as a key performance metric.

     

New tools: Uncertainty-based data evaluation

 The principles of uncertainty-based data evaluation are explained. Based on a brief review of recent publications on the topic, examples for application to standard procedures in analytical chemistry – calibration, method validation, standard addition etc., – are given. The performance and the advantages of uncertainty-based data evaluation are discussed. Received: 4 July 1998 · Accepted: 6 July 1998     

Validation of the k0_IAEA software using SMELS material at CDTN/CNEN, Brazil

The Laboratory for Neutron Activation Analysis at CDTN/CNEN, Brazil, acquired the k0_IAEA software package during the Workshop on Nuclear Data for Activation Analysis, 2005, held at the Abdus Salam International Centre for Theoretical Physics, Italy. The IAEA distributed the software to several laboratories and has accepted suggestions from the users about the performance of the program. This paper describes the validation procedure carried out aiming at the validation of the software package. The procedure was to analyze the SMELS samples and to compare the results obtained by this software to the commercial KayWin software package, already established at CDTN/CNEN. The results were compared to the values obtained by the Jožef Stefan Institute, Slovenia. The laboratories applied the same software: k0_IAEA and KayWin. The overall results pointed out that the k0_IAEA software set up at CDTN/CNEN, Brazil, is working properly. The u-score test showed that all results, except data in SMELS Type III for Se obtained at the JSI, are within 95% confidence interval once setting up u-score as 1.96 (P = 95% or ±2σ).     

Method validation of modern analytical techniques

 Validation of analytical methods of well-characterised systems, such as are found in the pharmaceutical industry, is based on a series of experimental procedures to establish: selectivity, sensitivity, repeatability, reproducibility, linearity of calibration, detection limit and limit of determination, and robustness. It is argued that these headings become more difficult to apply as the complexity of the analysis increases. Analysis of environmental samples is given as an example. Modern methods of analysis that use arrays of sensors challenge validation. The output may be a classification rather than a concentration of analyte, it may have been established by imprecise methods such as the responses of human taste panels, and the state space of possible responses is too large to cover in any experimental-design procedure. Moreover the process of data analysis may be done by non-linear methods such as neural networks. Validation of systems that rely on computer software is well established. The combination of software validation with validation of the analytical responses of the hardware is the challenge for the analytical chemist. As with validation of automated equipment such as programmable logic controllers in the synthesis of pharmaceuticals, method developers may need to concentrate on the process of validation, as well as the minutiae of what is done.     

Validating automated analytical instruments to meet regulatory and quality standard requirements

Analytical laboratories are more and more faced to meet official regulatory requirements as described in FDA and EPA good laboratory practice, good automated laboratory practice and good manufacturing practice regulations or to officially establish quality systems, such as specified in the ISO 9000 Series quality standards, in the ISO Guide 25 or in the EN 45001 guidelines. The impact on analytical instrumentation will be the requirement for stringent validation of analytical equipment and methods which increase the overall analysis costs. An overview is presented on the validation requirements using e.g. gas chromatography, high performance liquid chromatography, capillary electrophoresis and UV-visible spectroscopy and on the strategy to meet such needs at minimal extra costs with the help of an instrument vendor. It is recommended to use instrument hardware that has already built-in tools for self-verification and which is to be validated at the vendor's site. Performance testing in the user's laboratory is done using standard operating procedures as supplied with the instrument. If resources in the user's laboratory are limited, the performance verification is done by the vendor. Software and the entire computer system is validated prior to shipment at the vendor's site. Acceptance testing is done in the user's environment following the vendor recommendations. Analytical methods are validated automatically at the end of method development using a dedicated software. The software can be customized such that it can also be used for daily automated system suitability testing. Security and integrity of analytical data are ensured by saving the raw data together with instrument conditions and instrument log-books in check-sum protected binary register files for long-term archiving.     

Quality system implementation in Member States of the IAEA

The International Atomic Energy Agency (IAEA), through its Technical Co-operation Programme, has supported the establishment of many nuclear analytical and complementary laboratories in Member States. This included the development of capabilities for the use of various nuclear analytical techniques that include alpha, beta, and gamma spectrometry; radiochemical analysis; neutron activation analysis; energy dispersive X-ray fluorescence analysis; and total reflection X-ray fluorescence. As economic, ecological, medical, and legal decisions are frequently based on laboratory results, they need to be based on accepted national and international standards.The IAEA has taken up this important issue to enhance and foster the competitiveness of nuclear analytical laboratories with the consideration that non-nuclear capabilities are equally important. The projects aim at enhanced quality awareness, a concise system for documentation, establishment of standard operating procedures, procedures for validation of methods, surveillance of method performance, systems for sample management, regular qualification of personnel, client liaison and safety. These projects follow the ISO/IEC 17025 standard and promote participating laboratories to maintain a self-sufficient quality system by which they might be able to obtain national accreditation.This contribution describes the general concept of these projects and discusses some of the results achieved.     

An estimation of the measurement uncertainty for an optical emission spectrometric method

 A validation procedure based on the ISO/IEC 17025 standard was used to demonstrate the long-term stability of a calibration process and to assess the measurement uncertainty of a standard test method for optical emission vacuum spectrometric analysis of carbon and low-alloy steel (ASTM E 415–99a). The validation was used to provide documented evidence that the selected method fulfils the requirements and that the method is ”fit for purpose”. A test for drift was applied to determine statistically whether the analytical results vary systematically with time. The accuracy and traceability of the optimised method were tested by an analysis of closely matched matrix certified reference materials (CRMs). The measurement uncertainty estimations took account of the precision study, the bias and its uncertainty, and the qualification of uncertainties not considered in the overall performance studies. Received: 2 November 2002 Accepted: 2 January 2003 Acknowledgement The author expresses gratitude to Dr. Aleš Fajgelj for helpful discussions during the 3rd Central European Conference on Reference Materials and Measurements. Presented at CERMM-3, Central European Reference Materials and Measurements Conference: The function of reference materials in the measurement process, May 30–June 1, 2002, Rogaška Slatina, Slovenia Correspondence to T. Drglin     

Fuel cell performance assessment for closed-loop renewable energy systems

Fuel cells and electrolysis are promising candidates for future energy production from renewable energy sources. Usually, polymer electrolyte fuel cell systems run on hydrogen and air, while the most of electrolysis systems vent out oxygen as unused by-product. Replacing air with pure oxygen, fuel cell electrochemical performance, durability and system efficiency can be significantly increased with a further overall system simplification and increased reliability. This work, which represents the initial step for pure H_2/O_2 polymer electrolyte fuel cell operation in closed-loop systems, focuses on performance validation of a single cell operating with pure H_2/O_2 under different relative humidity(RH) levels, reactants stoichiometry conditions and temperature. As a result of this study, the most convenient and appropriate operative conditions for a polymer electrolyte fuel cell stack integrated in a closed loop system were selected.