Measurement uncertainty and the use of reference materials

The use of (certified) reference materials and quality control materials can form a suitable basis for evaluating measurement uncertainty of routine measurements. In particular when these materials are used for quality control purposes, it is not always evident how the quality control data can be used in the uncertainty budget of a routine measurement. Current guidance documents on the evaluation of measurement uncertainty and the use of reference materials treat this subject only in part, or in very generic terms. ISO/REMCO has established a new working group that will provide practical guidance and examples on how to use quality control data in the evaluation of measurement uncertainty. A short introduction to the subject is given.

Practical aspects of the uncertainty and traceability of spectrochemical measurement results by electrothermal atomic absorption spectrometry

The determination of trace elements concentration in water by electrothermal atomic absorption spectrometry (ETAAS) is a common and well established technique in many chemical testing laboratories. However, the evaluation of measurement uncertainty results is not systematically implemented. The paper presents an easy step-by-step example leading to the evaluation of the combined standard uncertainty of copper determination in water using ETAAS. The major contributors to the overall measurement uncertainty are identified due to amount of copper in water sample that mainly depends on the absorbance measurements, due to certified reference material and due to auto-sampler volume measurements. The practical aspects how the traceability of copper concentration in water can be established and demonstrated are also pointed out.     

Some aspects of the evaluation of measurement uncertainty using reference materials

 In practice there are three aspects that need to be considered in order to achieve the required traceability according to its definition: the 'stated reference', the 'unbroken chain of calibrations' and the "stated uncertainty". For a certain chemical result, each of these aspects highly depends on the measurement uncertainty, both on its magnitude and how it was estimated. Therefore, the paper describes the experience of the Romanian National Institute of Metrology in estimating measurement uncertainty during the certification of reference materials (RMs), in metrological activities (calibration, pattern approval, periodical verification, etc.), as well as during the analytical measurement process. Practical examples of estimation of measurement uncertainty using RMs or certified reference materials are discussed for their applicability in spectrophotometric and turbidimetric analysis. Use of the analysis of variance to obtain some additional information on the components of measurement uncertainty and to identify the magnitude of individual random effects is described. Received: 12 November 1999 / Accepted: 25 February 2000     

A validation concept for purity determination and assay in the pharmaceutical industry using measurement uncertainty and statistical process control

 The analytical chemists in process development in the pharmaceutical industry have to solve the difficult problem of producing high quality methods for purity determination and assay within a short time without a clear definition of the substance to be analyzed. Therefore the quality management is very difficult. The ideal situation would be that every method is validated before use. This is not possible because this would delay the development process. A process-type quality development approach with an estimation type fast validation (measurement uncertainty) is therefore suggested. The quality management process consists of the estimation of measurement uncertainty for early project status. Statistical process control (SPC) is started directly after measurement uncertainty estimation and a classical validation for the end of the project. By this approach a process is defined that allows a fast and cost-efficient way of supporting the development process with the appropriate quality at the end of the process and provides the transparency needed in the development process. The procedure presented tries to solve the problem of the parallelism between the two development processes (chemical and analytical development) by speeding up the analytical development process initially. Received: 25 March 1997 · Accepted: 17 May 1997     

The application of the measurement uncertainty concept to in-process control in pharmaceutical development

 Any analytical data is used to provide information about a sample. The "possible error" of the measurement can be of extreme importance in order to have complete information. The measurement uncertainty concept is a way to achieve quantitative information about this "possible error" using an estimation procedure. On the basis of the analytical result, the chemist makes a decision on the next step of the development process. If the uncertainty is unknown, the information is not complete; therefore this decision might be impossible. The major problem for the in-process control (IPC) procedure is that not only the repeatability but also the intermediate precision (which expresses the variations within laboratories related to different days, different analysts, different equipment, etc.) has to be good enough to make a decision. Unfortunately, the statistical information achieved from one single analytical run only gives information about the repeatability. This paper shows that the estimation of the measurement uncertainty for IPC is a way to solve the problem and gives the necessary information about the quality of the procedure. An example demonstrates that an estimate of uncertainty based on the standard deviations of an analytical method gives a value similar to one based on the standard deviations obtained from a control chart. Therefore, the estimation is both a very useful and also a very cost-effective tool. Though measurement uncertainty cannot replace validation in general, it is a viable alternative to validation for all methods that will never be used routinely. Received: 24 May 1996 Accepted: 10 August 1996     

Traceability in quantitative NMR using an electronic signal as working standard

The choice of the reference, either as internal or external is not straightforward in quantitative NMR. In this context ERETIC™ methodology appears as an universal referencing technique. An electronic signal, generated by the NMR spectrometer during the acquisition time, operates as a virtual working standard. The processes for ensuring a traceability to primary standards is illustrated on the official method devoted to (D/H)_i ratios measurement on ethanol, using quantitative ²H-NMR. The ERETIC approach is shown to be equivalent to its official homologue, in terms of accuracy and precision. Finally, its performance could be beneficial to other analytes, matrices and nuclei.     

Derived measurement standards of reduced uncertainty – A contradiction?

 If the value of a derived measurement standard is assigned by comparison with a reference standard of the same quantity, the uncertainty is increased by the additional uncertainty on the difference measurement. This basic fact has lead to the general belief that the uncertainty of derived standards is always larger than that of the reference standards. However, if the value of a derived standard is assigned by comparison with several independent reference standards using an appropriate average, the increase of uncertainty due to the uncertainty on difference measurement may be counterbalanced by the the well-known decrease of uncertainty through averaging. The gain of accuracy made possible by this mechanism is restricted to second-generation standards. Further gain through iteration is prevented by correlation between standards derived from the same set of reference standards. As a consequence, the concept of metrological hierarchy levels, relating to traceability chains, becomes questionable for traceability networks.     

The Japanese traceability system and the role of uncertainty evaluation in measurement

 The new traceability system of measurement standards based on the Japanese Measurement Law has been established since November 1993. Some reference materials such as metal standard solutions, pH standard solutions and standard gas mixtures are included in the system together with relevant physical quantities. In this system, primary measurement standard instruments or primary reference materials are designated by the regulation for each quantity. For the practical dissemination of each quantity, accreditation of calibration bodies is recognized by the steering committee under the supervision of the government. In the course of assessment of a candidate calibration body, the concepts of ISO/IEC Guide 25 and ISO/IEC Guide 58 are effectively introduced. For the estimation of reliability, the concept of how to introduce the statistical approach is effectively considered. The method of uncertainty evaluation described in the ISO document entitled "Guide to the expression of uncertainty in measurement" is adopted.     

Traceability in laboratory medicine

In laboratory medicine meaningful measurements are essential for diagnosis, risk assessment, treatment and monitoring of patients. Thus methods applied in diagnostic measurements must be accurate, precise, specific and comparable among laboratories. Inadequate or incorrect analytical performance has consequences for the patients, the clinicians, and the health care system. One key element of metrology is the traceability of a measurement result to the SI system ensuring comparable results. This principle is described in the ISO/TC 212/WG2 N65 prEN 17511 Standard. In addition to the principles of metrology, the clinical usefulness, the diagnostic needs, and the biological and disease associated variations in patients' specimens have to be considered when the analytical biases for diagnostic purposes are defined. It must be the general goal of diagnostic laboratories to produce results that are true and comparable worldwide. The recent European in vitro diagnostic (IVD) Directive 98/79 EC follows the above mentioned standard of the International Organization for Standardization (ISO) and the European Committee for Standardization (CEN) requesting its application for all IVD reagents used within the European Union. This new European legislation will have a worldwide impact on manufacturers and clinical laboratories and will be implemented in 2003. It states that "traceability of values assigned to calibrators and/or control materials must be assured through available reference measurement procedures and/or available reference materials of a higher order". Thus a worldwide reference system needs to be established by collaboration and mutual recognition between the United States National Institute of Standards and Technology (NIST), European Metrology Institutes (EUROMET), regulatory bodies (e.g. United States Food and Drug Administration, FDA) the IVD industry and professional organizations (e.g. International Federation of Clinical Chemistry and Laboratory Medicine, IFCC). In June 2002, in Paris, representatives of international and regional organizations and institutions decided to form the "Joint Committee on Traceability for Laboratory Medicine" (JCTLM), which will support industry in registration and licensing of the "CE" label to test systems conforming to the IVD Directive.Presented at the International ILAC/IAF Conference on Accreditation in Global Trade, 23–25 September 2002, Berlin, Germany     

Implementing the GUM in the certification of reference materials: the revision of ISO Guide 35

The availability of certified reference materials, certified in accordance to the GUM is an important tool for the proper estimation of measurement uncertainty in routine analysis. Many CRMs may suffer from incomplete or wrongly estimated uncertainties, mainly due to lack of guidance on how to implement the GUM in the production of CRMs. In particular the inclusion of the impact of inhomogeneity and instability in the uncertainty budget is often missing. The ongoing revision of ISO Guide 35 aims to fill this gap in providing guidance how (batch) inhomogeneity and instability can be translated into measurement uncertainty. The structure of the current ISO Guide 35 has been maintained as far as possible, but major parts underwent revision to become better aligned with GUM and ISO Guide 34 (2000). Received: 9 April 2001 Accepted: 22 October 2001     

Measurement uncertainty and trade: an example from the petroleum industry

The petroleum industry is and always has been one of the major players in global trade. The price of products depends largely on their characteristics, defined by specifications. Consequently the testing of these specifications and the acceptance of the results by all partners is a crucial pre-requisite for global trade. In the field of petroleum products this issue has been dealt with for decades by using internationally accepted standard test methods, which also define the required accuracy and measurement uncertainty, or the precision. Therefore the petroleum industry may well serve as an example of how measurement uncertainties can be treated and what impact they have on global trade.Presented at the Metro Trade Workshop on Traceability and Measurement Uncertainty in Testing, 30–31 January 2003, Berlin, Germany     

A traceability protocol to the SI by gravimetric analysis

 An example is presented of a traceability protocol for the measurement of a single-element strontium reference material solution, executed by a "primary" method of measurement for certification. The method of measurement is briefly described together with the measurement equation and the associated calculations for the estimation of uncertainties. This is followed by a discussion and estimate of each component of uncertainty associated with the measurement, together with a final estimate of uncertainty. The final estimate of uncertainty compares well with observed uncertainties for two previous laboratory measurements of the reference material. Received: 21 February 1998 · Accepted: 17 August 1998     

Traceable measurements in clinical laboratories

 Reliable, traceable and comparable measurements provide the rational basis for evaluation of the quality of a result and the starting point for recognized laboratory accreditation in any national area. Modern medical diagnostics and treatment involve rapidly rising numbers and types of clinical laboratory measurements, that are reliable. Therefore, the basic principles to be followed to assure the traceability of clinical measurements as required by the Romanian Laws of Metrology are reviewed. Main sources affecting the quality of the unbroken chain of calibrations that relate the measurements back to appropriate measurement standards are discussed. Examples of how to achieve traceable measurements in clinical laboratories are presented. Details of specific uses of reference materials, measuring instruments and standard measurement methods are also discussed. Received: 8 January 1998 · Accepted: 21 April 1998     

Measurement traceability and US IVD manufacturers: the impact of metrology

A goal of clinical laboratory science is to produce accurate and comparable patient test results for a specimen independent of analytical methodology. The In Vitro Diagnostics Directive in Europe has provided the impetus for the U.S. in vitro diagnostic (IVD) industry to adapt the concepts of Metrology, the science of measurement, including measurement traceability and measurement uncertainty. The joint committee for traceability in laboratory medicine has provided a valuable database of internationally recognized reference materials and methods and reference laboratories. Much of the responsibility for measurement traceability falls on IVD manufacturers, but all global stakeholders, including the clinical laboratory profession, government Regulatory bodies, metrology institutes, and the providers of EQA/PT surveys, must cooperate to progress toward this goal. The adaptation of the concepts of Metrology to the clinical laboratory is an appropriate and logical development and it will continue in the twenty-first century.     

Traceability in the amount-of-substance analysis of natural potassium, thorium and uranium by the method of passive gamma-ray spectrometry

 This paper describes the amount-of-substance analysis of the long-lived naturally occurring radionuclides ⁴⁰K, ²³²Th, ²³⁵U and ²³⁸U by the method of non-destructive passive gamma-ray spectrometry. Calibrands used were standard reference materials and high-purity analytical grade chemicals. Traceability of the measured results to reference materials was established. The emission probabilities of several high-energy gamma-rays were determined. High-energy gammas were measured to decrease the effect of gamma self-attenuation. Received: 31 August 1996 Accepted: 9 November 1996     

The role of certified reference materials in ensuring the quality of spectrochemical measurements – the present status in Romania

 The objective of quality assurance programme for spectrochemical measurements is to reduce the measurement errors to accepted limits. Reference materials are being widely used as measurement standards in the fields of industrial production, environmental protection and clinical chemistry, and are playing an important role in ensuring the quality of measurement results. This paper presents some aspects, practices and examples of the activity of the Reference Materials Laboratory of the National Institute of Metrology, Bucharest, in the field of spectrochemical measurements. An attempt to describe the role and use of reliable certified reference materials to ensure the quality of spectrochemical measurements is presented. A short review of the locally available certified reference materials used in spectrochemical measurements is given. The use of reference materials data in estimating the measurement uncertainty is discussed. An interlaboratory comparison, recently organized in Romania, is also presented as a useful response to the need for quality assurance of spectrochemical results. Received: 20 March 1999 / Accepted: 25 February 2000     

Uncertainty calculations in the certification of reference materials. 1. Principles of analysis of variance

 The preparation and certification of reference materials is a rapidly developing area. Many innovative reference materials have limited homogeneity and stability, and, additionally, the uncertainty estimation of the property values must be brought in agreement with the principles of the “Guide to the expression of uncertainty in measurement” (GUM). The results of the homogeneity and stability studies must be included to a certain extent in the uncertainty of the property values of the reference material, in order to comply with these requirements. The basic theory needed to accomplish this is essentially the theory of analysis of variance (ANOVA). As GUM also allows alternative evaluations other than Type A evaluations, a reinterpretation of the theory of ANOVA is necessary to establish a model for the certification of reference materials that is widely applicable. For this, analysis of variance can be used as a statistical technique to derive standard uncertainties from homogeneity, stability and characterisation data. Received: 10 May 2000 / Accepted: 29 July 2000     

Measurement uncertainty evaluation for a non-negative measurand: an alternative to limit of detection

The interpretation and reporting the results of measurements on materials where the concentration of the analyte is close to or may even be zero has been the subject of much discussion with the use of such concepts as limit of detection (LOD) and limit of quantification (LOQ). While these concepts have taken into account the measurement uncertainty, they have not utilised the fact that the value of the measurand, i.e., the concentration, is constrained to be zero or greater. Taking this into account the distribution of values attributable to the measurand can be derived from the probability density function (PDF) that determines the distribution of the observed values. When this PDF is normal the distribution of the values attributable to the measurand is a truncated t distribution with a lower limit of re-normalised so that the total probability is one, where x _m is the mean of the n observed values and s their standard deviation. When x _m much greater than then the distribution reverts to the unmodified t distribution. The probability that the value of the measurand is above or below a limit can be calculated directly from this truncated t distribution and the interpretation of the result does not require the use of concepts such as LOD and LOQ. Also it deals with the problem of negative observations. This Report was written by Alex Williams (e-mail: aw@camberley.demon.co.uk) for the Statistical Subcommittee and approved by the Analytical Methods Committee.     

Estimation of measurement uncertainty by the budget approach for heavy metal content in soils under different land use

A reference database was used for the estimation of the standard uncertainties resulting from sampling, sample preparation, and analysis of soil samples from a target area in Switzerland. This evaluation was based on an extended reference sampling of the Comparative Evaluation of European Methods for Sampling and Sample Preparation of Soils Project. Samples were taken according to the national sampling protocols of 15 European countries and were analyzed for zinc, cadmium, copper, and lead. The combined uncertainty for all laboratories was estimated according to the ISO Guide to the Expression of Uncertainty in Measurement. It was found that the sampling uncertainty was not larger than the analytical uncertainty if more than ten sample increments were taken. The uncertainty due to variation in sampling depth and sample size reduction was only significant under unfavorable conditions. On the basis of an uncertainty budget the sampling protocols can be optimized and a ranking is possible, aimed at conditions that are fit for the specific purpose.Electronic Supplementary Material Supplementary Material is available in the online version of this article at