Uncertainty calculations in the certification of reference materials 4. Characterisation and certification

The main objective of the certification of a reference material is to determine its property values including their uncertainty. In the previous parts of this series, the basis for the evaluation of measurement uncertainty of the property values has been examined, including the conversion of homogeneity and stability study data into standard uncertainties. In this final part, the determination of the property values and the modelling of the certification process is discussed. It is noted that the characterisation of a reference material can be modelled in some cases using analysis of variance statistics, but a more generally applicable model can be developed based on χ²-fitting. Furthermore, it is concluded that there is an advantage in using absolute standard uncertainties instead of relative ones when modelling the certification process. Received: 14 October 2000 Accepted: 21 January 2001     

Some aspects of the evaluation of measurement uncertainty using reference materials

 In practice there are three aspects that need to be considered in order to achieve the required traceability according to its definition: the 'stated reference', the 'unbroken chain of calibrations' and the "stated uncertainty". For a certain chemical result, each of these aspects highly depends on the measurement uncertainty, both on its magnitude and how it was estimated. Therefore, the paper describes the experience of the Romanian National Institute of Metrology in estimating measurement uncertainty during the certification of reference materials (RMs), in metrological activities (calibration, pattern approval, periodical verification, etc.), as well as during the analytical measurement process. Practical examples of estimation of measurement uncertainty using RMs or certified reference materials are discussed for their applicability in spectrophotometric and turbidimetric analysis. Use of the analysis of variance to obtain some additional information on the components of measurement uncertainty and to identify the magnitude of individual random effects is described. Received: 12 November 1999 / Accepted: 25 February 2000     

Uncertainty calculations in the certification of reference materials

To serve as a measurement standard, a (certified) reference material must be stable. For this purpose, the material should undergo stability testing after it has been prepared. This paper looks at the statistical aspects of stability testing. Essentially, these studies can be described with analysis of variance statistics, including variant regression analysis. The latter is used in practice for both trend analysis and for the development of expressions for extrapolations. Extrapolation of stability data is briefly touched upon, as far as the combined standard uncertainty of the reference material is concerned. There are different options to validate the extrapolations made from initial stability studies, and some of them might influence the uncertainty of the reference material and/or the shelf-life. The latter is the more commonly observed consequence of what is called ’stability monitoring’. Received: 6 October 2000 Accepted: 4 December 2000     

Trends in the certification of reference materials

The certification of reference materials is still a rapidly developing area. Mostly driven by demands from laboratories, new reference materials are produced, and even new categories of materials are developed, such as genetically modified organism materials or materials for qualitative analysis. Even in more classical areas, such as the certification of chemicals for purity, there are important new insights, in particular in modelling the measurements and the property values. Laboratories are asking increasingly for uncertainty budgets of reference materials that are compatible with the concepts of the Guide to the expression of uncertainty in measurement, thus putting stronger demands to improve not only the quality of the materials, but also of the science and technology behind a certification. Three important issues are highlighted to exemplify these trends: the further interpretation of homogeneity and stability data, the appreciation of asymmetry due to mathematical constraints (relevant for, e.g., purity and trace analysis), and the certification of reference materials for qualitative measurement.Presented at BERM-9—9th International Symposium on Biological and Environmental Reference Materials, 15–19June 2003, Berlin, Germany     

Twenty-five years of international collaboration in reference materials via ISO/REMCO

This paper looks back on a quarter century of history of the Council Committee on Reference Materials of the International Organization for Standardization – REMCO. It begins however with the period before its formation in 1976 to describe how the Committee came into being as a response to a growing need by the analytical community for the number and variety of reference materials (RMs) as well as a need for the assurance of the quality of RMs and ends with a view of REMCO activities in the near future. This is not intended as a detailed history but instead to describe the evolution of REMCO by identifying major activities and accomplishments of REMCO. Received: 21 January 2002 Accepted: 22 January 2002     

Traceable property values of in-house reference materials

The traceability of in-house reference materials (IHRM) is discussed. It is shown that a systematic error in results of a measured value, specific to a measurement method or to a laboratory developing an IHRM, can be overcome if a comparative approach to IHRM characterization is used. A traceability chain of the value carried by the IHRM to the value carried by the reference material with higher metrological status and sufficiently similar matrix (for example, a certified reference material – CRM according to ISO Guide 30) is helpful in such a case. The chain is realized when the IHRM samples are analysed simultaneously with the CRM samples under the same conditions. This and other traceability chains necessary for the IHRM development are examined as the measurement information sources.     

Uncertainty calculations in the certification of reference materials. 2. Homogeneity study

 Many reference materials undergo a batch certification, which implies that a small number of samples is taken from a batch, characterised, and these results are then assumed to be representative of all remaining samples. An important aspect in this design is the translation of the characterisation data to a single sample, as usually the laboratory will be using only one sample of the batch. This form of homogeneity is very important and can be influenced to a certain extent by well-designed sample preparation procedures. Another subsampling problem associated with many reference materials is that only a small test portion is drawn from the sample to carry out the measurement. Obviously, this test portion must be representative of the sample, otherwise the certified value is still not applicable. Both kinds of homogeneity tests are examined in the paper and evaluated using practical examples. Received: 31 May 2000 · Accepted: 29 July 2000     

Use of ISO Guides 25, 30, 31, 34, 35, and 9001 in re-engineering Bethlehem Steel Corporation's analytical chemistry reference materials program

 Many certified reference materials are needed to calibrate and control analytical measurement processes in integrated steel works. It is beyond the scope and capacity of most national laboratories to supply all of these needs. Yet, the demand for these materials is steadily increasing as more steel producers update their quality systems in preparation for ISO 9000 registration and/or ISO Guide 25 laboratory accreditation assessments. This paper describes how the Bethlehem Steel Corporation updated its reference materials program to meet its internal needs and offers a model for use by others in improving their programs. Received: 22 April 1998 · Accepted: 12 May 1998     

Uncertainty calculations in the certification of reference materials. 1. Principles of analysis of variance

 The preparation and certification of reference materials is a rapidly developing area. Many innovative reference materials have limited homogeneity and stability, and, additionally, the uncertainty estimation of the property values must be brought in agreement with the principles of the “Guide to the expression of uncertainty in measurement” (GUM). The results of the homogeneity and stability studies must be included to a certain extent in the uncertainty of the property values of the reference material, in order to comply with these requirements. The basic theory needed to accomplish this is essentially the theory of analysis of variance (ANOVA). As GUM also allows alternative evaluations other than Type A evaluations, a reinterpretation of the theory of ANOVA is necessary to establish a model for the certification of reference materials that is widely applicable. For this, analysis of variance can be used as a statistical technique to derive standard uncertainties from homogeneity, stability and characterisation data. Received: 10 May 2000 / Accepted: 29 July 2000     

The interpretation and use of stability data in the certification of reference materials

 Stability tests are carried out on candidate reference materials in order to ascertain that the certification values continue to be valid a reasonable time after completion of the certification analysis. These tests are also used for recommending storage conditions, as well as the duration of storage before certification values need be rechecked. BCR (Community Bureau of Reference) reference materials do not normally have an expiry date, but rely on stability monitoring throughout the lifetime of the certified material. The 1997 version of the BCR Guidelines for the production and certification of reference materials does, however, take into account the necessity of limiting the validity of a certification, when degradation of the material during storage cannot be ignored. This paper discusses an example of significant degradation taking place between the time of completion of the certification analysis and the issue of a formal certificate. Various options are presented together with an account of their influence on the certified values and their uncertainties. Received: 3 October 1997 · Accepted: 3 November 1997     

A traceability protocol to the SI by gravimetric analysis

 An example is presented of a traceability protocol for the measurement of a single-element strontium reference material solution, executed by a "primary" method of measurement for certification. The method of measurement is briefly described together with the measurement equation and the associated calculations for the estimation of uncertainties. This is followed by a discussion and estimate of each component of uncertainty associated with the measurement, together with a final estimate of uncertainty. The final estimate of uncertainty compares well with observed uncertainties for two previous laboratory measurements of the reference material. Received: 21 February 1998 · Accepted: 17 August 1998     

The NATA scheme for accreditation of certifiers of reference materials

 Certified reference materials are widely used for the calibration of measuring equipment and for the evaluation or validation of measurement procedures. The use of reference materials makes possible the transfer of the values of measured or assigned quantities between testing, analytical and measurement laboratories, both nationally and internationally. There is an increasing number of reference materials producers in other countries, and a demonstration of their scientific and technical competence is now more widely considered to be a basic requirement for ensuring the quality of reference materials. This article outlines recent activities by international bodies and their culmination in a scheme of accreditation of certifiers of reference materials which has been developed by the National Association of Testing Authorities, Australia (NATA).     

Measurement uncertainty of selenium determination in the reference material Seronorm Trace Elements Serum by hydride generation atomic fluorescence spectrometry

 An analytical result is not considered to be complete without a statement of the measurement uncertainty associated with it. Evaluation of measurement uncertainty is therefore an essential part of every determination. In the present study the measurement uncertainty of the result of determination of selenium in the reference material Seronorm Trace Elements Serum was studied. The combination of a digestion procedure using sulfuric acid, V₂O₅ in H₂SO₄ and hydrogen peroxide and the continuous flow approach of hydride generation atomic fluorescence spectrometry (HG-AFS) detection was used for selenium determination. The total uncertainty budget was calculated with the help of the GUM Workbench program, in which computations follow the rules of the ’ISO guide to the expression of uncertainty in measurement’. The major sources of uncertainty were found to be due to the recovery of the procedure, measurement of peak heights and the purity of Na₂SeO₃. A selenium mass fraction of 77.1±4.8 ng/g (with a coverage factor of 2.1, 95% probability) was determined, which is comparable with the recommended value of 80 ng/g. Received: 13 September 2002 Accepted: 23 December 2002 Acknowledgements We would like to thank Tinkara Buˇcar, B.Sc. for useful discussions and the IAEA Vienna, for financial support of the project 11553/RO. Presented at CERMM-3, Central European Reference Materials and Measurements Conference: The function of reference materials in the measurement process, May 30–June 1, 2002, Rogaška Slatina, Slovenia Correspondence to V. Stibilj     

Development and supply system of reference materials based on the Measurement Law in Japan

 Analytical instruments used for measurements of air and water pollution are calibrated by using reference materials such as standard gases and standard solutions. In Japan, since the middle of the 1970s, those reference materials which are traceable to the national standards maintained at national research institutes have been supplied to users by reference material producers. In order to establish the primary standards and to secure the traceability from the working standards to the national ones, various analytical methods such as coulometric, titrimetric and gravimetric analyses for purity determination and highly sensitive atomic spectrometry for trace analysis have been developed as the primary methods and reference methods. The Japanese Measurement Law, revised in 1992, has introduced a new traceability system in which a public organization, a "designated calibration body", can also prepare and maintain the national standards under the advice and instruction of national research institutes. The designated calibration body can provide calibration services to reference material producers (accredited calibration bodies) by using the national standards. The reference materials supplied in conformity with the traceability system include standard gases, pH standard solutions, metal standard solutions and non-metal ion standard solutions. Received: 4 October 1996 Accepted: 2 December 1996     

Measurement uncertainty and the use of reference materials

The use of (certified) reference materials and quality control materials can form a suitable basis for evaluating measurement uncertainty of routine measurements. In particular when these materials are used for quality control purposes, it is not always evident how the quality control data can be used in the uncertainty budget of a routine measurement. Current guidance documents on the evaluation of measurement uncertainty and the use of reference materials treat this subject only in part, or in very generic terms. ISO/REMCO has established a new working group that will provide practical guidance and examples on how to use quality control data in the evaluation of measurement uncertainty. A short introduction to the subject is given.

Preparation and analysis of a reference material for the measurement of oxygen in copper

The preparation and analysis of the oxygen mass fraction of three pure copper reference materials (BAM-379/1, BAM-379/2, BAM-379/3) intended for the calibration of spark emission spectrometry are described here. Data of homogeneity testing and round robin certification in collaboration with 12 independent laboratories from metalworking industry and research are reported. Problems with the establishment of traceability in this special case are discussed. Received: 20 July 2001 Accepted: 13 October 2001     

A framework for the application and materials in analytical chemistry

 Working group 5 of EuraChem Nederland has developed a framework for the implementation of reference materials in analytical chemistry. In this discussed paper, the framework is proposed as a tool for the development of standard operation procedures (SOPs) in laboratories. The implementation of (certified) reference materials in these SOPs is of major importance in establishing comparability and traceability in measurement results, which in turn play a crucial role in measurement in support of trade, environmental issues, and characterisation of materials. Recent developments in the field of uncertainty analysis require the application of reference materials. It is recognised that the calculation of the combined measurement uncertainty becomes almost impossible without the use of certified reference materials with a stated uncertainty. Received: 1 December 1995 Accepted: 20 December 1995     

ISO uncertainty and collaborative trial data

 The possibility of using interlaboratory study repeatability and reproducibility estimates as the basis for measurement uncertainty estimates is discussed. It is argued that collaborative trial reproducibility is an appropriate basis for estimating uncertainty in routine testing provided certain conditions are met by the laboratory. The primary shortcomings relate to establishment of traceability and consequent estimation of bias associated with the method, and quantitatively establishing the relevance to the single laboratory. Approaches to resolving both difficulties are proposed, the former via full implementation of trueness determination suggested in ISO 5725 : 1994 or by independent checks on individual accuracy and precision, the latter via a reconciliation procedure. The paper also discusses other factors including sampling and sample pre-treatment, change in sample matrix, and the influence of level of analyte. Received: 28 October 1997 · Accepted: 17 November 1997     

Accreditation of reference material producers

 The use of reference materials is the most pragmatic means by which the analyst can achieve comparability of data. Reference material producers therefore need to have adequate quality systems in place for ensuring the reliability of their materials. In order to provide guidance to both producers and assessors, ISO Guide 34 has recently been produced detailing the quality system requirements for the production of reference materials. CITAC, REMCO and ILAC are now collaborating in the revision of this guide to produce a free-standing document detailing the general requirements for the competence of reference material producers. This paper discusses some of the more important issues described in these documents. The possible formation of an international register containing details of a reference material producer's quality system status is also discussed.