Some aspects of the evaluation of measurement uncertainty using reference materials

To ensure and to confirm the required traceability according to the definition given in the International Vocabulary of Basic and Standard Terms in Metrology, three main aspects need to be considered in practice: “stated reference”, “unbroken chain of calibration” and “stated uncertainty”. For a certain spectrochemical result, each of the aspects above mentioned is highly dependent on measurement uncertainty, both on its magnitude and how it was estimated. The paper describes the experience of the Romanian National Institute of Metrology (INM) in estimating measurement uncertainty during certification of reference materials, in metrological calibration and during specific analytical processes. Practical examples of the use of reference materials or certified reference materials issued by the INM to estimate measurement uncertainty are discussed for their applicability in spectrochemical and turbidity analysis. Some aspects of the use of analysis of variance (ANOVA) to obtain additional information on the components of measurement uncertainty and to identify the magnitude of individual random effects are presented.     

Some aspects of the evaluation of measurement uncertainty using reference materials

To ensure and to confirm the required traceability according to the definition given in the International Vocabulary of Basic and Standard Terms in Metrology, three main aspects need to be considered in practice: "stated reference", "unbroken chain of calibration" and "stated uncertainty". For a certain spectrochemical result, each of the aspects above mentioned is highly dependent on measurement uncertainty, both on its magnitude and how it was estimated. The paper describes the experience of the Romanian National Institute of Metrology (INM) in estimating measurement uncertainty during certification of reference materials, in metrological calibration and during specific analytical processes. Practical examples of the use of reference materials or certified reference materials issued by the INM to estimate measurement uncertainty are discussed for their applicability in spectrochemical and turbidity analysis. Some aspects of the use of analysis of variance (ANOVA) to obtain additional information on the components of measurement uncertainty and to identify the magnitude of individual random effects are presented.     

New developments in the production and use of CRMs in Romania

 A lot of effort is being made in Romania to meet the present main strategic goal – EU integration. Since the confidence in measurements is of considerable importance in almost every field of activity, the National Institute of Metrology (INM) is involved in improving its calibration and measurement capabilities to provide services in accordance with the latest European Regulation. Within this framework the assurance of the required traceability of all measurements plays a most important role. As reliable analytical measurements depend largely upon reference materials and the assurance of the traceability of amount measurements is still developing in Romania, a new approach regarding the function of Certified Reference Materials (CRMs) may be emphasized. The experience of the INM as well as new developments in Romania in preparation and certification of Reference Materials (RMs) are described. A short review of the locally available RMs and CRMs is given. Some aspects regarding the use of RMs and CRMs, especially for calibration, are discussed for their applicability for analytical measurements. Received: 31 October 2002 Accepted: 24 January 2003 Presented at CERMM-3, Central European Reference Materials and Measurements Conference: The function of reference materials in the measurement process, May 30–June 1, 2002, Rogaška Slatina, Slovenia Correspondence to M. Buzoianu     

Reference materials and certified reference materials for spectrometry in Romania

Several reference materials (RMs) and certified reference materials (CRMs) are widely used in Romania as measurement standards in different spectrochemical measurements. Among them, single element standard solution certified for their mass concentration play a key role in ensuring the required traceability of results expressed in this measurement unit. A short review of the locally available elemental RMs and CRMs used in atomic spectrometry or in other analytical techniques where aqueous standard solutions are required (usually called RMs or CRMs for spectrometry) is given. The experience of the INM in preparation and certification of such materials is described. Some aspects regarding their use for ensuring the accuracy and for confirmation of the traceability of analytical measurements, especially through calibration and metrological validation of main instrument performances, are discussed.     

Reference materials and certified reference materials for spectrometry in Romania

Several reference materials (RMs) and certified reference materials (CRMs) are widely used in Romania as measurement standards in different spectrochemical measurements. Among them, single element standard solution certified for their mass concentration play a key role in ensuring the required traceability of results expressed in this measurement unit. A short review of the locally available elemental RMs and CRMs used in atomic spectrometry or in other analytical techniques where aqueous standard solutions are required (usually called RMs or CRMs for spectrometry) is given. The experience of the INM in preparation and certification of such materials is described. Some aspects regarding their use for ensuring the accuracy and for confirmation of the traceability of analytical measurements, especially through calibration and metrological validation of main instrument performances, are discussed.     

Guidance on the contents of accompanying documentation for reference materials (RMs)

The use of reference materials (RMs) is a key activity for the improvement and maintenance of a worldwide coherent measurement system. As detailed in ISO Guide 33, RMs with different characteristics are used in measurement processes, for the purpose of precision control, bias assessment, calibration, assigning values to other materials, and maintaining conventional scales, to name a few. For the establishment of metrological traceability of measurement results to international scales or other measurement standards, proper use of certified reference materials (CRMs) is essential. From the perspective of a reference material producer, the documentation that is provided with an RM is the value-adding component of the material; for the user, the document is critical for the correct implementation and use of the RM in the measurement process. The ISO Committee on Reference Materials (ISO/REMCO) recognised the importance of the documentation that accompanies a reference material as early as 1981 when the first edition of ISO Guide 31 was published. The third edition of the Guide that was published recently considers the appropriate accompanying documentation for all types of reference materials, i.e. CRMs and non-certified RMs.     

Global perspectives for secondary reference materials for analysis of food and related biological samples

Primary, secondary and tertiary reference materials (RM) play an important role in quality controls of analytical measurements. Logistics of preparation and proper use of primary and secondary RMs are presented. Tertiary (i.e. in-house) control materials are useful as substitutes in the absence of recognized primary or secondary RMs. The lack of interdisciplinary interaction during development of RMs (e.g. in specific areas such as foods), has an important impact on limiting the usefulness of certain types of RMs. The abundance of RMs in some countries and regions appears to have little effect on the existing paucity in RMs in other regions, and the underlying causes are outlined. The ability of a laboratory to produce good quality in-house RMs traceable to recognized primary or secondary RMs is a direct measure of its quest for reliable analytical data. Therefore many laboratories should be encouraged to engage in secondary and tertiary RM activities designed to answer specific measurement problems. In this context, assistance (e.g. practical training opportunities) in identifying simple methods of analyses for their efficacy in determining specific analytes is a source of help that can be extended to countries experiencing limitations in laboratory instrumentation.     

The new ISO Guide 80: Guidance for the in-house preparation of quality control materials (QCMs)

Reference materials (RMs) are widely used in measurement laboratories for a variety of purposes, and it is important to recognise that the material most appropriate for a particular application should be used. Certified reference materials (CRMs) are used for method validation, the calibration of a measurement system and all other aspects of the evaluation of the measurement system where the trueness of the measurement result is required. For other aspects, such as quality control, precision studies, the checking of the variability between operators, where the results are compared relatively, any suitable reference material can be used. ISO/REMCO, the ISO Committee on Reference Materials, has prepared ISO Guide 80, a guidance document for the in-house preparation of quality control materials (QCMs). QCMs are mostly used to monitor the performance of laboratory methods that have already been validated over time to be able to detect change or when a method goes out of statistical control. QCMs are RMs and as such have to be sufficiently homogeneous and stable for the intended use. QCMs are usually prepared in-house by laboratory staff for in-house use only, and therefore, the requirements for “in-house” QCMs are less demanding than those for a CRM. For example, transport issues are not of concern. The quality assessment of QCMs should involve homogeneity and stability assessments, and a limited characterisation of the material to provide an indication of its relevant property values and their variation, prior to use.     

Experimental design and data evaluation considerations for comparisons of reference materials

The analysis of reference materials (RMs) can help assess the equivalence of chemical measurement processes. When two or more RMs are available for a given measurand, confidently establishing the equivalence of measurement processes requires the RMs to be capable of yielding equivalent results. Evaluating the degrees of equivalence among RMs that differ in analyte quantity and perhaps matrix composition requires an approach other than that used to assess results for samples of a single material. We have more than a decade of experience with an approach that compares the assigned values of RMs to a simple linear model of the relationship between those values and measurement results ideally made under repeatability conditions. In addition to accessing the metrological equivalence of specific RMs, the equivalence of the value-assignment capabilities of the organizations that issue the RMs can also be accessed. This report summarizes our experience with the design of and analysis of studies using this approach and provides numeric and graphical tools for estimating degrees of equivalence. We divide the required tasks into four steps: (1) design, (2) measurement, (3) definition of a reference function, and (4) estimation of degrees of equivalence. We regard the experimental design and measurement tasks as most critical to the eventual utility of the comparison, since creative mathematics cannot fully compensate for poor planning or erratic measurements.     

Correcting measurement errors using reference materials in method validation

Quality assurance and method validation are needed to reduce false decisions due to measurement errors. In this context accuracy and standard uncertainty for the analytical method need to be considered to ensure that the performance characteristics of the method are understood. Therefore, analytical methods ought to be validated before implementation and controlled on a regular basis during usage. For this purpose reference materials (RMs) are useful to determine the performance characteristics of methods under development. These performance parameters may be documented in the light of a method evaluation study and the documentation related to international standards and guidelines. In a method evaluation study of Pb in blood using reference samples from the Laboratoire Toxicologie du Quèbec, Canada, a difference between the systematic errors was observed using a Perkin-Elmer Model 5100 atomic absorption spectrometer and a Perkin-Elmer Model 4100 atomic absorption spectrometer, both with Zeeman background correction. For measurement of blood samples, the performance parameters obtained in the method evaluation studies, i.e. slopes and intercepts of the method evaluation function (MEF), were intended to be used for correcting the systematic errors. However, the number of MEF samples was insufficient to produce an acceptable SD for the MEF slopes to be used for correction. In a method evaluation study on valproate in plasma using the SYVA's EMIT assay on COBAS MIRA S a significant systematic error above the concentration 300 mmol dm^–3 was demonstrated (slope 0.9541) and consequently the slope was used for correction of results. For analytes, where certified RMs (CRMs) exist, a systematic error of measurements can be reduced by correcting errors by assessment of the trueness as recommended in international guidelines issued by ISO or the National Institute of Standards and Technology (NIST). When possible, the analysis of several RMs, covering the concentration range of interest, is the most useful way to investigate measurement bias. Unfortunately, until recently only few RMs existed and only few had been produced and certified by specialized organizations such as NIST or the Standards, Measurements and Testing (SMT, previously BCR) programme. Due to the lack of such RMs, network organizations are nowadays established with the aim of supporting the correct use and production of high-quality CRMs.     

The establishment of a quality evaluation system of reference materials

Reference materials have been applied widely to ensure the traceability, comparability and reliability of measurement results. To achieve this purpose, the quality of reference materials (RMs) themselves is surely an important aspect to be pay attention to. A quality evaluation system of RMs has been established through the project “The National Sharing Platform of Reference Materials” in China to give a reliable assessment on the quality of RMs from various sources including the accuracy and comparability of their property values, which is very useful to promote the appropriate selecting and using of RMs in China. Through the application of National Metrology Institute calibration and measurement capabilities on the basis of the international mutual recognition arrangement, it can also provide a powerful supplement to the current activities such as the accreditation of RM producers in the construction of a global harmonized quality control and assurance system of RMs.     

Development of reference materials for microbiological analysis

The reliability of reference materials (RMs) depends on properties such as fitness, robustness, commutability, stability and homogeneity. The development of RMs for microbiological analysis is especially challenged through questions around the stabilisation and recovery of viable cells, the dispersion of precise numbers of cells, matrix effects and, when using molecular techniques, the presence of nucleic acids (e.g. DNA) of dead and live target organisms. However, RMs are indispensable tools for quality control in microbiological analysis. The Institute for Reference Materials and Measurements (IRMM), as part of the European Commission, concentrates its efforts on the development of RMs to support the development, implementation and monitoring of EU legislation. A special focus is given to highly precise RMs for presence/absence and enumeration tests in microbiological food and water analysis. Another group of new RMs certified by the IRMM comprise DNA-based materials to control the identity of micro-organisms in qualitative assays. All of these activities serve to improve quality control in microbiological analysis. Presented at ‘BERM-10’, April 2006, Charleston, SC, USA.     

IAEA Programme of natural matrix reference materials for the determination of radionuclides

Summary The International Atomic Energy Agency has been providing analytical quality control services (AQCS) to its Member States since the 1960's. The AQCS programme distributes reference materials (RMs), organizes intercomparison runs, and provides training courses for quality assurance in chemical analysis and radioactivity measurements of food, biological, environmental and marine materials. This paper focusses on those aspects of the subject dealing with reference materials and intercomparison runs for the determination of radionuclides. Nineteen natural matrix reference materials are available for the determination of radionuclides. Twelve new intercomparison and reference materials are in preparation or under consideration. The radionuclides of interest include: K-40, Mn-54, Co-60, Sr-90, Tc-99, Ru-106, Ba-133, Cs-134, Cs-137, Pb-210, Ra-226, Th-228, Th-232, Pu-238, Pu-239+240.     

Certified reference materials for the quality control of environmental analysis within the standards,measurements and testing programme (formerly BCR)

A great number of analyses is performed every year, the results of which are used for many purposes, e.g. the quality of goods and food, the status of quality of the environment or the health of patients. The accuracy of these results is a prerequisite for a good interpretation of the data obtained. One of the most powerful tool for achieving quality control of chemical analysis is to use reference materials (RMs) and certified reference materials (CRMs). These materials are necessary for one or more of the following items: method validation (CRMs), monitoring of the state of statistical control (RMs), samples in inter-comparisons (RMs), etc. The requirements and use of RMs and CRMs in chemical analysis are described, with special emphasis on environmental analysis, and some examples of environmental materials currently in production within the Standards, Measurements and Testing Programme (formerly BCR) of the European Commission are given.     

Reference materials in the Russian system of accreditation of analytical laboratories

 This article is devoted to the role of reference materials (RMs) in chemical analysis and their main applications in analytical laboratories. The principal requirements of the RMs used in accredited laboratories in the Russian Analytical Laboratories Accreditation System (SAAL) are presented. These include the basic regulatory and metrological requirements of RMs. Finally, a review of the provision of RMs used for the analytical control of various test objects is presented. Received: 9 August 1998 / Accepted: 9 November 1998     

Reference materials for measuring the size of nanoparticles

This article discusses the requirements for reference materials (RMs) for measuring the size of nanoparticles (NPs). Such RMs can be used for instrument calibration, statistical quality control or interlaboratory comparisons. They can come in the form of suspensions, powders or matrix-embedded materials [i.e. NPs integrated in a natural matrix (e.g., food, soil, or sludge)].At present, uncertainty about the most suitable form of material, the most relevant measurands and the most useful metrological-traceability statement inhibits the production of NP RMs. In addition, the lack of validated methods and qualified laboratories to produce NP RMs present formidable challenges.Metal, inorganic and organic NPs are available, but most of them are intended to be laboratory chemicals. With the exception of latex materials, certified RMs are not available, although some metrology institutes have started to develop such materials for colloidal gold and silica particles.     

Development of clenbuterol reference materials: lyophilized bovine eye samples free of clenbuterol (CRM 673) and containing clenbuterol (CRM 674)

The certification by inter-laboratory testing of two candidate reference materials (RMs) for the mass concentration of the anabolic agent clenbuterol in bovine eye material is described: RM 674 with ca 10 microg clenbuterol per kg of eye matrix and RM 673 clenbuterol-free eye matrix as the negative control (<0.50 microg kg(-1)). Both candidate RMs were certified by eleven EU laboratories, and sixty-six accepted replicate measurements were included in the "Certification Study". The precision of the measurement process was assessed by calculation of the standard variation determined within each laboratory during the certification step. The study was performed according to the "Guidelines for the production and certification of BCR reference materials" and to "ISO guide 31, 33, and 35". The certified clenbuterol mass concentration for clenbuterol-free eye material CRM 673 (calculated on the basis of clenbuterol as the free base) was <0.50 microg kg(-1). The corresponding concentration for clenbuterol-containing eye material CRM 674 was 9.42 +/- 0.88 microg kg(-1). These certified values are very close to the desired target concentration of <0.5 microg kg(-1) and ca 10 microg kg(-1). This study has demonstrated that successful certification of clenbuterol-containing and clenbuterol-free bovine eye materials is possible.     

The future demand for geological reference materials

Geological RMs (G-1 and W-1) were introduced in 1951 for the purpose of validating the accuracy of silicate rock analysis by dc arc spectrography. Since then the introduction of an array of other spectrographic methods has greatly enhanced research into geological processes. The range of elements that could be determined was expanded, and the detection limits for measurement was lowered repeatedly through the years. The development and use of reference materials was critically important in supporting this rapid expansion of geological research. Essentially, all RMs are of importance to the geosciences community since G-1 and W-1 have been prepared and distributed by national geological institutions, first by the USGS or the CRPG, rather than by national metrology institutions. These geological institutions are not yet certifying their RMs according to ISO Guides. The International Association of Geoanalysts (IAG) is seeking to meet this higher metrological requirement. Since the inception of the IAG certification program in 2003, five powdered silicate rock materials have been issued to meet the demand with respect to calibration, method validation, traceability, etc. for whole rock major and trace element analysis. The introduction of microanalytical techniques nearly decades ago and the more recent advent of MC-ICP-MS have become new driving forces in geochemical research. The first opened the possibility of performing in situ elemental composition studies at the ??m scale. The second led to the discovery of small isotope composition variations of mass- and non-mass-dependent processes in ??non-traditional?? stable isotopes (e.g., Fe, Cu, Zn, Mo, W, and Hg) through cosmo- and geochemical processes. Coupling the two techniques expands in situ analysis to isotopic studies. These developments have created great demand for (certified) RMs for both isotope ratio and microanalytical measurements for the geochemical community that is not yet being met. Homogeneity at a ??m scale and unmatched matrices of the natural minerals or synthetic doped glasses hamper the progress in certification of RMs for the microanalytical measurement community. A challenge for the production of isotope RMs is to prepare an RM solution with an isotopic composition similar to the natural systems under investigation. Refined cadmium and nickel metals, for example, have fractionated isotopic compositions far above the range observed in natural systems of interest. Yet, the calibration RM cannot fulfill its purpose when the uncertainty of its isotopic composition exceeds that of the unknowns being measured against it. In this regard, the IAG has recently certified a calibration solution for the determination of Os isotopic ratios. It is also working through member organizations, USGS, and MPI for Geochemistry (Mainz) to develop appropriate microanalytical standards. In addition to these current and future challenges, establishing metrological traceability of geological reference materials in the absence of starting points developed by national metrology institutions is a major issue that needs attention in all future certifications.     

Reference materials in environmental trace organic analysis

 The paper reviews the application of reference materials (RMs) in environmental analysis of trace organic pollutants. The problems related to RM preparation, stability, use, etc. are critically discussed. Importance of analytical quality assurance and the role RMs play in the process are emphasised. Received: 18 May 1999 · Accepted: 27 December 1999     

How accurate must a reference material be?

 This article deals with reference materials (RMs) used for calibration purposes. For most common spectroscopic and chromatographic methods, RMs which have a relative content uncertainty of up to 3% can be used without considerably increasing the overall measurement uncertainty of the complete procedure. It is vital that the correct amount of the RM is used to ensure the quality of the quantitative chemical analyses. This can only be guaranteed if, in addition to the correct determination of the amount, the stability of the RM in the sales packaging is considered in the quoted uncertainty. For instance when the RM is packed in a container made of polyvinylidene fluoride water losses in hot climates can result in an increase in concentration which cannot be neglected. This is also true for high density polyethylene containers (PE-HD) although to a lesser degree. When mercury solutions of 1000 mg/l to 10 000 mg/l are kept in diluted nitric acid in PE containers, a relevant reduction in amount can be measured despite the water losses. However, the solutions remain stable in glass containers.