Achieving traceability in chemical measurement—a metrological approach to proficiency testing

ISO/IEC 17025 requires that testing laboratories establish the traceability of their measurements, preferably to the SI units of measurement. The responsibility for establishing traceability lies with each individual laboratory and must be achieved by following a metrological approach.The results of measurements made in such a way are traceable to the standards used in method validation and to the calibration standards used during the measurement process. If these standards are traceable to SI then the measurements will also be traceable to SI.Participation in appropriate proficiency studies (an ISO/IEC 17025 requirement) enables laboratories to demonstrate the comparability of their measurements. If the materials used for the studies have traceable assigned values, then proficiency testing also provides information about measurement accuracy and confirms, or otherwise, that appropriate traceability has been established. This paper will report on a new approach for the establishment of traceable assigned values for chemical testing proficiency studies. The work is conducted at a "fit for purpose" level of measurement uncertainty, with costs contained at a level similar to previous "consensus" based proficiency studies. By establishing traceable assigned values in a cost effective way, NARL aims to demonstrate the added value of the metrological approach to participant laboratories.     

Measurement uncertainty—Surveys about customers' knowledge, reactions and needs

During discussions early in 2000, representatives of accredited analytical laboratories expressed concern about what the customers' reactions might be when the new requirements for evaluating and reporting uncertainty are implemented. In collaboration with accreditation bodies, authorities, laboratories and interest organisations, a two-page leaflet was produced. It was intended to be used by testing laboratories as information, e.g. together with the test report. To gain further insight into customers' views on measurement uncertainty, two surveys were conducted among some 1,200 Swedish customers. The result shows that the majority of them need and value uncertainty statements in the test report.     

Confidence in testing services – new expectations, new rules, new challenges. 5th Eurolab Symposium offered important information and stimulating discussions

The 5th Eurolab Symposium on 4th and 5th October in Edinburgh was the highlight event of Eurolab in 2000, Eurolab’s 10th anniversary year. Under the title: ”Confidence in Testing Services – new expectations, new rules, new challenges” it reflected recent changes and developments in the laboratory scene and focussed on new tasks and challenges. The most essential changes for laboratories are connected with the new standard ISO/IEC 17025 ”General requirements for the competence of testing and calibration laboratories”. Keywords in this respect are uncertainty of measurement and traceability to SI units, requirements on personnel, proficiency testing, customer orientation, and management systems.     

Integration of metrological principles and performance evaluation in a proficiency testing scheme in support of the Council Directive 98/83/EC

Proficiency testing as a means of external quality assessment plays the role of independent evidence of laboratories’ performance. To enable laboratories to fulfil the requirements stated in legislation, methodology for evaluation of laboratories’ performance in proficiency testing schemes should incorporate principles of measurement results which are fit for intended use and incorporate evaluation of laboratories’ performances based on independent reference value. A proficiency testing scheme was designed to support Drinking Water Directive (98/83/EC) specifically. The methodology for performance evaluation, which takes into account a “fitness for purpose”-based standard deviation for proficiency assessment, is proposed and discussed in terms of requirements of the Drinking Water Directive. A ζ′-score, modified by application of target uncertainty was developed in a way that fulfils requirements defined in the legislation. As an illustration, results are reported for nitrate concentration in water. The approach presented can also be applied to other fields of measurements.     

Quality issues in proficiency testing

 Proficiency testing is a means of assessing the ability of laboratories to competently perform specific tests and/or measurements. It supplements a laboratory's own internal quality control procedure by providing an additional external audit of their testing capability and provides laboratories with a sound basis for continuous improvement. It is also a means towards achieving comparability of measurement between laboratories. Participation is one of the few ways in which a laboratory can compare its performance with that of other laboratories. Good performance in proficiency testing schemes provides independent evidence and hence reassurance to the laboratory and its clients that its procedures, test methods and other laboratory operations are under control. For test results to have any credibility, they must be traceable to a standard of measurement, preferably in terms of SI units, and must be accompanied by a statement of uncertainty. Analytical chemists are coming to realise that this is just as true in their field as it is for physical measurements, and applies equally to proficiency testing results and laboratory test reports. Recent approaches toward ensuring the quality and comparability of proficiency testing schemes and the means of evaluating proficiency test results are described. These have led to the drafting of guidelines and subsequently to the development of international requirements for the competence of scheme providers. Received: 2 January 1999 · Accepted: 7 April 1999     

An error model for evaluation and interpretation of proficiency testing

Data from proficiency testing can be used to increase our knowledge of the performance of populations of laboratories, individual laboratories and different measurement methods. To support the evaluation and interpretation of results from proficiency testing an error model containing different random and systematic components is presented. From a single round of a proficiency testing scheme the total variation in a population of laboratories can be estimated. With results from several rounds the random variation can be separated into a laboratory and time component and for individual laboratories it is then also possible to evaluate stability and bias in relation to the population mean. By comparing results from laboratories using different methods systematic differences between methods may be indicated. By using results from several rounds a systematic difference can be partitioned into two components: a common systematic difference, possibly depending on the level, and a sample-specific component. It is essential to distinguish between these two components as the former may be eliminated by a correction while the latter must be treated as a random component in the evaluation of uncertainty. Received: 20 November 2000 Accepted: 3 January 2001     

News from CEN/BT/WG 122 uncertainty and EA expert group on uncertainty

Since the publication in 2000 of the standard ISO/IEC 17025 "General requirements for the competence of testing and calibration laboratories", the concept of uncertainty of measurement or test results seems to be a key issue for laboratories and their clients. Two working groups are trying to implement this concept in testing activities. The CEN/BT/WG122 has proposed to the technical bureau of CEN a series of recommendations on how to introduce this concept in European standards and the EA expert group on uncertainty has prepared a guidance document in order to help the testing community in uncertainty evaluation. The objective of this paper is to report the current situation of these two groups.     

Measurement uncertainty—policy and guidance documents issued by accreditation bodies

ISO/IEC 17025 contains general requirements for the competence of calibration and testing laboratories, including those for the evaluation and reporting of measurement uncertainty. Some accreditation bodies have issued additional guidance documents and regulations related to uncertainty, five of which are briefly commented on here.Presented at Roche Diagnostics' Workshop on in vitro diagnostics directive. A Nordic event about the implication of traceability and uncertainty in practice, Helsinki, February 13, 2003.     

Estimates of uncertainty of measurement from proficiency testing data: a case study

The results obtained by a laboratory over a number of proficiency testing/external quality assessment schemes (PT/EQAS) rounds can give information on the uncertainty of its measurements for a given test, provided that conditions such as full coverage of the routine analytical range, traceability, and small uncertainty of the assigned values (compared to the spread of the results) are met and provided that systematic deviations and any other sources of uncertainty are considered. As organisers of the Italian EQAS (ITEQAS) in occupational and environmental laboratory medicine, we tested this hypothesis using as model data from well-performing laboratories taking part in ITEQAS for lead in blood over the last 2 years. We also investigated how different PT/EQAS features (frequency of trials and number of samples) would affect a laboratory estimate of its uncertainty. Such information can be helpful in improving PT/EQAS organisation and define, for a given test: (a) the state of the art of the uncertainty of current measurement procedures, (b) identify needs for improvement of analytical methodologies and (c) set targets for acceptable uncertainty values.Presented at the Eurachem PT Workshop September 2005, Portorož, Slovenia.Papers published in this section do not necessarily reflect the opinion of the Editors, the Editorial Board and the Publisher.     

ISO/IEC 17043: the new International Standard for proficiency testing

The revision of ISO/IEC Guide 43 is well underway by CASCO Working Group 28, with the author as Convener. The ballot on the committee draft was successfully completed in June 2008. The Working Group met in September to resolve the CD comments and to recommend that the document should advance as an ISO/IEC DIS. The document is in harmony with ISO/IEC 17025 (2005), ILAC G13 (2007), and the IUPAC Harmonized Protocol (2006) for proficiency testing. Major changes from Guide 43 include considerations for inspection bodies, requirements for metrological traceability of assigned values for calibration schemes, limitations on subcontracting, requirements for reporting the uncertainty of assigned values, and for including method information and technical commentary in scheme reports. Minor changes include requirements for equipment used in the manufacture and testing of proficiency test items, considerations for handling laboratories’ reported uncertainties, and the issuance of certificates of participation. These changes have not generated any substantial objections from the CASCO membership and liaisons.     

Performance of uncertainty evaluation strategies in a food proficiency scheme

A study of the performance of different uncertainty evaluation strategies among 163 voluntary respondents from food proficiency schemes is presented. Strategies included use of: single-laboratory validation data, quality control data, past proficiency testing data, reproducibility data, a measurement equation and the dispersion of replicate observations on the test material. Most performed reasonably well, but the dispersion of replicate observations underestimated uncertainty by a factor of approximately 3. Intended compliance with accreditation requirements was associated with significantly improved uncertainty evaluation performance, while intended compliance with the ISO “Guide to the expression of uncertainty in measurement” had no significant effect. Substituting estimates based on the Horwitz or Horwitz–Thompson models or on PT target standard deviation for the respondents’ own estimates of uncertainty led to a marked reduction in poor zeta scores and significant improvement in dispersion of zeta scores.     

Practical aspects of the uncertainty and traceability of spectrochemical measurement results by electrothermal atomic absorption spectrometry

The determination of trace elements concentration in water by electrothermal atomic absorption spectrometry (ETAAS) is a common and well established technique in many chemical testing laboratories. However, the evaluation of measurement uncertainty results is not systematically implemented. The paper presents an easy step-by-step example leading to the evaluation of the combined standard uncertainty of copper determination in water using ETAAS. The major contributors to the overall measurement uncertainty are identified due to amount of copper in water sample that mainly depends on the absorbance measurements, due to certified reference material and due to auto-sampler volume measurements. The practical aspects how the traceability of copper concentration in water can be established and demonstrated are also pointed out.     

Local comparability of proficiency testing results: determination of concrete slump and compressive strength values

A proficiency testing (PT) scheme is developed for comparability assessment of results of concrete slump and compressive strength determination. The scheme is based on preparing of a test portion/sample of a concrete in-house reference material (IHRM) at a reference laboratory (RL) in the same conditions for every PT participant. Therefore, in this scheme IHRM instability is not relevant as a source of measurement/test uncertainty, while intra- and between-samples inhomogeneity parameters are evaluated using the results of RL testing of the samples taken at the beginning, the middle and the end of the PT experiment. The IHRM assigned slump and compressive strength values are calculated as averaged RL results. Their uncertainties include the measurement/test uncertainty components and the components arising from the material inhomogeneity. The test results of 25 PT participants were compared with the IHRM assigned values taking into account both the uncertainties of the assigned values and the measurement/test uncertainties of the participants. Since traceability of the IHRM assigned values to the international measurement standards and SI units cannot be stated, local comparability of the results is assessed. It is shown, that comparability of the slump and compressive strength determination results is satisfactory, while uncertainty evaluation for slump results requires additional efforts.     

Traceability and its role in interlaboratory comparisons (proficiency testing programmes), modeled on trace element determination in biological materials

Traceability is not always evident in proficiency testing programs, although this is a requirement in ISO/IEC Guide?43-1. The assigned, or "true", value in most programs is not traceable to an independent entity. The test materials should generally be similar in nature to those routinely tested by participating laboratories. This is far from always the case and it is important to realize that if the difference is large, there may be no traceability to the testing program. It is also important that results from participation in proficiency tests are cited when papers are published, in order to enhance reliability/credibility of the published data.     

Performance evaluation of polycyclic aromatic hydrocarbons analysis in sediment from proficiency testing with metrological reference values

This paper describes a metrological approach to evaluate the measurement capability of laboratories participating in two proficiency testing (PT) programmes involving the analysis of five polycyclic aromatic hydrocarbons (PAHs) in sediment samples. Reference values of PAHs in the programmes for performance assessment were obtained from an accurate isotope dilution gas chromatography mass spectrometry (ID-GCMS) method which was thoroughly validated and verified. Isotope dilution mass spectrometry (IDMS) technique usually has a well-defined measurement uncertainty budget and a traceability link to an International System of Units. Provision of the metrological reference values in PT enables the establishment of a technical platform to assess the actual competence of the participating laboratories in sediment PAHs analysis. Results of the PT programmes showed that about 80 % of the laboratories employed gas chromatography in their analyses and the remaining used liquid chromatography. Irrespective of the techniques being used, however, the majority of the participating laboratories were observed to underestimate values in which the mean values of the five reported PAHs were less than those of the ID-GCMS-derived reference values by 13–20 %. Only 41–44 % of the participating laboratories were able to achieve satisfactory z-scores. The present study revealed that the reinforcement of the capability for accurate measurement of PAHs in sediment samples in laboratories worldwide should be addressed.     

Traceability and its role in interlaboratory comparisons (proficiency testing programmes), modeled on trace element determination in biological materials

 Traceability is not always evident in proficiency testing programs, although this is a requirement in ISO/IEC Guide 43-1. The assigned, or "true", value in most programs is not traceable to an independent entity. The test materials should generally be similar in nature to those routinely tested by participating laboratories. This is far from always the case and it is important to realize that if the difference is large, there may be no traceability to the testing program. It is also important that results from participation in proficiency tests are cited when papers are published, in order to enhance reliability/credibility of the published data.

     

Measurement uncertainty and its meaning in legal metrology of environmental chemistry and public health

 The need for reliability of measurements supporting legal decisions in environmental policy or medical diagnosis and treatment is well known and widely accepted. This prerequisite can be met only by ensuring that legal measurements are accurate and traceable to national or international standards. Consequently, an outline of the organizational structure of the Romanian National Institute of Metrology (INM) for ensuring uniformity, consistency and accuracy of all measurements including legal measurements performed in chemical laboratories is presented. Since reliable measurements can only be accomplished within an appropriate traceability chain, the experience of the INM in identification and evaluation of measurement uncertainty in legal activities concerning the environment and health is reviewed. Practical examples of measurement uncertainty evaluation in spectrophotometric determination of five analytes, commonly determined in environmental and clinical chemistry are described. The implications of measurement uncertainty for interpretation of regulatory compliance are discussed. Received: 3 January 1998 · Accepted: 9 June 1998     

Proficiency testing in the light of a new rationale in metrology

The novel proposed definition of measurement result in the international metrology vocabulary requires a revision of standards and guidelines for proficiency testing (PT), and a new approach to processing proficiency data is needed to test the ability of laboratories to present not only unbiased quantity values, but reliable estimates of their uncertainty. Hence, an accepted reference value with the smallest possible uncertainty is needed to ascertain the proficiency of laboratories reporting results with lower than average uncertainty. A strategy based on the T-statistic is proposed leading to an accepted reference value that fully reflects the uncertainties reported by participants in a PT scheme and permits calculation of E _n numbers to distinguish whether or not measurement results are consistent with the accepted definition of the measurand. The strategy is applied to PT data from a recent international laboratory intercomparison of uranium isotopic ratios.     

Evaluation of proficiency testing results taking into account their uncertainties

A new composite score for the evaluation of performance of proficiency testing participants is proposed. The score is based on a combination of the z-score, uncertainty of a participant’s measurement result and uncertainty of the proficiency testing scheme’s assigned value. The use of such a composite score will allow evaluation not only of the participant’s ability to determine an analyte in corresponding matrix, but also their understanding of the uncertainty in the obtained analytical result. The score may be helpful for the laboratory’s quality system and for laboratory accreditation according to ISO 17025.