“Demonstration” vs. “designation” of measurement competence: the need to link accreditation to metrology

Formal acceptance of the results of chemical laboratories is increasingly organized through a) accreditation of measuring laboratories nationally and b) mutual recognition of accreditation internationally (through formal Multilateral Recognition Agreements, MRAs). However, real comparability of results of measurements is realized by using common (internationally agreed) measurement scales which make these results traceable to this scale, i.e. “traceable” to the same (internationally agreed) value of the unit of that scale. In addition, the criterion against which the evaluation is done, should be “external” to the measurement laboratories which are being evaluated. This is realized in IRMM’s International Measurement Evaluation Programme (IMEP) where evaluation is performed against values which are anchored using “metrology”, the science of measurement with its own rules, which offers a sound foundation for measurement in all scientific disciplines. It is argued in this paper that the demonstration of measurement capability against values on such scales provides a result-oriented rather than a procedure-oriented evaluation. Thus, competence can be “demonstrated” rather than just “designated” and this can be shown to both customers and regulators. It inspires more confidence.     

Achieving traceability in chemical measurement—a metrological approach to proficiency testing

ISO/IEC 17025 requires that testing laboratories establish the traceability of their measurements, preferably to the SI units of measurement. The responsibility for establishing traceability lies with each individual laboratory and must be achieved by following a metrological approach.The results of measurements made in such a way are traceable to the standards used in method validation and to the calibration standards used during the measurement process. If these standards are traceable to SI then the measurements will also be traceable to SI.Participation in appropriate proficiency studies (an ISO/IEC 17025 requirement) enables laboratories to demonstrate the comparability of their measurements. If the materials used for the studies have traceable assigned values, then proficiency testing also provides information about measurement accuracy and confirms, or otherwise, that appropriate traceability has been established. This paper will report on a new approach for the establishment of traceable assigned values for chemical testing proficiency studies. The work is conducted at a "fit for purpose" level of measurement uncertainty, with costs contained at a level similar to previous "consensus" based proficiency studies. By establishing traceable assigned values in a cost effective way, NARL aims to demonstrate the added value of the metrological approach to participant laboratories.     

The NATA scheme for accreditation of certifiers of reference materials

 Certified reference materials are widely used for the calibration of measuring equipment and for the evaluation or validation of measurement procedures. The use of reference materials makes possible the transfer of the values of measured or assigned quantities between testing, analytical and measurement laboratories, both nationally and internationally. There is an increasing number of reference materials producers in other countries, and a demonstration of their scientific and technical competence is now more widely considered to be a basic requirement for ensuring the quality of reference materials. This article outlines recent activities by international bodies and their culmination in a scheme of accreditation of certifiers of reference materials which has been developed by the National Association of Testing Authorities, Australia (NATA).     

International Measurement Evaluation Programme: IMEP-9, trace elements in water

The International Measurement Evaluation Programme (IMEP) is an interlaboratory comparison scheme, founded, owned and coordinated by the Institute for Reference Materials and Measurements (IRMM) since 1988. IMEP-9 is the third round of trace elements in water evaluation following IMEP-3 and IMEP-6. Reference values for 15 elements stating total concentrations and combined uncertainties (according to GUM) were established. The reference values were established mainly by isotope dilution mass spectrometry (IDMS) as a primary method of measurement, and values traceable to the SI were obtained. The four elements that could not be certified by IDMS were assigned values by means of other measurement techniques. Results from 201 laboratories from 35 countries and four continents were evaluated against the reference values and the comparability between the laboratories is presented graphically.     

Integration of metrological principles in a proficiency-testing scheme in the field of water analysis

Measurement traceability is universally recognised as one of the basic prerequisites for comparability of results obtained in different laboratories and is a basic aspect of metrological sciences such as analytical chemistry. This requirement is underscored by the increasing adoption of standards and measurement quality systems, such as laboratory accreditation against ISO/IEC 17025. Testing laboratories ensure traceability of their measurement results by using appropriate reference standards for calibration of instruments and control of measurement processes. For routine work in the field of water analysis, these standards are usually commercial solutions or in-house solutions prepared from pure products. Therefore, laboratories should demonstrate that their use of reference standards is appropriate and sufficient, which can be done by participation in an appropriate proficiency-testing scheme. The paper reports how measurement traceability of results from field laboratories (nitrite nitrogen, nitrate nitrogen, chloride and sulphate; all in water) can be demonstrated by participation in a proficiency-testing scheme based on reference values.     

Performance evaluation for proficiency testing with a limited number of participants

Proficiency testing (PT) is an essential tool for laboratories to assess their competency. Also, participation in PT has become one of the mandatory requirements for laboratory to seek accreditation according to ISO/IEC 17025. For this reason, the effectiveness of performance evaluation by PT scheme is of great concern for the participants and for accreditation bodies as well. In practice, owing to unavailability of other appropriate alternatives, PT scheme providers may have to choose using consensus values to evaluate the performance of participants. However, such consensus values approach was not recommended by relevant international guidelines for PT schemes with limited number of participants. With the use of Monte Carlo simulation technique, this study attempted to investigate the effectiveness of using consensus values for performance evaluation in PT schemes with limited number of participants. The simulation process was schemed according to the statistical model provided by ISO 5725-1 for laboratory measurement results, which covered components like method bias, laboratory bias, and measurement precision. The effectiveness of the consensus value approach was expressed as the percentage of participants in a simulation run could get the same evaluation result, either satisfactory or unsatisfactory, against the “true value.” The findings indicated that the number of participants, choice of consensus values, mass fraction of analyte, method bias, laboratory bias, and measurement repeatability of participating laboratories would all affect the effectiveness of the consensus value approach but at different extent. However, under certain circumstances, use of consensus value could still be considered as an acceptable approach for performance evaluation even the number of participants was limited. Some of the findings were further verified using real data from PT schemes where appropriate certified reference materials or reliable reference values were available.     

Traceable measurements in clinical laboratories

 Reliable, traceable and comparable measurements provide the rational basis for evaluation of the quality of a result and the starting point for recognized laboratory accreditation in any national area. Modern medical diagnostics and treatment involve rapidly rising numbers and types of clinical laboratory measurements, that are reliable. Therefore, the basic principles to be followed to assure the traceability of clinical measurements as required by the Romanian Laws of Metrology are reviewed. Main sources affecting the quality of the unbroken chain of calibrations that relate the measurements back to appropriate measurement standards are discussed. Examples of how to achieve traceable measurements in clinical laboratories are presented. Details of specific uses of reference materials, measuring instruments and standard measurement methods are also discussed. Received: 8 January 1998 · Accepted: 21 April 1998     

European measurement comparison of <Superscript>137</Superscript>Cs, <Superscript>40</Superscript>K and <Superscript>90</Superscript>Sr in milk powder

Recently, the Institute for Reference Materials and Measurements (IRMM) has assumed responsibility for organizing regular measurement comparisons among those laboratories which provide radioactivity monitoring data from their country to authorities of the European Commission (EC) under various EC legislation articles. The most recent exercise under this International Comparison Scheme for Radioactivity Environmental Monitoring (ICS-REM) in measuring the ¹³⁷Cs, ⁴⁰K and the ⁹⁰Sr activity concentration in milk powder is presented here. The complete cycle of the comparison is described, including the establishment of reference values traceable to SI units, the demonstration of the homogeneity of the distributed samples, the treatment and measurement of samples in the participating laboratories, and the evaluation of the results.     

NATA: 50 years experience with accreditation

 Laboratory accreditation is becoming increasingly accepted around the world as a means of identifying technically competent laboratories. It is also being used as a mechanism for the acceptance of test data both nationally and internationally. The concept and mechanisms of accreditation have been developed over the past 50 years. The first national laboratory accreditation system appeared in Australia in 1947. This organisation, known as the National Association of Testing Authorities (NATA), has since taken a leading role in developing accreditation practices that are now used world-wide in evaluating testing, measurement and calibration laboratories. This paper examines the development of the world's first and largest laboratory accreditation system, and looks at the difficulties and triumphs in gaining acceptance and recognition by government and industry of the benefits of laboratory accreditation. Received: 24 June 1996 Accepted: 25 June 1996     

Using high-performance quantitative NMR (HP-qNMR®) for certifying traceable and highly accurate purity values of organic reference materials with uncertainties <0.1 %

Quantitative nuclear magnetic resonance (qNMR) in combination with metrological weighing is optimised to demonstrate the power of the qNMR measurement method. It is shown that with ¹H-qNMR it is possible to certify the purity of organic reference materials (expressed as mass fraction) with relative expanded uncertainties of <0.1 % for a 95 % confidence interval (k = 2). Following well-defined selection criteria, a set of twelve different chemical compounds is evaluated and certified to serve as internal references for ¹H-qNMR measurements. A series of comparison measurements is made amongst a subset of the selected compounds. The purity of maleic acid is determined by six different ¹H-qNMR measurement series, and all results show full consistency. All the six mean values are covered within the range of ±0.05 %. In two more measurement series, four different nuclei are analysed within the same sample against one calibrator. Even with non-optimised signal intensity ratios and varying signal pattern, a high consistency was obtained. Therefore, the validity and robustness of ¹H-qNMR measurement results are demonstrated. ¹H-qNMR measurement results are directly traceable to a variety of internationally accepted primary reference materials, and therefore, traceability to SI units is obtained. All experiments are performed under ISO/IEC 17025 and ISO Guide 34 accreditation.     

A convenient and economic approach to achieve SI-traceable reference values to be used in drinking-water interlaboratory comparisons

Metrologically traceable reference values add an essential benefit to interlaboratory comparisons: unlike consensus values, they can be used to establish national and international comparability. Furthermore, the participating laboratories obtain a reliable and unbiased benchmark to check their results for accuracy. Usually, metrologically traceable reference values are obtained by so-called primary methods which demand excessive efforts at great expense. Within the framework of two national drinking-water interlaboratory comparisons (proficiency testing rounds), a new approach to provide metrologically traceable reference values was applied. It is solely based on existing data which were collected during the comparison itself. Lead (Pb) measurements serve as an example to show how metrologically traceable reference values were derived from the lead amount added during sample preparation and the amount of lead already present in the drinking-water matrix used to prepare these samples. Within this approach, the matrix content is calculated in a way similar to a standard addition experiment. An uncertainty budget for the reference value was set up which describes the link to the corresponding SI units. Isotope dilution mass spectrometry (IDMS) as a primary method was used to validate this approach in the case of cadmium, chromium, copper, lead, and nickel.     

A strategy for a national metrology institute to create a cost effective distributed metrology infrastructure for chemical measurements

A sound strategy for a national metrology institute (NMI) is proposed, describing how to set up an metrology infrastructure for chemical measurements. A national measurement infrastructure is defined as a collection of various measurement services (testing, calibration and reference laboratories) and the communication between these services. For clarity, in this paper the distributed metrology infrastructure covers those organisations that are involved in disseminating measurement traceability (i.e. the national metrology institute and the reference laboratories acting as national reference standard holders).The strategy aims at a proper support of sectoral field laboratories. It is based on a distributed metrology system. Such a system is composed of clearly identified national reference standard holders for particular measurement services (e.g. for a particular analyte in a particular matrix) co-ordinated via an NMI. Such national reference standard holders, appointed by the NMI, represent the best measurement capability inside the country, and their appointment is based on demonstrated measurement competence. They receive support (e.g. under contract) from the NMI to fulfil this role. They have the obligation to demonstrate their measurement capabilities on a regular basis and in a publicly open and transparent way.In particular and carefully selected cases, the NMI itself can and should act as national reference standard holder. The NMI should particularly devote a large part of its resources to cross-sectoral knowledge transfer, to advice and co-ordination. This can be achieved by participating in teaching/training, by supporting the accreditation, by being involved in advising governmental bodies in authorisation of laboratories and by assisting in the implementation of legislation.As a consequence, only when values produced at the NMI (or one of its designated national reference standard holders) are disseminated to field laboratories (e.g. for CRMs or as a calibration service) will it be necessary to have the NMI measurement capability recognised under the CIPM-MRA system.Such a distributed system requires an efficient communication tool between the three stakeholders concerned: the NMI, the national reference standard holder and the end users. The latter not only include the field laboratories, but also governmental bodies and the national accreditation body.Presented at the XVIIIth IMEKO Congress in Dubrovnik-Cavtat, June 22–27, 2003Further contributors to this paper: M. Buzoianu (National Institute of Metrology, Bucharest), W.Kozlowski (Central Office of Measures, Warsaw), P. Klenovsky, Frantisek Jelinek (CMI, Prague), C. Michael (State General Laboratory, Nicosia), Zsofia Nagyné Szilágyi, (National Office of Measures, Budapest), V. Patoprsty (Slovak Institute of Metrology, Bratislava), A. Todorova (SAMTS Sofia)     

Protocols for traceability in chemical analysis

 In continuing their attempt to bring general issues concerned with trustworthy chemical measurements to review and international discussion, the authors propose basic aims and requirements for protocols of chemical-measurement procedures with traceability to the SI or, where this is not possible, to units of internationally recognized measurement scales. Documents describing such protocols could be useful in science, technology, law, or trade. Concepts and definitions for protocols have been introduced in Part I of this contribution. Part II here deals with the development and application of protocols for intended in-laboratory, commercial, national, or international recognition. Protocols deal with measurement methods, instrumentation, and the estimation of uncertainties from all possible sources of measurement errors. Uncertainties define the quality of all links in a traceability chain starting from the value of a measurand in a sample, often through a certified value in a reference material, either to the SI, or – if this is not possible – to a value on a suitable, internationally agreed measurement scale. A protocol may concern itself with the complex interplay between uncertainties, tolerances, and any limit values introduced by the set aims of specific measurements. Received: 23 April 1997 Accepted: 27 April 1997     

Interlaboratory comparison for the determination of pesticide residues in Chinese cabbage

The results of and findings from an interlaboratory comparison among laboratories carrying out food testing of pesticide residues in the APEC (Asia–Pacific Economic Cooperation) region are presented and discussed to show critical roles of chemical metrology infrastructure in establishing traceability of measurements and in supporting existing measurement capability in safety and quality of food trade. The study material, which was prepared and certified by Korea Research Institute of Standards and Science (KRISS), was freeze-dried Chinese cabbage powder fortified with two organophosphorous pesticides (diazinon and chlorpyrifos). Among 14 participants, 12 laboratories were accredited based on ISO/IEC17025 and one laboratory was under assessment for the accreditation at the time of this study. Though all participants demonstrated very good intra-day repeatability and inter-day intermediate precision, many of them showed a large bias from the certified values. It is suggested that in addition to the accreditation system, economies are encouraged to develop appropriate chemical metrology infrastructure, which could effectively support laboratories to assure measurement traceability to SI, for which NMIs could play significant roles through their metrological services recognized in Mutual Recognition Arrangement (MRA) of the International Committee for Weights and Measures (Comité International des Poids et Mesures, CIPM).     

Reliability of food measurements – a South African perspective

 High quality analysis of food involves a comprehensive process, which includes proper sampling, validated methodology, experienced technical staff and the use of standard reference materials. Today there is more international emphasis not only on generating food composition data but also on data quality and the main issue is that South African data should be internationally recognized as acceptable and representative. Quality is multi-dimensional and should at least include aspects of accuracy, precision and representativeness. A major step forward is that laboratories can apply for accreditation, which involves, inter alia, documented, validated methodology, regular interlaboratory studies, the use of certified reference materials and the existence of a sound quality system. The South African National Accreditation System (SANAS) is a regulatory body in South Africa, which is internationally recognized. Assessment of laboratories against specific standards is performed regularly and laboratories have to comply with certain managerial and technical requirements. Once a laboratory is accredited, ongoing validation and verification of results as well as regular assessment ensure reliability of results and overall competency of the laboratory. With a quality assurance programme in place, the reliability of results of the Irene laboratory is beyond doubt and nutrient data could be included in food composition tables. Received: 31 January 2002 Accepted: 4 February 2002 Correspondence to Louwrens Erasmus Smit     

Measurement uncertainty – a reliable concept in food analysis and for the use of recovery data?

 Steps which are taken to implement the concept of measurement uncertainty in analytical chemical laboratories should take full account of existing internationally agreed protocols for analytical quality assurance and reflect the needs of particular analytical sectors. For the food sector this may mean that for official purposes the use of the term measurement uncertainty is replaced by the term measurement reliability and that a quantitative estimation of this is made based on existing collaborative trial data. In many analytical sectors, the differing strategies currently followed for the determination and use of recovery information are an important cause of the non-comparability of analytical results. Guidelines which are being prepared for the estimation and use of recovery information in analytical measurement may provide a more unified approach which includes measurement uncertainty as a key concept in the use of recovery data. Received: 4 November 1997 · Accepted: 3 February 1998     

From a single analyzer to multiple instruments—The GUM approach

Assessment and expression of analytical quality have become novel spotlights in medical laboratories since accreditation began in the early 1990s, in Europe. Evaluation of uncertainty of measurement by definition was launched in Finland when the Finnish Accreditation Service (FINAS) accredited the first medical laboratories in the mid 1990s. In spite of all the analytical and statistical knowledge which has been available in medical laboratories for years, evaluation of total uncertainty of measurement has not yet caught on. The concept is still unfamiliar to experts and, indeed, little guidance has been available. National and international activities, with good results, can be shown when the educational aspect is considered. The Guide to the Expression of Uncertainty in Measurement (GUM) remains the main document for uncertainty evaluation. Uncertainty of measurement together with target value of uncertainty can be used as a good measure for analytical quality in large or smaller laboratories over time, because it is a quantitative indication and the evaluation is easy to repeat as running practical tools are available.Presented at the 8th Conference on Quality in the Spotlight, 17–18 March 2003, Antwerp, Belgium     

Accreditation in analytical laboratories: a critical assessment of its impact on human beings and techniques

Summary The relationships between Quality, Quality Assurance and Third Party Approval by accreditation based on formal application of EN 29002, EN 45001 and ISO Guide 25 are briefly outlined for analytical chemical laboratories working in the non-regulated area. The roles of human beings in laboratories and accreditation bodies are discussed and recommendations are made on how to minimize friction during accreditation processes. The structures of the European Accreditation Systems are reviewed and the efforts towards mutual recognition of the national accreditation bodies are described and critically assessed. The lack of competition based on free market conditions in the framework of company law is deplored. The assessment of laboratory systems, rather than assessing the activity of laboratories against technical standards, is recommended (unless it is otherwise requested). The beneficial effects of the process of accreditation on competence and quality of the activity of the laboratory are emphasized.