Reference material requirements for laboratories and the role of accreditation bodies

It is now over two years since ISO/IEC 17025 General requirements for the competence of testing and calibration laboratories was published. The standard places increased emphasis on the demonstration of traceability of measurements made by laboratories. In the areas of chemical and biological metrology, the introduction of this standard has brought new challenges for laboratories to grapple with. This paper will examine the requirements regarding traceability for chemical and biological measurements, with specific reference to the use of reference materials by laboratories. This will be explored from the perspective of both accreditation bodies and a laboratory which is both a user and producer of certified reference materials. Moreover, the paper will describe mechanisms that are being used to improve the use of reference materials by accredited laboratories and hence the traceability of measurements. Finally the role of accreditation programs for reference material producers in assisting with this aspect will be examined.Electronic Supplementary Material Supplementary material is available for this article if you access the article at . A link in the frame on the left on that page takes you directly to the supplementary material.Presented at BERM-9—Ninth International Symposium on Biological and Environmental Reference Materials, June 15–19, 2003 Berlin, Germany.     

A strategy for a national metrology institute to create a cost effective distributed metrology infrastructure for chemical measurements

A sound strategy for a national metrology institute (NMI) is proposed, describing how to set up an metrology infrastructure for chemical measurements. A national measurement infrastructure is defined as a collection of various measurement services (testing, calibration and reference laboratories) and the communication between these services. For clarity, in this paper the distributed metrology infrastructure covers those organisations that are involved in disseminating measurement traceability (i.e. the national metrology institute and the reference laboratories acting as national reference standard holders).The strategy aims at a proper support of sectoral field laboratories. It is based on a distributed metrology system. Such a system is composed of clearly identified national reference standard holders for particular measurement services (e.g. for a particular analyte in a particular matrix) co-ordinated via an NMI. Such national reference standard holders, appointed by the NMI, represent the best measurement capability inside the country, and their appointment is based on demonstrated measurement competence. They receive support (e.g. under contract) from the NMI to fulfil this role. They have the obligation to demonstrate their measurement capabilities on a regular basis and in a publicly open and transparent way.In particular and carefully selected cases, the NMI itself can and should act as national reference standard holder. The NMI should particularly devote a large part of its resources to cross-sectoral knowledge transfer, to advice and co-ordination. This can be achieved by participating in teaching/training, by supporting the accreditation, by being involved in advising governmental bodies in authorisation of laboratories and by assisting in the implementation of legislation.As a consequence, only when values produced at the NMI (or one of its designated national reference standard holders) are disseminated to field laboratories (e.g. for CRMs or as a calibration service) will it be necessary to have the NMI measurement capability recognised under the CIPM-MRA system.Such a distributed system requires an efficient communication tool between the three stakeholders concerned: the NMI, the national reference standard holder and the end users. The latter not only include the field laboratories, but also governmental bodies and the national accreditation body.Presented at the XVIIIth IMEKO Congress in Dubrovnik-Cavtat, June 22–27, 2003Further contributors to this paper: M. Buzoianu (National Institute of Metrology, Bucharest), W.Kozlowski (Central Office of Measures, Warsaw), P. Klenovsky, Frantisek Jelinek (CMI, Prague), C. Michael (State General Laboratory, Nicosia), Zsofia Nagyné Szilágyi, (National Office of Measures, Budapest), V. Patoprsty (Slovak Institute of Metrology, Bratislava), A. Todorova (SAMTS Sofia)     

“Demonstration” vs. “designation” of measurement competence: the need to link accreditation to metrology

Formal acceptance of the results of chemical laboratories is increasingly organized through a) accreditation of measuring laboratories nationally and b) mutual recognition of accreditation internationally (through formal Multilateral Recognition Agreements, MRAs). However, real comparability of results of measurements is realized by using common (internationally agreed) measurement scales which make these results traceable to this scale, i.e. “traceable” to the same (internationally agreed) value of the unit of that scale. In addition, the criterion against which the evaluation is done, should be “external” to the measurement laboratories which are being evaluated. This is realized in IRMM’s International Measurement Evaluation Programme (IMEP) where evaluation is performed against values which are anchored using “metrology”, the science of measurement with its own rules, which offers a sound foundation for measurement in all scientific disciplines. It is argued in this paper that the demonstration of measurement capability against values on such scales provides a result-oriented rather than a procedure-oriented evaluation. Thus, competence can be “demonstrated” rather than just “designated” and this can be shown to both customers and regulators. It inspires more confidence.     

Traceability and uncertainty – A comparison of their application in chemical and physical measurement

 Establishment of the traceability and the evaluation of the uncertainty of the result of a measurement are essential in order to establish its comparability and fitness for purpose. There are both similarities and differences in the way that the concepts of traceability and uncertainty have been utilised in physical and chemical measurement. The International Committee of Weights and Measures (CIPM) have only in the last decade set up programmes in chemical metrology similar to those that have been in existence for physical metrology for over a century. However, analytical chemists over that same period have also developed techniques, based on the concepts of traceability and uncertainty, to ensure that their results are comparable and fit for purpose. This paper contrasts these developments in physical and chemical metrology and identifies areas where these two disciplines can learn from each other.     

Comparability and recognition of chemical measurement results – an international goal

As a consequence of the globalisation of trade and industry and other human activities, reliability of and confidence in measurement results is increasingly required, also in the field of chemical analysis, so that measurements made in one country will be accepted in other countries without the necessity to repeat them. The prerequisite for confidence is comparability on the basis of known uncertainties which in turn are based on traceability to recognised references. Traceability structures for chemical measurements are required which, by providing calibration means traceable to national standards, allow uncertainty statements to be made at field level, thus establishing comparability. Such traceability structures are now being developed in all industrialised countries. To ensure international comparability, mutual recognition of the national activities in metrology in chemistry is required in addition. The Mutual Recognition Agreement (MRA) for national measurement standards and calibration certificates issued by national metrology institutes, which is currently under way within the framework of the Metre Convention, aimes at providing the necessary international confidence for all kinds of measurements. The field of chemical analysis is included in the international metrological infrastructure through the new Consultative Committee for Amount of Substance (CCQM). Carefully selected key comparison measurements, which cover the most important areas where traceability is required, and which are carried out by national metrology institutes in cooperation with other national institutes entrusted with the provision of part of the national references for chemical measurements, form the basis for declarations of equivalence under the MRA. The results of the first key comparisons and studies carried out so far clearly show that the group of laboratories involved in the key comparisons is capable of establishing the international references (key comparison reference values) for chemical measurements with sufficient accuracy, also in complicated matrices.     

"Demonstration" vs. "designation" of measurement competence: the need to link accreditation to metrology

Formal acceptance of the results of chemical laboratories is increasingly organized through a) accreditation of measuring laboratories nationally and b) mutual recognition of accreditation internationally (through formal Multilateral Recognition Agreements, MRAs). However, real comparability of results of measurements is realized by using common (internationally agreed) measurement scales which make these results traceable to this scale, i.e. "traceable" to the same (internationally agreed) value of the unit of that scale. In addition, the criterion against which the evaluation is done, should be "external" to the measurement laboratories which are being evaluated. This is realized in IRMM's International Measurement Evaluation Programme (IMEP) where evaluation is performed against values which are anchored using "metrology", the science of measurement with its own rules, which offers a sound foundation for measurement in all scientific disciplines. It is argued in this paper that the demonstration of measurement capability against values on such scales provides a result-oriented rather than a procedure-oriented evaluation. Thus, competence can be "demonstrated" rather than just "designated" and this can be shown to both customers and regulators. It inspires more confidence.     

Proficiency testing and external quality assurance: crossing borders and disciplines

Proficiency testing and external quality assurance of medical laboratories is now entering its sixth decade. These activities comprise a broad range of applications including: providing participants and public health authorities with estimates of measurement uncertainty and national infrastructure; providing education; provision of a practical basis for accreditation and regulatory compliance. All branches of medical laboratory science have employed external quality assurance as a basis for improvement and comparability. The opportunities and challenges reviewed here include: the proper establishment of multiple target values in comparison to a system of traceability to reference or definitive methods; the problems of matrix effects and commutability of patient and proficiency test samples; generating information on laboratory infrastructure and trends in analytical technique and performance; providing education and setting goals for laboratory improvement; problems of specimen distribution; application of Internet technology; the role of programs in legal mandates and accreditation. Received: 24 April 2002 Accepted: 11 July 2002     

The use of certified reference materials in the Romanian traceability scheme

 For ensuring the traceability and uniformity of measurement results, the main objectives of national metrology programmes in chemistry are to calibrate and verify measuring instruments, to evaluate the uncertainty of measurement results and to intercompare the analytical results, etc. The concept of traceability has developed recently in chemical measurements, thus, an attempt to implement the principles of metrological traceability especially by appropriateness calibration using composition certified reference materials (CRMs) is underlined. Interlaboratory comparisons are also a useful response to the need for comparable results. The paper presents some aspects and practices in the field of spectrometric measurement regarding the metrological quality of the traceability by calibrating the instruments using suitable and reliable CRMs. The uncertainty of results, as a measure of the reliability that can be placed on them, has been adequately described in different documents and, as a consequence, some examples of evaluating the measurement uncertainty are described. The relationship between uncertainty and traceability, as two fundamental concepts of metrology which are intimately linked, is underlined. Received: 12 November 1999 / Accepted: 10 December 1999     

A national traceability system for chemical measurements

Current developments in Germany for establishing a traceability system for chemical measurements are reported. The focus is on a dissemination mechanism which employs chemical calibration laboratories accredited within the framework of the German Calibration Service (DKD) and acting as "multipliers" between the national standards level and the user level by providing the user with calibration means which are traceable to the SI via national standards. At the national standards level, a network of high-level chemistry institutes coordinated by the national metrology institute, PTB, provides the primary references for chemical measurements.The use of the metrological dissemination system provided by the DKD also for chemical measurements is a logical extension of a traceability mechanism, successful for more than two decades in general metrology, to metrology in chemistry. In detail, traceability structures in clinical chemistry, electrochemistry, elemental analysis and gas analysis are described. This system has become an important part of the efforts made in Germany to support chemical laboratories in meeting the traceability requirements of the market and of legal regulations.     

Measurements: developments in the USA

Summary Sales and use of analytical instruments have expanded in the United States over the past two years, despite the recessionary nature of the economy. Interest in increasing the quality of analytical measurements seems to be undiminished, if not growing. Trends in several measurement areas, including health, environment, manufacturing, and commerce, are described as they bear on this growth of interest in reliably accurate measurements. The paper also considers trends in the development of reference materials and accreditation of laboratories in the USA. United States of America participation in efforts of the International Organization for Standardization, and a study by the International Bureau of Weights and Measures of how to provide for international traceability for analytical chemical measurements are mentioned.     

Performance evaluation for proficiency testing with a limited number of participants

Proficiency testing (PT) is an essential tool for laboratories to assess their competency. Also, participation in PT has become one of the mandatory requirements for laboratory to seek accreditation according to ISO/IEC 17025. For this reason, the effectiveness of performance evaluation by PT scheme is of great concern for the participants and for accreditation bodies as well. In practice, owing to unavailability of other appropriate alternatives, PT scheme providers may have to choose using consensus values to evaluate the performance of participants. However, such consensus values approach was not recommended by relevant international guidelines for PT schemes with limited number of participants. With the use of Monte Carlo simulation technique, this study attempted to investigate the effectiveness of using consensus values for performance evaluation in PT schemes with limited number of participants. The simulation process was schemed according to the statistical model provided by ISO 5725-1 for laboratory measurement results, which covered components like method bias, laboratory bias, and measurement precision. The effectiveness of the consensus value approach was expressed as the percentage of participants in a simulation run could get the same evaluation result, either satisfactory or unsatisfactory, against the “true value.” The findings indicated that the number of participants, choice of consensus values, mass fraction of analyte, method bias, laboratory bias, and measurement repeatability of participating laboratories would all affect the effectiveness of the consensus value approach but at different extent. However, under certain circumstances, use of consensus value could still be considered as an acceptable approach for performance evaluation even the number of participants was limited. Some of the findings were further verified using real data from PT schemes where appropriate certified reference materials or reliable reference values were available.     

On practical metrology and chemical analysis: etalons and traceability systems

 National measurement systems are infrastructures to ensure, for each nation, a consistent and internationally recognised basis for measurement. Such complex systems have historical, technical, legal, organisational and institutional aspects to connect scientific metrology with practical measurements. Underlying any valid measurement is a chain of comparisons linking the measurement to an accepted standard. The ways the links are forged and the etalons (measurement standards) to which they connect are defining characteristics of all measurement systems. This is often referred to as traceability which aims at basing measurements in common measurement units – a key issue for the integration of quantitative chemical analysis with the evolving physical and engineering measurement systems. Adequate traceability and metrological control make possible new technical capabilities and new levels of quality assurance and confidence by users in the accuracy and integrity of quantitative analytical results. Traceability for chemical measurements is difficult to achieve and harder to demonstrate. The supply of appropriate etalons is critical to the development of metrology systems for chemical analysis. An approach is suggested that involves the development of networks of specialised reference laboratories able to make matrix-independent reference measurements on submitted samples, which may then be used as reference materials by an originating laboratory using its practical measurement procedures. Received: 31 July 1995 Accepted: 19 August 1995     

The traceability scheme in chemical measurement

 Traceability is an essential property of a measurement result. However, it is recognized that the results of chemical measurements can be lacking in this property. In this paper we try to show how to understand and establish traceability in chemical measurement. The traceability connotation and the necessity of tracing back to SI units are described by means of comparability well-known. The roles and interrelationships of quality assurance, accreditation, calibration, reference material, analytical method, comparison and uncertainty in establishing traceability are explained with the aid of a block diagram. The paper also includes diagrams illustrating the Chinese situation and experience of establishing traceability for chemical measurement in China.     

Key metrological issues in proficiency testing––response to “Metrological compatibility-a key issue in further accreditation” by K. Heydorn

A discussion of proficiency testing (PT) topics started by Heydorn (Accred Qual Assur 15:643–645, 2010) is continued in the present paper. The role of PT in the accreditation of testing/analytical laboratories, the use of consensus values (average or weighted average, median, observed standard deviation, etc.) and a metrological background of PT schemes are discussed. It is shown that metrological traceability, comparability, and compatibility, as well as commutability of a reference material, are the key issues of any PT scheme that applies certified reference material as test items. Metrological compatibility of PT results in such schemes is a property demonstrating the closeness of the PT results to the certified value in comparison with the measurement uncertainty of their difference. The metrological background is especially important for the selection and use of PT schemes for a limited number of participants (fewer than 30) as detailed in IUPAC/CITAC Guide on the topic published in 2010 in Pure Appl Chem 82(5):1099–1135.     

IMEP in support of the comparability of measurement results across the Romanian chemical metrology infrastructure

On the basis of quantitative chemical measurements many important decisions are made in support of legislation or in industrial processes or social aspects. For this reason it is important to improve the quality of chemical measurement results and thus make them comparable and acceptable everywhere. The measurement quality is important to enable an equivalent implementation of the European Union regulations and directives across an enlarged EU. In this context, the European Commission–Joint Research Centre–Institute for Reference Materials and Measurement (EC-JRC-IRMM) set up a programme to improve the scientific basis for metrology in chemistry (MiC) in EU candidate countries in the framework of EU enlargement. Several activities were initiated, such as training, fellowships, sponsoring of seminars, conferences and participation in interlaboratory comparisons. To disseminate measurement traceability, IRMM provides through its International Measurement Evaluation Programme (IMEP) an interlaboratory tool to enable the benchmarking of laboratory performance. IMEP emphasizes the metrological aspects of measurement results, such as traceability and measurement uncertainty. In this way it has become a publicly available European tool for MiC. The Romanian Bureau of Legal Metrology – National Institute of Metrology (BRML-INM) actively supports the participation of Romanian authorized and field laboratories in IMEP interlaboratory comparisons. This paper describes the interest of Romanian laboratories participating in this programme, the analytical and metrological problems that became relevant during these exercises and some actions for improvement. The results from Romanian laboratories participating in IMEP-12 (water), IMEP-16 (wine), IMEP-17 (human serum) and IMEP-20 (tuna fish) are presented. To conclude, the educational and training activities at national level organized jointly by the Romanian National Institute of Metrology (INM) and IRMM are also mentioned.     

Comparability and compatibility of proficiency testing results in schemes with a limited number of participants

Comparability and compatibility of proficiency testing (PT) results are discussed for schemes with a limited number of participants (less than 20–30) based on the use of reference materials (RMs) as test items. Since PT results are a kind of measurement/analysis/test result, their comparability is a property conditioned by traceability to measurement standards applied in the measurement process. At the same time, metrological traceability of the certified value of the RM (sent to PT participants as test items) is also important, since the PT results are compared with the RM certified value. The RM position in the calibration hierarchy of measurement standards sets the degree of comparability for PT results, which can be assessed in the scheme. However, this assessment is influenced by commutability (adequacy or match) of the matrix RM used for PT and routine samples. Compatibility of PT results is a characteristic of the collective (group) performance of the laboratories participating in PT that can be expressed as closeness of the distribution of the PT results to the distribution of the RM data. Achieving quality-of-measurement/analysis/test results in the framework of the concept “tested once, accepted everywhere” requires both comparability and compatibility of the test results.     

The increasing demands of quality assurance in chemical testing

The chemical and microbiological testing community is going through a rather difficult period of change. Publication of ISO/IEC 17025 (General requirements for the competence of Calibration and Testing Laboratories, 1999) [1] is placing additional demands on testing laboratories to ensure traceability and estimate uncertainty in their measurements. At the same time, laboratories must remain mindful of the need to provide relevant, timely and economic services to their clients. International Accreditation New Zealand (IANZ) and its accredited laboratories are currently focussing on establishing realistic methods for ensuring traceability to national and international standards and estimating measurement uncertainty. To this end, IANZ recognizes that it has an important role in providing as much advice and assistance as possible, not only to its accredited chemical laboratories but also to all those contemplating accreditation in New Zealand.

The key elements of traceability in chemical measurement: agreed or still under debate?

 Talking about "traceability" means talking about a "property of the result of a measurement", about "the value of a standard", about "stated references" and about an "unbroken chain of comparisons". It describes by which comparison, and to which other value, the result of a measurement has been obtained, i.e. is "traceable to". It is about the underlying structure of the measurement process of the result of a measurement and therefore about the authority of the result. Since values carried by (certified) reference materials have also been obtained by measurement, the definition of traceability equally applies. Traceability in the context of reference materials is also about the authority of the values carried by the (certified) reference materials and is, therefore, of key importance for the authority of the reference materials themselves. Hence, values of results of measurements constitute part of the traceability chain and their uncertainties are an intrinsic accompanying phenomenon. Uncertainties need a traceability chain against which they can be evaluated, and a traceability chain is an a priori requirement for evaluating the uncertainty budget of a measurement result. An attempt has been made to exemplify "traceability" chains in some types of chemical measurement and to identify the degree of international agreement on the key elements of "traceability". It is concluded that there is less than universal agreement on this issue. The debate should continue in order to arrive at the international understanding and agreement needed, as "traceability" is now being incorporated in the International Organization for Standardization (ISO), the International Laboratory Accreditation Co-operation (ILAC) and in other "guiding" or regulatory documents. It is also the reason why the Institute for Reference Materials and Measurements (IRMM) has taken up the study of the concept in its core programme on Metrology in Chemistry, and why it sponsored the Workshop in Bratislava.

     

Laboratory accreditation in Italy for reference solution production of sucrose in water

The accreditation of Chemifarm srl laboratory for the calibration of two characteristics on the same aqueous solution has been achieved. The process has been executed by the Italian accreditation body for calibration laboratories (SIT). This is the first example of a producer of certified reference solutions in Italy. The solutions are mixtures of sucrose in water at several concentrations and are characterised for refractive index in the range of 1.33299 to 1.38115 and for mass fraction of sucrose in the range of 0 to 30 (commercially expressed in Brix degrees). Both traceability paths, obtained through refractometric and gravimetric methods, are reported. Furthermore, the paper describes the approach adopted to match the criteria based on ISO Guide 34 and ILAC-G 12, the documents with requirements for certified reference material producers, in compliance with those of ISO/IEC 17025, the norm for the laboratory accreditation.